Jul 23 15:12:33.787179 ip-10-0-128-213 systemd[1]: Starting Kubernetes Kubelet... Jul 23 15:12:35.456267 ip-10-0-128-213 systemd[1]: Started Kubernetes Kubelet. Jul 23 15:12:35.477398 ip-10-0-128-213 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 15:12:35.477398 ip-10-0-128-213 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 23 15:12:35.477398 ip-10-0-128-213 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 15:12:35.477398 ip-10-0-128-213 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 23 15:12:35.477398 ip-10-0-128-213 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 15:12:35.477398 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.260484 2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 23 15:12:35.477398 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270479 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 15:12:35.477398 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270497 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 15:12:35.477398 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270503 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 15:12:35.477398 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270507 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 15:12:35.477398 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270512 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 15:12:35.477398 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270516 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 15:12:35.477398 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270520 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 15:12:35.477398 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270523 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 15:12:35.479415 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270530 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 15:12:35.479415 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270545 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 15:12:35.479415 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270550 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 15:12:35.479415 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270555 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 15:12:35.479415 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270558 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 15:12:35.479415 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270562 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 15:12:35.479415 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270566 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 15:12:35.479415 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270570 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 15:12:35.479415 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270574 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 15:12:35.479415 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270579 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 15:12:35.479415 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270583 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 15:12:35.479415 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270587 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 15:12:35.479415 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270592 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 15:12:35.479415 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270596 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 15:12:35.479415 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270601 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 15:12:35.479415 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270606 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 15:12:35.479415 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270611 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 15:12:35.479415 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270614 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 15:12:35.479415 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270619 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 15:12:35.479415 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270622 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 15:12:35.483443 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270626 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 15:12:35.483443 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270630 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 15:12:35.483443 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270633 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 15:12:35.483443 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270637 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 15:12:35.483443 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270643 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 15:12:35.483443 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270648 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 15:12:35.483443 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270653 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 15:12:35.483443 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270658 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 15:12:35.483443 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270662 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 15:12:35.483443 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270666 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 15:12:35.483443 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270671 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 15:12:35.483443 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270675 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 15:12:35.483443 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270679 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 15:12:35.483443 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270682 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 15:12:35.483443 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270686 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 15:12:35.483443 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270690 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 15:12:35.483443 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270694 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 15:12:35.483443 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270697 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 15:12:35.483443 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270701 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 15:12:35.484199 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270705 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 15:12:35.484199 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270709 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 15:12:35.484199 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270713 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 15:12:35.484199 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270717 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 15:12:35.484199 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270720 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 15:12:35.484199 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270725 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 15:12:35.484199 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270728 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 15:12:35.484199 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270734 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 15:12:35.484199 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270738 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 15:12:35.484199 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270742 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 15:12:35.484199 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270746 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 15:12:35.484199 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270749 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 15:12:35.484199 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270753 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 15:12:35.484199 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270756 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 15:12:35.484199 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270761 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 15:12:35.484199 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270764 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 15:12:35.484199 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270768 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 15:12:35.484199 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270772 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 15:12:35.484199 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270776 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 15:12:35.484199 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270780 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 15:12:35.487303 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270788 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 15:12:35.487303 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270792 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 15:12:35.487303 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270796 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 15:12:35.487303 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270800 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 15:12:35.487303 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270804 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 15:12:35.487303 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270807 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 23 15:12:35.487303 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270811 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 15:12:35.487303 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270815 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 15:12:35.487303 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270819 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 15:12:35.487303 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270823 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 15:12:35.487303 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270827 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 15:12:35.487303 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270831 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 15:12:35.487303 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270835 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 15:12:35.487303 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270839 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 15:12:35.487303 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270843 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 15:12:35.487303 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270849 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 15:12:35.487303 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270853 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 15:12:35.487303 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270858 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 15:12:35.487303 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270876 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 15:12:35.488055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270881 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 15:12:35.488055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270886 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 15:12:35.488055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270889 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 15:12:35.488055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270893 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 15:12:35.488055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270896 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 15:12:35.488055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270900 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 15:12:35.488055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270904 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 15:12:35.488055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270908 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 15:12:35.488055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270911 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 15:12:35.488055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270915 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 15:12:35.488055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270919 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 15:12:35.488055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270923 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 15:12:35.488055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.270929 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 15:12:35.488055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272721 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 15:12:35.488055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272732 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 15:12:35.488055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272737 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 15:12:35.488055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272741 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 15:12:35.488055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272745 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 15:12:35.488055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272749 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 15:12:35.488055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272755 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 15:12:35.490750 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272761 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 15:12:35.490750 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272765 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 15:12:35.490750 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272770 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 15:12:35.490750 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272775 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 15:12:35.490750 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272778 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 15:12:35.490750 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272782 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 15:12:35.490750 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272786 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 15:12:35.490750 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272790 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 15:12:35.490750 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272794 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 15:12:35.490750 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272799 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 15:12:35.490750 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272803 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 15:12:35.490750 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272808 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 15:12:35.490750 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272814 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 15:12:35.490750 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272818 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 15:12:35.490750 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272822 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 15:12:35.490750 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272826 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 15:12:35.490750 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272830 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 15:12:35.490750 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272834 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 15:12:35.490750 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272838 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 15:12:35.490750 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272843 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 15:12:35.491532 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272849 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 15:12:35.491532 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272853 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 15:12:35.491532 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272858 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 15:12:35.491532 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272876 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 15:12:35.491532 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272881 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 15:12:35.491532 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272887 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 15:12:35.491532 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272891 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 15:12:35.491532 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272896 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 15:12:35.491532 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272901 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 15:12:35.491532 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272905 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 15:12:35.491532 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272909 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 15:12:35.491532 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272913 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 15:12:35.491532 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272916 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 15:12:35.491532 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272920 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 15:12:35.491532 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272924 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 15:12:35.491532 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272929 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 15:12:35.491532 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272933 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 15:12:35.491532 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272937 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 15:12:35.491532 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272941 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 15:12:35.495449 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272945 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 15:12:35.495449 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272949 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 15:12:35.495449 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272953 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 15:12:35.495449 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272956 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 15:12:35.495449 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272960 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 23 15:12:35.495449 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272964 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 15:12:35.495449 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272968 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 15:12:35.495449 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272972 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 15:12:35.495449 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272975 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 15:12:35.495449 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272979 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 15:12:35.495449 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272983 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 15:12:35.495449 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272986 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 15:12:35.495449 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272990 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 15:12:35.495449 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272994 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 15:12:35.495449 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.272998 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 15:12:35.495449 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273002 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 15:12:35.495449 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273006 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 15:12:35.495449 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273010 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 15:12:35.495449 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273013 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 15:12:35.495449 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273017 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 15:12:35.496234 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273021 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 15:12:35.496234 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273027 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 15:12:35.496234 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273031 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 15:12:35.496234 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273038 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 15:12:35.496234 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273043 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 15:12:35.496234 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273048 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 15:12:35.496234 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273052 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 15:12:35.496234 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273055 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 15:12:35.496234 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273060 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 15:12:35.496234 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273064 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 15:12:35.496234 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273068 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 15:12:35.496234 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273072 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 15:12:35.496234 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273076 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 15:12:35.496234 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273080 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 15:12:35.496234 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273084 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 15:12:35.496234 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273088 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 15:12:35.496234 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273092 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 15:12:35.496234 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273096 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 15:12:35.496234 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273099 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 15:12:35.496234 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273103 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 15:12:35.500988 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273107 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 15:12:35.500988 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273111 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 15:12:35.500988 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273116 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 15:12:35.500988 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273119 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 15:12:35.500988 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273123 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 15:12:35.500988 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273127 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 15:12:35.500988 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273131 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 15:12:35.500988 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273135 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 15:12:35.500988 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273139 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 15:12:35.500988 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273143 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 15:12:35.500988 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273146 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 15:12:35.500988 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273151 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 15:12:35.500988 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273154 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 15:12:35.500988 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273746 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 15:12:35.500988 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273753 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 15:12:35.500988 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273780 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 15:12:35.500988 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273787 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 15:12:35.500988 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273792 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 15:12:35.500988 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273796 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 15:12:35.501720 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273800 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 15:12:35.501720 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273804 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 15:12:35.501720 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273809 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 15:12:35.501720 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273814 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 15:12:35.501720 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273818 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 15:12:35.501720 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273821 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 15:12:35.501720 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273826 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 15:12:35.501720 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273830 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 15:12:35.501720 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273835 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 15:12:35.501720 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273839 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 15:12:35.501720 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273843 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 15:12:35.501720 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273847 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 15:12:35.501720 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273851 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 15:12:35.501720 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273855 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 15:12:35.501720 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273859 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 15:12:35.501720 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273897 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 15:12:35.501720 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273919 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 15:12:35.501720 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273924 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 15:12:35.501720 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273927 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 15:12:35.502516 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273930 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 15:12:35.502516 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273934 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 15:12:35.502516 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273937 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 15:12:35.502516 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273939 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 15:12:35.502516 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273943 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 15:12:35.502516 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273945 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 15:12:35.502516 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273948 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 15:12:35.502516 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273951 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 15:12:35.502516 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273957 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 15:12:35.502516 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273960 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 15:12:35.502516 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273963 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 15:12:35.502516 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273965 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 15:12:35.502516 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273968 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 15:12:35.502516 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273971 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 15:12:35.502516 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273974 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 15:12:35.502516 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273977 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 15:12:35.502516 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273980 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 15:12:35.502516 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273983 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 15:12:35.502516 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273985 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 15:12:35.502516 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273988 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 15:12:35.601202 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273990 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 15:12:35.601202 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273995 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 15:12:35.601202 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.273999 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 15:12:35.601202 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274002 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 15:12:35.601202 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274005 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 15:12:35.601202 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274008 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 15:12:35.601202 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274011 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 15:12:35.601202 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274016 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 15:12:35.601202 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274019 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 15:12:35.601202 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274022 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 15:12:35.601202 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274025 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 15:12:35.601202 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274028 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 15:12:35.601202 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274030 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 15:12:35.601202 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274033 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 15:12:35.601202 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274036 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 15:12:35.601202 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274038 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 15:12:35.601202 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274041 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 15:12:35.601202 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274044 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 15:12:35.601202 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274068 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 15:12:35.601202 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274072 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 15:12:35.601950 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274075 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 15:12:35.601950 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274078 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 15:12:35.601950 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274081 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 15:12:35.601950 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274084 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 15:12:35.601950 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274087 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 15:12:35.601950 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274090 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 15:12:35.601950 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274093 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 15:12:35.601950 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274096 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 15:12:35.601950 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274100 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 15:12:35.601950 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274104 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 15:12:35.601950 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274107 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 15:12:35.601950 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274110 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 15:12:35.601950 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274113 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 15:12:35.601950 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274115 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 15:12:35.601950 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274118 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 15:12:35.601950 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274121 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 15:12:35.601950 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274124 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 15:12:35.601950 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274127 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 15:12:35.601950 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274130 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 15:12:35.601950 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274133 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 15:12:35.602727 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274135 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 15:12:35.602727 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274138 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 15:12:35.602727 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274141 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 15:12:35.602727 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274144 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 15:12:35.602727 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274146 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 15:12:35.602727 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274149 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 15:12:35.602727 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274152 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 15:12:35.602727 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274155 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 15:12:35.602727 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274159 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 15:12:35.602727 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274161 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 15:12:35.602727 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274164 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 15:12:35.602727 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274166 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 15:12:35.602727 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274169 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 23 15:12:35.602727 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274174 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 15:12:35.602727 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274252 2582 flags.go:64] FLAG: --address="0.0.0.0" Jul 23 15:12:35.602727 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274271 2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 23 15:12:35.602727 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274278 2582 flags.go:64] FLAG: --anonymous-auth="true" Jul 23 15:12:35.602727 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274283 2582 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 23 15:12:35.602727 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274288 2582 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 23 15:12:35.602727 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274291 2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 23 15:12:35.602727 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274296 2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 23 15:12:35.605094 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274301 2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 23 15:12:35.605094 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274304 2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 23 15:12:35.605094 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274307 2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 23 15:12:35.605094 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274310 2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 23 15:12:35.605094 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274314 2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 23 15:12:35.605094 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274317 2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 23 15:12:35.605094 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274321 2582 flags.go:64] FLAG: --cgroup-root="" Jul 23 15:12:35.605094 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274324 2582 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 23 15:12:35.605094 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274335 2582 flags.go:64] FLAG: --client-ca-file="" Jul 23 15:12:35.605094 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274338 2582 flags.go:64] FLAG: --cloud-provider="external" Jul 23 15:12:35.605094 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274341 2582 flags.go:64] FLAG: --cluster-dns="[]" Jul 23 15:12:35.605094 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274346 2582 flags.go:64] FLAG: --cluster-domain="" Jul 23 15:12:35.605094 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274349 2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 23 15:12:35.605094 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274352 2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 23 15:12:35.605094 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274355 2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 23 15:12:35.605094 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274358 2582 flags.go:64] FLAG: --container-log-max-files="5" Jul 23 15:12:35.605094 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274362 2582 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 23 15:12:35.605094 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274366 2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 23 15:12:35.605094 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274369 2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 23 15:12:35.605094 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274372 2582 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 23 15:12:35.605094 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274376 2582 flags.go:64] FLAG: --contention-profiling="false" Jul 23 15:12:35.605094 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274379 2582 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 23 15:12:35.605094 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274382 2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 23 15:12:35.605094 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274385 2582 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 23 15:12:35.605847 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274388 2582 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 23 15:12:35.605847 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274392 2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 23 15:12:35.605847 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274396 2582 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 23 15:12:35.605847 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274399 2582 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 23 15:12:35.605847 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274402 2582 flags.go:64] FLAG: --enable-load-reader="false" Jul 23 15:12:35.605847 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274405 2582 flags.go:64] FLAG: --enable-server="true" Jul 23 15:12:35.605847 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274408 2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 23 15:12:35.605847 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274413 2582 flags.go:64] FLAG: --event-burst="100" Jul 23 15:12:35.605847 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274417 2582 flags.go:64] FLAG: --event-qps="50" Jul 23 15:12:35.605847 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274420 2582 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 23 15:12:35.605847 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274423 2582 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 23 15:12:35.605847 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274426 2582 flags.go:64] FLAG: --eviction-hard="" Jul 23 15:12:35.605847 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274430 2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 23 15:12:35.605847 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274434 2582 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 23 15:12:35.605847 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274437 2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 23 15:12:35.605847 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274440 2582 flags.go:64] FLAG: --eviction-soft="" Jul 23 15:12:35.605847 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274444 2582 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 23 15:12:35.605847 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274447 2582 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 23 15:12:35.605847 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274450 2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 23 15:12:35.605847 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274453 2582 flags.go:64] FLAG: --experimental-mounter-path="" Jul 23 15:12:35.605847 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274456 2582 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 23 15:12:35.605847 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274459 2582 flags.go:64] FLAG: --fail-swap-on="true" Jul 23 15:12:35.605847 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274462 2582 flags.go:64] FLAG: --feature-gates="" Jul 23 15:12:35.605847 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274466 2582 flags.go:64] FLAG: --file-check-frequency="20s" Jul 23 15:12:35.605847 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274469 2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 23 15:12:35.606638 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274473 2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 23 15:12:35.606638 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274476 2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 23 15:12:35.606638 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274478 2582 flags.go:64] FLAG: --healthz-port="10248" Jul 23 15:12:35.606638 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274482 2582 flags.go:64] FLAG: --help="false" Jul 23 15:12:35.606638 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274485 2582 flags.go:64] FLAG: --hostname-override="ip-10-0-128-213.ec2.internal" Jul 23 15:12:35.606638 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274488 2582 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 23 15:12:35.606638 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274491 2582 flags.go:64] FLAG: --http-check-frequency="20s" Jul 23 15:12:35.606638 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274494 2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 23 15:12:35.606638 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274497 2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 23 15:12:35.606638 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274501 2582 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 23 15:12:35.606638 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274505 2582 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 23 15:12:35.606638 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274508 2582 flags.go:64] FLAG: --image-service-endpoint="" Jul 23 15:12:35.606638 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274511 2582 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 23 15:12:35.606638 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274513 2582 flags.go:64] FLAG: --kube-api-burst="100" Jul 23 15:12:35.606638 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274516 2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 23 15:12:35.606638 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274519 2582 flags.go:64] FLAG: --kube-api-qps="50" Jul 23 15:12:35.606638 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274522 2582 flags.go:64] FLAG: --kube-reserved="" Jul 23 15:12:35.606638 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274525 2582 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 23 15:12:35.606638 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274528 2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 23 15:12:35.606638 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274531 2582 flags.go:64] FLAG: --kubelet-cgroups="" Jul 23 15:12:35.606638 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274534 2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 23 15:12:35.606638 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274537 2582 flags.go:64] FLAG: --lock-file="" Jul 23 15:12:35.606638 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274542 2582 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 23 15:12:35.606638 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274546 2582 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 23 15:12:35.609365 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274549 2582 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 23 15:12:35.609365 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274555 2582 flags.go:64] FLAG: --log-json-split-stream="false" Jul 23 15:12:35.609365 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274558 2582 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 23 15:12:35.609365 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274561 2582 flags.go:64] FLAG: --log-text-split-stream="false" Jul 23 15:12:35.609365 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274563 2582 flags.go:64] FLAG: --logging-format="text" Jul 23 15:12:35.609365 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274566 2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 23 15:12:35.609365 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274570 2582 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 23 15:12:35.609365 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274572 2582 flags.go:64] FLAG: --manifest-url="" Jul 23 15:12:35.609365 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274575 2582 flags.go:64] FLAG: --manifest-url-header="" Jul 23 15:12:35.609365 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274580 2582 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 23 15:12:35.609365 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274583 2582 flags.go:64] FLAG: --max-open-files="1000000" Jul 23 15:12:35.609365 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274587 2582 flags.go:64] FLAG: --max-pods="110" Jul 23 15:12:35.609365 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274590 2582 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 23 15:12:35.609365 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274593 2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 23 15:12:35.609365 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274597 2582 flags.go:64] FLAG: --memory-manager-policy="None" Jul 23 15:12:35.609365 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274599 2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 23 15:12:35.609365 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274603 2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 23 15:12:35.609365 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274606 2582 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 23 15:12:35.609365 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274609 2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 23 15:12:35.609365 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274618 2582 flags.go:64] FLAG: --node-status-max-images="50" Jul 23 15:12:35.609365 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274621 2582 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 23 15:12:35.609365 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274624 2582 flags.go:64] FLAG: --oom-score-adj="-999" Jul 23 15:12:35.609365 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274628 2582 flags.go:64] FLAG: --pod-cidr="" Jul 23 15:12:35.610154 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274631 2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 23 15:12:35.610154 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274637 2582 flags.go:64] FLAG: --pod-manifest-path="" Jul 23 15:12:35.610154 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274640 2582 flags.go:64] FLAG: --pod-max-pids="-1" Jul 23 15:12:35.610154 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274647 2582 flags.go:64] FLAG: --pods-per-core="0" Jul 23 15:12:35.610154 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274650 2582 flags.go:64] FLAG: --port="10250" Jul 23 15:12:35.610154 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274653 2582 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 23 15:12:35.610154 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274656 2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08df3808db6c0a00f" Jul 23 15:12:35.610154 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274664 2582 flags.go:64] FLAG: --qos-reserved="" Jul 23 15:12:35.610154 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274666 2582 flags.go:64] FLAG: --read-only-port="10255" Jul 23 15:12:35.610154 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274669 2582 flags.go:64] FLAG: --register-node="true" Jul 23 15:12:35.610154 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274673 2582 flags.go:64] FLAG: --register-with-taints="" Jul 23 15:12:35.610154 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274677 2582 flags.go:64] FLAG: --registry-burst="10" Jul 23 15:12:35.610154 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274679 2582 flags.go:64] FLAG: --registry-qps="5" Jul 23 15:12:35.610154 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274682 2582 flags.go:64] FLAG: --reserved-cpus="" Jul 23 15:12:35.610154 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274685 2582 flags.go:64] FLAG: --reserved-memory="" Jul 23 15:12:35.610154 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274689 2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 23 15:12:35.610154 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274692 2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 23 15:12:35.610154 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274695 2582 flags.go:64] FLAG: --rotate-certificates="false" Jul 23 15:12:35.610154 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274698 2582 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 23 15:12:35.610154 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274701 2582 flags.go:64] FLAG: --runonce="false" Jul 23 15:12:35.610154 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274704 2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 23 15:12:35.610154 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274707 2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 23 15:12:35.610154 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274710 2582 flags.go:64] FLAG: --seccomp-default="false" Jul 23 15:12:35.610154 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274713 2582 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 23 15:12:35.610154 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274716 2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 23 15:12:35.706827 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274719 2582 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 23 15:12:35.706827 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274723 2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 23 15:12:35.706827 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274726 2582 flags.go:64] FLAG: --storage-driver-password="root" Jul 23 15:12:35.706827 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274729 2582 flags.go:64] FLAG: --storage-driver-secure="false" Jul 23 15:12:35.706827 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274733 2582 flags.go:64] FLAG: --storage-driver-table="stats" Jul 23 15:12:35.706827 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274736 2582 flags.go:64] FLAG: --storage-driver-user="root" Jul 23 15:12:35.706827 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274739 2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 23 15:12:35.706827 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274742 2582 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 23 15:12:35.706827 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274745 2582 flags.go:64] FLAG: --system-cgroups="" Jul 23 15:12:35.706827 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274748 2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 23 15:12:35.706827 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274754 2582 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 23 15:12:35.706827 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274757 2582 flags.go:64] FLAG: --tls-cert-file="" Jul 23 15:12:35.706827 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274760 2582 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 23 15:12:35.706827 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274764 2582 flags.go:64] FLAG: --tls-min-version="" Jul 23 15:12:35.706827 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274768 2582 flags.go:64] FLAG: --tls-private-key-file="" Jul 23 15:12:35.706827 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274771 2582 flags.go:64] FLAG: --topology-manager-policy="none" Jul 23 15:12:35.706827 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274774 2582 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 23 15:12:35.706827 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274777 2582 flags.go:64] FLAG: --topology-manager-scope="container" Jul 23 15:12:35.706827 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274780 2582 flags.go:64] FLAG: --v="2" Jul 23 15:12:35.706827 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274784 2582 flags.go:64] FLAG: --version="false" Jul 23 15:12:35.706827 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274788 2582 flags.go:64] FLAG: --vmodule="" Jul 23 15:12:35.706827 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274792 2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 23 15:12:35.706827 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.274795 2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 23 15:12:35.706827 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274935 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 15:12:35.707968 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274941 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 15:12:35.707968 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274944 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 15:12:35.707968 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274947 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 15:12:35.707968 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274949 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 15:12:35.707968 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274952 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 15:12:35.707968 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274954 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 15:12:35.707968 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274957 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 15:12:35.707968 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274960 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 15:12:35.707968 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274963 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 15:12:35.707968 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274965 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 15:12:35.707968 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274968 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 15:12:35.707968 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274970 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 15:12:35.707968 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274973 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 15:12:35.707968 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274976 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 15:12:35.707968 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274979 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 15:12:35.707968 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274982 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 15:12:35.707968 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274984 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 15:12:35.707968 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274987 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 15:12:35.707968 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274991 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 15:12:35.707968 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274994 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 15:12:35.715773 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.274997 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 15:12:35.715773 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275000 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 15:12:35.715773 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275004 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 15:12:35.715773 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275006 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 15:12:35.715773 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275010 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 15:12:35.715773 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275012 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 15:12:35.715773 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275015 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 15:12:35.715773 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275018 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 15:12:35.715773 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275020 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 15:12:35.715773 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275022 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 15:12:35.715773 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275025 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 15:12:35.715773 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275027 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 15:12:35.715773 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275030 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 15:12:35.715773 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275033 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 15:12:35.715773 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275035 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 15:12:35.715773 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275038 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 15:12:35.715773 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275040 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 15:12:35.715773 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275043 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 23 15:12:35.715773 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275045 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 15:12:35.715773 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275048 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 15:12:35.716825 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275050 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 15:12:35.716825 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275052 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 15:12:35.716825 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275055 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 15:12:35.716825 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275058 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 15:12:35.716825 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275061 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 15:12:35.716825 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275063 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 15:12:35.716825 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275068 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 15:12:35.716825 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275071 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 15:12:35.716825 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275074 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 15:12:35.716825 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275077 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 15:12:35.716825 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275082 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 15:12:35.716825 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275084 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 15:12:35.716825 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275087 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 15:12:35.716825 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275089 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 15:12:35.716825 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275093 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 15:12:35.716825 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275096 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 15:12:35.716825 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275098 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 15:12:35.716825 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275101 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 15:12:35.716825 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275104 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 15:12:35.716825 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275106 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 15:12:35.717579 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275109 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 15:12:35.717579 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275111 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 15:12:35.717579 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275114 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 15:12:35.717579 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275116 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 15:12:35.717579 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275119 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 15:12:35.717579 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275121 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 15:12:35.717579 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275124 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 15:12:35.717579 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275126 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 15:12:35.717579 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275129 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 15:12:35.717579 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275131 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 15:12:35.717579 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275134 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 15:12:35.717579 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275136 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 15:12:35.717579 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275140 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 15:12:35.717579 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275143 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 15:12:35.717579 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275146 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 15:12:35.717579 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275149 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 15:12:35.717579 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275152 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 15:12:35.717579 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275154 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 15:12:35.717579 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275156 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 15:12:35.719130 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275159 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 15:12:35.719130 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275162 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 15:12:35.719130 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275165 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 15:12:35.719130 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275168 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 15:12:35.719130 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275171 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 15:12:35.719130 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275174 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 15:12:35.719130 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275176 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 15:12:35.719130 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275180 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 15:12:35.719130 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275183 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 15:12:35.719130 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275186 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 15:12:35.719130 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275188 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 15:12:35.719130 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275191 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 15:12:35.719130 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275193 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 15:12:35.719130 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275196 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 15:12:35.719130 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275198 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 15:12:35.719130 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275202 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 15:12:35.719130 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275205 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 15:12:35.719130 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275208 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 15:12:35.719130 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.275211 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 15:12:35.719917 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.275847 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 15:12:35.719917 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.283828 2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 23 15:12:35.719917 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.283853 2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 23 15:12:35.719917 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.283902 2582 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 23 15:12:35.719917 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.283912 2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 23 15:12:35.719917 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284081 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 15:12:35.719917 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284089 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 15:12:35.719917 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284094 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 15:12:35.719917 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284098 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 15:12:35.719917 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284103 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 15:12:35.719917 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284109 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 15:12:35.719917 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284119 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 15:12:35.719917 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284123 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 15:12:35.719917 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284127 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 15:12:35.719917 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284131 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 15:12:35.721086 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284136 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 15:12:35.721086 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284140 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 15:12:35.721086 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284148 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 15:12:35.721086 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284152 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 15:12:35.721086 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284156 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 15:12:35.721086 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284163 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 15:12:35.721086 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284167 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 15:12:35.721086 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284171 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 15:12:35.721086 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284175 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 15:12:35.721086 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284184 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 15:12:35.721086 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284188 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 15:12:35.721086 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284193 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 15:12:35.721086 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284197 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 15:12:35.721086 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284201 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 15:12:35.721086 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284206 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 15:12:35.721086 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284210 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 15:12:35.721086 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284215 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 15:12:35.721086 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284219 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 15:12:35.721086 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284223 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 15:12:35.721086 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284242 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 15:12:35.721877 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284247 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 15:12:35.721877 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284256 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 15:12:35.721877 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284262 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 15:12:35.721877 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284267 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 15:12:35.721877 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284272 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 15:12:35.721877 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284276 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 15:12:35.721877 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284281 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 15:12:35.721877 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284285 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 15:12:35.721877 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284290 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 15:12:35.721877 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284294 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 15:12:35.721877 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284299 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 15:12:35.721877 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284303 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 15:12:35.721877 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284308 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 15:12:35.721877 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284312 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 15:12:35.721877 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284319 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 15:12:35.721877 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284328 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 15:12:35.721877 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284333 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 15:12:35.721877 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284338 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 15:12:35.721877 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284343 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 15:12:35.721877 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284348 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 15:12:35.723055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284352 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 15:12:35.723055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284357 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 15:12:35.723055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284361 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 23 15:12:35.723055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284365 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 15:12:35.723055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284369 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 15:12:35.723055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284374 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 15:12:35.723055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284378 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 15:12:35.723055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284387 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 15:12:35.723055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284392 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 15:12:35.723055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284396 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 15:12:35.723055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284401 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 15:12:35.723055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284410 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 15:12:35.723055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284414 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 15:12:35.723055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284421 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 15:12:35.723055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284539 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 15:12:35.723055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284543 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 15:12:35.723055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284546 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 15:12:35.723055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284549 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 15:12:35.723055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284552 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 15:12:35.723055 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284555 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 15:12:35.725034 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284558 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 15:12:35.725034 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284560 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 15:12:35.725034 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284563 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 15:12:35.725034 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284566 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 15:12:35.725034 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284569 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 15:12:35.725034 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284571 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 15:12:35.725034 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284575 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 15:12:35.725034 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284578 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 15:12:35.725034 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284580 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 15:12:35.725034 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284584 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 15:12:35.725034 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284587 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 15:12:35.725034 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284592 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 15:12:35.725034 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284596 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 15:12:35.725034 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284600 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 15:12:35.725034 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284604 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 15:12:35.725034 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284607 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 15:12:35.725034 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284611 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 15:12:35.725034 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284615 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 15:12:35.725507 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284619 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 15:12:35.725507 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284622 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 15:12:35.725507 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284624 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 15:12:35.725507 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284627 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 15:12:35.725507 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284631 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 15:12:35.725507 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284633 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 15:12:35.725507 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284636 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 15:12:35.725507 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284640 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 15:12:35.725507 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284643 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 15:12:35.725507 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284646 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 15:12:35.725507 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284649 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 15:12:35.725507 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.284655 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 15:12:35.725507 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284803 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 15:12:35.725507 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284809 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 15:12:35.725507 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284812 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 15:12:35.725891 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284815 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 15:12:35.725891 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284818 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 15:12:35.725891 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284821 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 15:12:35.725891 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284823 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 15:12:35.725891 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284826 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 15:12:35.725891 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284829 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 15:12:35.725891 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284833 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 15:12:35.725891 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284836 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 15:12:35.725891 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284840 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 15:12:35.725891 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284843 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 15:12:35.725891 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284846 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 23 15:12:35.725891 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284848 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 15:12:35.725891 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284851 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 15:12:35.725891 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284854 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 15:12:35.725891 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284857 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 15:12:35.725891 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284860 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 15:12:35.725891 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284877 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 15:12:35.725891 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284882 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 15:12:35.725891 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284885 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 15:12:35.725891 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284888 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 15:12:35.726365 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284891 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 15:12:35.726365 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284893 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 15:12:35.726365 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284896 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 15:12:35.726365 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284899 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 15:12:35.726365 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284903 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 15:12:35.726365 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284905 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 15:12:35.726365 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284908 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 15:12:35.726365 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284910 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 15:12:35.726365 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284913 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 15:12:35.726365 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284915 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 15:12:35.726365 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284919 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 15:12:35.726365 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284924 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 15:12:35.726365 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284927 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 15:12:35.726365 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284931 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 15:12:35.726365 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284934 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 15:12:35.726365 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284937 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 15:12:35.726365 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284940 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 15:12:35.726365 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284943 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 15:12:35.726365 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284948 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 15:12:35.726824 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284951 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 15:12:35.726824 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284955 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 15:12:35.726824 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284958 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 15:12:35.726824 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284962 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 15:12:35.726824 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284965 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 15:12:35.726824 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284968 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 15:12:35.726824 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284970 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 15:12:35.726824 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284973 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 15:12:35.726824 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284975 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 15:12:35.726824 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284978 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 15:12:35.726824 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284980 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 15:12:35.726824 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284983 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 15:12:35.726824 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284986 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 15:12:35.726824 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284989 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 15:12:35.726824 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284991 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 15:12:35.726824 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284994 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 15:12:35.726824 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284996 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 15:12:35.726824 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.284999 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 15:12:35.726824 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285002 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 15:12:35.726824 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285004 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 15:12:35.727333 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285007 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 15:12:35.727333 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285010 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 15:12:35.727333 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285012 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 15:12:35.727333 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285015 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 15:12:35.727333 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285017 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 15:12:35.727333 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285020 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 15:12:35.727333 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285022 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 15:12:35.727333 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285025 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 15:12:35.727333 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285027 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 15:12:35.727333 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285030 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 15:12:35.727333 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285032 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 15:12:35.727333 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285036 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 15:12:35.727333 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285039 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 15:12:35.727333 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285043 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 15:12:35.727333 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285045 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 15:12:35.727333 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285048 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 15:12:35.727333 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285051 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 15:12:35.727333 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285054 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 15:12:35.727333 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285057 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 15:12:35.727333 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285059 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 15:12:35.727805 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285062 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 15:12:35.727805 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285064 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 15:12:35.727805 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285067 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 15:12:35.727805 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285069 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 15:12:35.727805 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285072 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 15:12:35.727805 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285074 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 15:12:35.727805 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285079 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 15:12:35.727805 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285082 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 15:12:35.727805 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285084 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 15:12:35.727805 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285087 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 15:12:35.727805 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285089 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 15:12:35.727805 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285092 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 15:12:35.727805 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285094 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 15:12:35.727805 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285097 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 15:12:35.727805 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285099 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 15:12:35.727805 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285102 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 15:12:35.727805 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:34.285105 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 15:12:35.728216 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.285109 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 15:12:35.728216 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.285242 2582 server.go:962] "Client rotation is on, will bootstrap in background" Jul 23 15:12:35.728216 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.287565 2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 23 15:12:35.728216 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.288886 2582 server.go:1019] "Starting client certificate rotation" Jul 23 15:12:35.728216 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.288997 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 15:12:35.728216 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.289037 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 15:12:35.728216 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.292026 2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 15:12:35.728216 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.293347 2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 15:12:35.728216 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.300056 2582 log.go:25] "Validated CRI v1 runtime API" Jul 23 15:12:35.728216 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.303807 2582 log.go:25] "Validated CRI v1 image API" Jul 23 15:12:35.728216 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.304572 2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 23 15:12:35.728216 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.307201 2582 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8e1bbf5d-2897-4744-8cee-17ba07ecceaf:/dev/nvme0n1p4 b6f32b49-80e9-4c6d-bd5d-fde5bafe3d5b:/dev/nvme0n1p3] Jul 23 15:12:35.728524 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.307216 2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 23 15:12:35.728554 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.312476 2582 manager.go:216] Machine: {Timestamp:2026-07-23 15:12:34.311053077 +0000 UTC m=+0.410344703 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100582 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e740544100d932c16c22ca341172e SystemUUID:ec2e7405-4410-0d93-2c16-c22ca341172e BootID:504d836e-5303-4c81-b852-b7e95322cd9a Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b8:cb:1f:aa:e3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b8:cb:1f:aa:e3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:ea:d4:67:1c:b5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 23 15:12:35.728554 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.312592 2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 23 15:12:35.728554 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.312686 2582 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 23 15:12:35.728554 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.315677 2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 23 15:12:35.728554 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.315717 2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-213.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 23 15:12:35.728554 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.316318 2582 topology_manager.go:138] "Creating topology manager with none policy" Jul 23 15:12:35.728554 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.316330 2582 container_manager_linux.go:309] "Creating device plugin manager" Jul 23 15:12:35.728554 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.316338 2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:34.316925 2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.435564 2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.438955 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.439112 2582 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.439141 2582 kubelet.go:486] "Attempting to sync node with API server" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.439153 2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.439168 2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.439177 2582 kubelet.go:398] "Adding apiserver pod source" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.439187 2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.439737 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.439756 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.441822 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.443297 2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.449614 2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.449643 2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.450926 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.450941 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.450947 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.450953 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.450961 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.450968 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.450984 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.450993 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.451001 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.451007 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.451016 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.451022 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:35.451686 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:35.451825 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-213.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.451971 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.451983 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.455482 2582 server.go:1268] "Started kubelet" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.455553 2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.456120 2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.456187 2582 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.456470 2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-213.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.457555 2582 server.go:310] "Adding debug handlers to kubelet server" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.457939 2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 23 15:12:35.728788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.466120 2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 23 15:12:35.729788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.466145 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 23 15:12:35.729788 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:35.466223 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Jul 23 15:12:35.729788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.466884 2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 23 15:12:35.729788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.466905 2582 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 23 15:12:35.729788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.466917 2582 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 23 15:12:35.729788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.467001 2582 reconstruct.go:97] "Volume reconstruction finished" Jul 23 15:12:35.729788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.467010 2582 reconciler.go:29] "Reconciler: start to sync state" Jul 23 15:12:35.729788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.470243 2582 factory.go:55] Registering systemd factory Jul 23 15:12:35.729788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.470259 2582 factory.go:223] Registration of the systemd container factory successfully Jul 23 15:12:35.729788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.471221 2582 factory.go:153] Registering CRI-O factory Jul 23 15:12:35.729788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.471238 2582 factory.go:223] Registration of the crio container factory successfully Jul 23 15:12:35.729788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.471304 2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 23 15:12:35.729788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.471339 2582 factory.go:103] Registering Raw factory Jul 23 15:12:35.729788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.471354 2582 manager.go:1196] Started watching for new ooms in manager Jul 23 15:12:35.729788 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:35.470208 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-213.ec2.internal.18c4f3ede717ae94 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-213.ec2.internal,UID:ip-10-0-128-213.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-213.ec2.internal,},FirstTimestamp:2026-07-23 15:12:35.455446676 +0000 UTC m=+0.437747500,LastTimestamp:2026-07-23 15:12:35.455446676 +0000 UTC m=+0.437747500,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-213.ec2.internal,}" Jul 23 15:12:35.729788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.471790 2582 manager.go:349] Starting recovery of all containers Jul 23 15:12:35.729788 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.475473 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 23 15:12:35.729788 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:35.475823 2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 23 15:12:35.820476 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:35.816901 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Jul 23 15:12:35.820476 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.817190 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wgljq" Jul 23 15:12:35.820476 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.817215 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wgljq" Jul 23 15:12:35.820476 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:35.817468 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 23 15:12:35.820476 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:35.817608 2582 helpers.go:245] readString: Failed to read "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service/memory.max": read /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service/memory.max: no such device Jul 23 15:12:35.820476 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.819397 2582 manager.go:354] Recovery completed Jul 23 15:12:35.820476 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:35.819639 2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-213.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 23 15:12:35.826297 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.826277 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 15:12:35.828409 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.828386 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientMemory" Jul 23 15:12:35.828505 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.828418 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 15:12:35.828505 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.828429 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientPID" Jul 23 15:12:35.828966 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.828952 2582 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 23 15:12:35.828966 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.828964 2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 23 15:12:35.829052 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.828982 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 23 15:12:35.829052 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.828993 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 15:12:35.829683 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.829666 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientMemory" Jul 23 15:12:35.829750 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.829696 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 15:12:35.829750 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.829707 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientPID" Jul 23 15:12:35.830079 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.830070 2582 policy_none.go:49] "None policy: Start" Jul 23 15:12:35.830112 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.830085 2582 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 23 15:12:35.830112 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.830095 2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 23 15:12:35.831177 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.831167 2582 policy_none.go:47] "Start" Jul 23 15:12:35.870179 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.869977 2582 manager.go:337] "Starting Device Plugin manager" Jul 23 15:12:35.870282 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:35.870218 2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 23 15:12:35.870282 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.870229 2582 server.go:87] "Starting device plugin registration server" Jul 23 15:12:35.870459 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.870448 2582 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 23 15:12:35.870593 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.870459 2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 23 15:12:35.870593 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.870557 2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 23 15:12:35.870693 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.870631 2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 23 15:12:35.870693 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.870640 2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 23 15:12:35.871326 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:35.871298 2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 23 15:12:35.871413 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:35.871354 2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-213.ec2.internal\" not found" Jul 23 15:12:35.971580 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.971536 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 15:12:35.972984 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.972806 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientMemory" Jul 23 15:12:35.972984 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.972836 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 15:12:35.972984 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.972847 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientPID" Jul 23 15:12:35.972984 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.972906 2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-213.ec2.internal" Jul 23 15:12:35.975123 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.975099 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 23 15:12:35.975217 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.975137 2582 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 23 15:12:35.975217 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.975159 2582 kubelet.go:2448] "Starting kubelet main sync loop" Jul 23 15:12:35.975217 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:35.975194 2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 23 15:12:35.978213 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.978192 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 15:12:35.980193 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:35.980178 2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-213.ec2.internal" Jul 23 15:12:35.980266 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:35.980199 2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-213.ec2.internal\": node \"ip-10-0-128-213.ec2.internal\" not found" Jul 23 15:12:36.024179 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:36.024143 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Jul 23 15:12:36.076024 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.075973 2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal"] Jul 23 15:12:36.076174 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.076059 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 15:12:36.077085 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.077067 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientMemory" Jul 23 15:12:36.077211 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.077095 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 15:12:36.077211 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.077107 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientPID" Jul 23 15:12:36.078710 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.078695 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 15:12:36.078822 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.078804 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Jul 23 15:12:36.078894 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.078845 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 15:12:36.079666 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.079647 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientMemory" Jul 23 15:12:36.079760 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.079680 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 15:12:36.079760 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.079689 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientPID" Jul 23 15:12:36.079760 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.079654 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientMemory" Jul 23 15:12:36.079887 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.079761 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 15:12:36.079887 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.079773 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientPID" Jul 23 15:12:36.080871 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.080845 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" Jul 23 15:12:36.080978 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.080883 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 15:12:36.081571 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.081551 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientMemory" Jul 23 15:12:36.081660 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.081583 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 15:12:36.081660 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.081595 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeHasSufficientPID" Jul 23 15:12:36.094505 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:36.094483 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-213.ec2.internal\" not found" node="ip-10-0-128-213.ec2.internal" Jul 23 15:12:36.097996 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:36.097977 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-213.ec2.internal\" not found" node="ip-10-0-128-213.ec2.internal" Jul 23 15:12:36.124717 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:36.124645 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Jul 23 15:12:36.218558 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.218507 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/747d68153f2a6e5680c1224eb7cb36a8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal\" (UID: \"747d68153f2a6e5680c1224eb7cb36a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Jul 23 15:12:36.218558 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.218557 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3b0cee6e3f6ab4006080287e7a9b3351-config\") pod \"kube-apiserver-proxy-ip-10-0-128-213.ec2.internal\" (UID: \"3b0cee6e3f6ab4006080287e7a9b3351\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" Jul 23 15:12:36.218767 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.218584 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/747d68153f2a6e5680c1224eb7cb36a8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal\" (UID: \"747d68153f2a6e5680c1224eb7cb36a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Jul 23 15:12:36.225625 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:36.225598 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Jul 23 15:12:36.319137 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.319108 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/747d68153f2a6e5680c1224eb7cb36a8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal\" (UID: \"747d68153f2a6e5680c1224eb7cb36a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Jul 23 15:12:36.319220 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.319153 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/747d68153f2a6e5680c1224eb7cb36a8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal\" (UID: \"747d68153f2a6e5680c1224eb7cb36a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Jul 23 15:12:36.319220 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.319170 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3b0cee6e3f6ab4006080287e7a9b3351-config\") pod \"kube-apiserver-proxy-ip-10-0-128-213.ec2.internal\" (UID: \"3b0cee6e3f6ab4006080287e7a9b3351\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" Jul 23 15:12:36.319220 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.319209 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/747d68153f2a6e5680c1224eb7cb36a8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal\" (UID: \"747d68153f2a6e5680c1224eb7cb36a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Jul 23 15:12:36.319311 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.319218 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/747d68153f2a6e5680c1224eb7cb36a8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal\" (UID: \"747d68153f2a6e5680c1224eb7cb36a8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Jul 23 15:12:36.319311 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.319258 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3b0cee6e3f6ab4006080287e7a9b3351-config\") pod \"kube-apiserver-proxy-ip-10-0-128-213.ec2.internal\" (UID: \"3b0cee6e3f6ab4006080287e7a9b3351\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" Jul 23 15:12:36.326220 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:36.326183 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Jul 23 15:12:36.356295 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.356268 2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 15:12:36.397959 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.397890 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Jul 23 15:12:36.401132 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.401113 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" Jul 23 15:12:36.405374 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.405358 2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 23 15:12:36.405493 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.405475 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 15:12:36.405540 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.405506 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 15:12:36.426835 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:36.426795 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Jul 23 15:12:36.527387 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:36.527347 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Jul 23 15:12:36.627927 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:36.627891 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Jul 23 15:12:36.728473 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:36.728400 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-213.ec2.internal\" not found" Jul 23 15:12:36.735292 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.735267 2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 15:12:36.743165 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.743139 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 15:12:36.766553 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.766513 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" Jul 23 15:12:36.782559 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.782526 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 15:12:36.783416 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.783400 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" Jul 23 15:12:36.795174 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.795149 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 15:12:36.823398 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.823360 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 15:07:35 +0000 UTC" deadline="2028-03-21 11:24:24.049587411 +0000 UTC" Jul 23 15:12:36.823398 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.823395 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14564h11m47.226195641s" Jul 23 15:12:36.910643 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:36.910601 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod747d68153f2a6e5680c1224eb7cb36a8.slice/crio-02cfe84104b7b52a72e9c320e421149abe4e1b2dbf95f9ae6df069ba640bfa5d WatchSource:0}: Error finding container 02cfe84104b7b52a72e9c320e421149abe4e1b2dbf95f9ae6df069ba640bfa5d: Status 404 returned error can't find the container with id 02cfe84104b7b52a72e9c320e421149abe4e1b2dbf95f9ae6df069ba640bfa5d Jul 23 15:12:36.914820 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.914800 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 15:12:36.978516 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:36.978427 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" event={"ID":"747d68153f2a6e5680c1224eb7cb36a8","Type":"ContainerStarted","Data":"02cfe84104b7b52a72e9c320e421149abe4e1b2dbf95f9ae6df069ba640bfa5d"} Jul 23 15:12:36.994363 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:36.994335 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b0cee6e3f6ab4006080287e7a9b3351.slice/crio-70c752d39daf9f028358e0a3d016b5d36a48a3a4641cf4d7fdedadc6986aef39 WatchSource:0}: Error finding container 70c752d39daf9f028358e0a3d016b5d36a48a3a4641cf4d7fdedadc6986aef39: Status 404 returned error can't find the container with id 70c752d39daf9f028358e0a3d016b5d36a48a3a4641cf4d7fdedadc6986aef39 Jul 23 15:12:37.440953 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.440920 2582 apiserver.go:52] "Watching apiserver" Jul 23 15:12:37.449720 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.449695 2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 23 15:12:37.450994 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.450966 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-pgrx7","kube-system/global-pull-secret-syncer-b7wx7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4v49","openshift-cluster-node-tuning-operator/tuned-lgn6w","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal","openshift-multus/multus-additional-cni-plugins-nfdrv","openshift-multus/multus-d2249","openshift-multus/network-metrics-daemon-xsdtd","openshift-network-operator/iptables-alerter-tt2g5","kube-system/konnectivity-agent-4c6h4","kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal","openshift-image-registry/node-ca-8qhdh","openshift-network-diagnostics/network-check-target-bsgd9"] Jul 23 15:12:37.452779 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.452759 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4v49" Jul 23 15:12:37.454820 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.454789 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bsgd9" Jul 23 15:12:37.454998 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:37.454880 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bsgd9" podUID="ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb" Jul 23 15:12:37.455479 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.455417 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 23 15:12:37.455479 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.455435 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 23 15:12:37.455479 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.455453 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6ch26\"" Jul 23 15:12:37.455680 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.455424 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 23 15:12:37.456213 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.456191 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d2249" Jul 23 15:12:37.457850 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.457829 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.458728 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.458448 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 23 15:12:37.458728 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.458457 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 23 15:12:37.458728 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.458677 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bxfq5\"" Jul 23 15:12:37.458938 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.458922 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 23 15:12:37.459017 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.458997 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 23 15:12:37.459638 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.459621 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nfdrv" Jul 23 15:12:37.460393 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.460144 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 23 15:12:37.460393 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.460186 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5gbzm\"" Jul 23 15:12:37.460574 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.460408 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 23 15:12:37.461419 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.461303 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.461910 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.461898 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 23 15:12:37.462165 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.462145 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pt2cw\"" Jul 23 15:12:37.462733 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.462711 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xsdtd" Jul 23 15:12:37.462900 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:37.462815 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xsdtd" podUID="ffacaf02-b6c9-4245-bee8-eb863a7b117c" Jul 23 15:12:37.463844 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.463826 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 23 15:12:37.464151 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.464134 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tt2g5" Jul 23 15:12:37.464654 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.464581 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 23 15:12:37.464654 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.464589 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 23 15:12:37.464654 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.464629 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 23 15:12:37.464836 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.464715 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nfnt7\"" Jul 23 15:12:37.465647 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.465628 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 23 15:12:37.465734 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.465693 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 23 15:12:37.465734 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.465635 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 23 15:12:37.466124 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.466106 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4c6h4" Jul 23 15:12:37.467365 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.467347 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 23 15:12:37.467545 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.467525 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8qhdh" Jul 23 15:12:37.468110 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.468091 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 23 15:12:37.468200 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.468153 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-mzbpw\"" Jul 23 15:12:37.468200 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.468162 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 23 15:12:37.468308 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.468217 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 23 15:12:37.468682 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.468663 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:12:37.468752 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:37.468725 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7wx7" podUID="fb607685-50d2-4fd7-b238-865b7726e7fa" Jul 23 15:12:37.469253 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.469226 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 23 15:12:37.471030 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.471006 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-v6v4z\"" Jul 23 15:12:37.471171 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.471130 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 23 15:12:37.471595 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.471553 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 23 15:12:37.472351 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.472210 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8c4jh\"" Jul 23 15:12:37.472351 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.472335 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 23 15:12:37.472617 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.472597 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 23 15:12:37.481577 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.481551 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 15:12:37.512185 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.512154 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8g56m" Jul 23 15:12:37.521583 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.521553 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8g56m" Jul 23 15:12:37.526158 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.526131 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8564870e-3d81-4633-a187-b2ebfd22bd69-etc-sysctl-d\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.526265 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.526170 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-host-slash\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.526265 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.526213 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-host-cni-bin\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.526265 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.526239 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/45cd984a-be03-413a-9229-c3b195e80e25-serviceca\") pod \"node-ca-8qhdh\" (UID: \"45cd984a-be03-413a-9229-c3b195e80e25\") " pod="openshift-image-registry/node-ca-8qhdh" Jul 23 15:12:37.526432 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.526264 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fb607685-50d2-4fd7-b238-865b7726e7fa-kubelet-config\") pod \"global-pull-secret-syncer-b7wx7\" (UID: \"fb607685-50d2-4fd7-b238-865b7726e7fa\") " pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:12:37.526432 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.526286 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8564870e-3d81-4633-a187-b2ebfd22bd69-etc-sysctl-conf\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.526432 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.526306 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8564870e-3d81-4633-a187-b2ebfd22bd69-run\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.526432 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.526323 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8564870e-3d81-4633-a187-b2ebfd22bd69-etc-tuned\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.526432 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.526344 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nrdm\" (UniqueName: \"kubernetes.io/projected/d7627ebf-1afb-4d04-8218-f1242fb9a742-kube-api-access-4nrdm\") pod \"multus-additional-cni-plugins-nfdrv\" (UID: \"d7627ebf-1afb-4d04-8218-f1242fb9a742\") " pod="openshift-multus/multus-additional-cni-plugins-nfdrv" Jul 23 15:12:37.526432 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.526371 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.526432 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.526389 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/71c26905-7c6e-4291-a1f3-5d8251939199-socket-dir\") pod \"aws-ebs-csi-driver-node-b4v49\" (UID: \"71c26905-7c6e-4291-a1f3-5d8251939199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4v49" Jul 23 15:12:37.526432 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.526409 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-multus-conf-dir\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.526810 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.526466 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8564870e-3d81-4633-a187-b2ebfd22bd69-lib-modules\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.526810 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.526506 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e0b34ed2-b27e-4b52-8f86-584ef89bd71e-agent-certs\") pod \"konnectivity-agent-4c6h4\" (UID: \"e0b34ed2-b27e-4b52-8f86-584ef89bd71e\") " pod="kube-system/konnectivity-agent-4c6h4" Jul 23 15:12:37.526810 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.526538 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fe195eea-0d32-4761-a885-e953d4460bcc-ovnkube-config\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.526810 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.526562 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fe195eea-0d32-4761-a885-e953d4460bcc-env-overrides\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.526810 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.526586 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fe195eea-0d32-4761-a885-e953d4460bcc-ovn-node-metrics-cert\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.526810 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.526604 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twbv5\" (UniqueName: \"kubernetes.io/projected/45cd984a-be03-413a-9229-c3b195e80e25-kube-api-access-twbv5\") pod \"node-ca-8qhdh\" (UID: \"45cd984a-be03-413a-9229-c3b195e80e25\") " pod="openshift-image-registry/node-ca-8qhdh" Jul 23 15:12:37.526810 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.526622 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8564870e-3d81-4633-a187-b2ebfd22bd69-var-lib-kubelet\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.526810 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.526645 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d7627ebf-1afb-4d04-8218-f1242fb9a742-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nfdrv\" (UID: \"d7627ebf-1afb-4d04-8218-f1242fb9a742\") " pod="openshift-multus/multus-additional-cni-plugins-nfdrv" Jul 23 15:12:37.526810 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.526671 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-host-run-netns\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.526810 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.526703 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-run-systemd\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.526810 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.526742 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-node-log\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.526810 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.526762 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwf89\" (UniqueName: \"kubernetes.io/projected/fe195eea-0d32-4761-a885-e953d4460bcc-kube-api-access-jwf89\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.526810 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.526789 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-multus-cni-dir\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.526810 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.526807 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-cnibin\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.527989 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.526822 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-os-release\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.527989 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.526836 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7fbc52f2-0509-44c3-91b2-428cc69d99eb-multus-daemon-config\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.527989 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.526849 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-host-cni-netd\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.527989 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.526911 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/71c26905-7c6e-4291-a1f3-5d8251939199-registration-dir\") pod \"aws-ebs-csi-driver-node-b4v49\" (UID: \"71c26905-7c6e-4291-a1f3-5d8251939199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4v49" Jul 23 15:12:37.527989 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.526927 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8564870e-3d81-4633-a187-b2ebfd22bd69-host\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.527989 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.526946 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-run-openvswitch\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.527989 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.526981 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-host-run-ovn-kubernetes\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.527989 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527011 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45cd984a-be03-413a-9229-c3b195e80e25-host\") pod \"node-ca-8qhdh\" (UID: \"45cd984a-be03-413a-9229-c3b195e80e25\") " pod="openshift-image-registry/node-ca-8qhdh" Jul 23 15:12:37.527989 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527031 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/71c26905-7c6e-4291-a1f3-5d8251939199-device-dir\") pod \"aws-ebs-csi-driver-node-b4v49\" (UID: \"71c26905-7c6e-4291-a1f3-5d8251939199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4v49" Jul 23 15:12:37.527989 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527054 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djts8\" (UniqueName: \"kubernetes.io/projected/71c26905-7c6e-4291-a1f3-5d8251939199-kube-api-access-djts8\") pod \"aws-ebs-csi-driver-node-b4v49\" (UID: \"71c26905-7c6e-4291-a1f3-5d8251939199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4v49" Jul 23 15:12:37.527989 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527091 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d7627ebf-1afb-4d04-8218-f1242fb9a742-os-release\") pod \"multus-additional-cni-plugins-nfdrv\" (UID: \"d7627ebf-1afb-4d04-8218-f1242fb9a742\") " pod="openshift-multus/multus-additional-cni-plugins-nfdrv" Jul 23 15:12:37.527989 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527125 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb607685-50d2-4fd7-b238-865b7726e7fa-original-pull-secret\") pod \"global-pull-secret-syncer-b7wx7\" (UID: \"fb607685-50d2-4fd7-b238-865b7726e7fa\") " pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:12:37.527989 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527150 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/71c26905-7c6e-4291-a1f3-5d8251939199-etc-selinux\") pod \"aws-ebs-csi-driver-node-b4v49\" (UID: \"71c26905-7c6e-4291-a1f3-5d8251939199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4v49" Jul 23 15:12:37.528584 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527177 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/71c26905-7c6e-4291-a1f3-5d8251939199-sys-fs\") pod \"aws-ebs-csi-driver-node-b4v49\" (UID: \"71c26905-7c6e-4291-a1f3-5d8251939199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4v49" Jul 23 15:12:37.528584 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527200 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-host-run-k8s-cni-cncf-io\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.528584 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527229 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6089d453-26a4-4e10-ae2c-948293b23a47-host-slash\") pod \"iptables-alerter-tt2g5\" (UID: \"6089d453-26a4-4e10-ae2c-948293b23a47\") " pod="openshift-network-operator/iptables-alerter-tt2g5" Jul 23 15:12:37.528584 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527250 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-system-cni-dir\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.528584 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527283 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8564870e-3d81-4633-a187-b2ebfd22bd69-tmp\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.528584 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527336 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rxjr\" (UniqueName: \"kubernetes.io/projected/8564870e-3d81-4633-a187-b2ebfd22bd69-kube-api-access-8rxjr\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.528584 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527367 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-etc-openvswitch\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.528584 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527391 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fe195eea-0d32-4761-a885-e953d4460bcc-ovnkube-script-lib\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.528584 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527416 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8564870e-3d81-4633-a187-b2ebfd22bd69-etc-systemd\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.528584 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527436 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7czm6\" (UniqueName: \"kubernetes.io/projected/7fbc52f2-0509-44c3-91b2-428cc69d99eb-kube-api-access-7czm6\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.528584 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527460 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7627ebf-1afb-4d04-8218-f1242fb9a742-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nfdrv\" (UID: \"d7627ebf-1afb-4d04-8218-f1242fb9a742\") " pod="openshift-multus/multus-additional-cni-plugins-nfdrv" Jul 23 15:12:37.528584 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527479 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d7627ebf-1afb-4d04-8218-f1242fb9a742-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nfdrv\" (UID: \"d7627ebf-1afb-4d04-8218-f1242fb9a742\") " pod="openshift-multus/multus-additional-cni-plugins-nfdrv" Jul 23 15:12:37.528584 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527494 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6089d453-26a4-4e10-ae2c-948293b23a47-iptables-alerter-script\") pod \"iptables-alerter-tt2g5\" (UID: \"6089d453-26a4-4e10-ae2c-948293b23a47\") " pod="openshift-network-operator/iptables-alerter-tt2g5" Jul 23 15:12:37.529209 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527515 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-var-lib-openvswitch\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.529209 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527537 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-multus-socket-dir-parent\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.529209 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527559 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-host-var-lib-cni-multus\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.529209 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527596 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7627ebf-1afb-4d04-8218-f1242fb9a742-system-cni-dir\") pod \"multus-additional-cni-plugins-nfdrv\" (UID: \"d7627ebf-1afb-4d04-8218-f1242fb9a742\") " pod="openshift-multus/multus-additional-cni-plugins-nfdrv" Jul 23 15:12:37.529209 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527619 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7627ebf-1afb-4d04-8218-f1242fb9a742-cnibin\") pod \"multus-additional-cni-plugins-nfdrv\" (UID: \"d7627ebf-1afb-4d04-8218-f1242fb9a742\") " pod="openshift-multus/multus-additional-cni-plugins-nfdrv" Jul 23 15:12:37.529209 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527660 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-run-ovn\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.529209 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527683 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-host-var-lib-cni-bin\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.529209 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527704 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-hostroot\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.529209 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527725 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q22ph\" (UniqueName: \"kubernetes.io/projected/ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb-kube-api-access-q22ph\") pod \"network-check-target-bsgd9\" (UID: \"ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb\") " pod="openshift-network-diagnostics/network-check-target-bsgd9" Jul 23 15:12:37.529209 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527747 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7627ebf-1afb-4d04-8218-f1242fb9a742-cni-binary-copy\") pod \"multus-additional-cni-plugins-nfdrv\" (UID: \"d7627ebf-1afb-4d04-8218-f1242fb9a742\") " pod="openshift-multus/multus-additional-cni-plugins-nfdrv" Jul 23 15:12:37.529209 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527768 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-systemd-units\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.529209 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527814 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-log-socket\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.529209 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527834 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8564870e-3d81-4633-a187-b2ebfd22bd69-etc-kubernetes\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.529209 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527884 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8564870e-3d81-4633-a187-b2ebfd22bd69-sys\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.529949 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527908 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-host-kubelet\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.529949 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527929 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fb607685-50d2-4fd7-b238-865b7726e7fa-dbus\") pod \"global-pull-secret-syncer-b7wx7\" (UID: \"fb607685-50d2-4fd7-b238-865b7726e7fa\") " pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:12:37.529949 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527951 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/71c26905-7c6e-4291-a1f3-5d8251939199-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b4v49\" (UID: \"71c26905-7c6e-4291-a1f3-5d8251939199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4v49" Jul 23 15:12:37.529949 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527972 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-host-run-netns\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.529949 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.527995 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-host-var-lib-kubelet\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.529949 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.528030 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-host-run-multus-certs\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.529949 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.528063 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-etc-kubernetes\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.529949 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.528089 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8564870e-3d81-4633-a187-b2ebfd22bd69-etc-modprobe-d\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.529949 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.528154 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e0b34ed2-b27e-4b52-8f86-584ef89bd71e-konnectivity-ca\") pod \"konnectivity-agent-4c6h4\" (UID: \"e0b34ed2-b27e-4b52-8f86-584ef89bd71e\") " pod="kube-system/konnectivity-agent-4c6h4" Jul 23 15:12:37.529949 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.528172 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffacaf02-b6c9-4245-bee8-eb863a7b117c-metrics-certs\") pod \"network-metrics-daemon-xsdtd\" (UID: \"ffacaf02-b6c9-4245-bee8-eb863a7b117c\") " pod="openshift-multus/network-metrics-daemon-xsdtd" Jul 23 15:12:37.529949 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.528187 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwtjq\" (UniqueName: \"kubernetes.io/projected/ffacaf02-b6c9-4245-bee8-eb863a7b117c-kube-api-access-wwtjq\") pod \"network-metrics-daemon-xsdtd\" (UID: \"ffacaf02-b6c9-4245-bee8-eb863a7b117c\") " pod="openshift-multus/network-metrics-daemon-xsdtd" Jul 23 15:12:37.529949 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.528210 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjxs5\" (UniqueName: \"kubernetes.io/projected/6089d453-26a4-4e10-ae2c-948293b23a47-kube-api-access-cjxs5\") pod \"iptables-alerter-tt2g5\" (UID: \"6089d453-26a4-4e10-ae2c-948293b23a47\") " pod="openshift-network-operator/iptables-alerter-tt2g5" Jul 23 15:12:37.529949 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.528231 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7fbc52f2-0509-44c3-91b2-428cc69d99eb-cni-binary-copy\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.529949 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.528311 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8564870e-3d81-4633-a187-b2ebfd22bd69-etc-sysconfig\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.567754 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.567725 2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 23 15:12:37.628762 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.628727 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45cd984a-be03-413a-9229-c3b195e80e25-host\") pod \"node-ca-8qhdh\" (UID: \"45cd984a-be03-413a-9229-c3b195e80e25\") " pod="openshift-image-registry/node-ca-8qhdh" Jul 23 15:12:37.628970 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.628786 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/71c26905-7c6e-4291-a1f3-5d8251939199-device-dir\") pod \"aws-ebs-csi-driver-node-b4v49\" (UID: \"71c26905-7c6e-4291-a1f3-5d8251939199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4v49" Jul 23 15:12:37.628970 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.628821 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djts8\" (UniqueName: \"kubernetes.io/projected/71c26905-7c6e-4291-a1f3-5d8251939199-kube-api-access-djts8\") pod \"aws-ebs-csi-driver-node-b4v49\" (UID: \"71c26905-7c6e-4291-a1f3-5d8251939199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4v49" Jul 23 15:12:37.628970 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.628845 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45cd984a-be03-413a-9229-c3b195e80e25-host\") pod \"node-ca-8qhdh\" (UID: \"45cd984a-be03-413a-9229-c3b195e80e25\") " pod="openshift-image-registry/node-ca-8qhdh" Jul 23 15:12:37.628970 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.628849 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d7627ebf-1afb-4d04-8218-f1242fb9a742-os-release\") pod \"multus-additional-cni-plugins-nfdrv\" (UID: \"d7627ebf-1afb-4d04-8218-f1242fb9a742\") " pod="openshift-multus/multus-additional-cni-plugins-nfdrv" Jul 23 15:12:37.628970 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.628930 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb607685-50d2-4fd7-b238-865b7726e7fa-original-pull-secret\") pod \"global-pull-secret-syncer-b7wx7\" (UID: \"fb607685-50d2-4fd7-b238-865b7726e7fa\") " pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:12:37.628970 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.628923 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/71c26905-7c6e-4291-a1f3-5d8251939199-device-dir\") pod \"aws-ebs-csi-driver-node-b4v49\" (UID: \"71c26905-7c6e-4291-a1f3-5d8251939199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4v49" Jul 23 15:12:37.628970 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.628960 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/71c26905-7c6e-4291-a1f3-5d8251939199-etc-selinux\") pod \"aws-ebs-csi-driver-node-b4v49\" (UID: \"71c26905-7c6e-4291-a1f3-5d8251939199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4v49" Jul 23 15:12:37.629327 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.628985 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/71c26905-7c6e-4291-a1f3-5d8251939199-sys-fs\") pod \"aws-ebs-csi-driver-node-b4v49\" (UID: \"71c26905-7c6e-4291-a1f3-5d8251939199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4v49" Jul 23 15:12:37.629327 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.629016 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-host-run-k8s-cni-cncf-io\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.629327 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.629055 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6089d453-26a4-4e10-ae2c-948293b23a47-host-slash\") pod \"iptables-alerter-tt2g5\" (UID: \"6089d453-26a4-4e10-ae2c-948293b23a47\") " pod="openshift-network-operator/iptables-alerter-tt2g5" Jul 23 15:12:37.629327 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.629063 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/71c26905-7c6e-4291-a1f3-5d8251939199-etc-selinux\") pod \"aws-ebs-csi-driver-node-b4v49\" (UID: \"71c26905-7c6e-4291-a1f3-5d8251939199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4v49" Jul 23 15:12:37.629327 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.629081 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-system-cni-dir\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.629327 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.629105 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8564870e-3d81-4633-a187-b2ebfd22bd69-tmp\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.629327 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.629166 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rxjr\" (UniqueName: \"kubernetes.io/projected/8564870e-3d81-4633-a187-b2ebfd22bd69-kube-api-access-8rxjr\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.629327 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.629182 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-etc-openvswitch\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.629327 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.629238 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fe195eea-0d32-4761-a885-e953d4460bcc-ovnkube-script-lib\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.629327 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.629258 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8564870e-3d81-4633-a187-b2ebfd22bd69-etc-systemd\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.629327 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.629272 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7czm6\" (UniqueName: \"kubernetes.io/projected/7fbc52f2-0509-44c3-91b2-428cc69d99eb-kube-api-access-7czm6\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.629327 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:37.629282 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 15:12:37.629327 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.629288 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6089d453-26a4-4e10-ae2c-948293b23a47-host-slash\") pod \"iptables-alerter-tt2g5\" (UID: \"6089d453-26a4-4e10-ae2c-948293b23a47\") " pod="openshift-network-operator/iptables-alerter-tt2g5" Jul 23 15:12:37.629942 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.629367 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-system-cni-dir\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.629942 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:37.629385 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb607685-50d2-4fd7-b238-865b7726e7fa-original-pull-secret podName:fb607685-50d2-4fd7-b238-865b7726e7fa nodeName:}" failed. No retries permitted until 2026-07-23 15:12:38.129347618 +0000 UTC m=+3.111648441 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fb607685-50d2-4fd7-b238-865b7726e7fa-original-pull-secret") pod "global-pull-secret-syncer-b7wx7" (UID: "fb607685-50d2-4fd7-b238-865b7726e7fa") : object "kube-system"/"original-pull-secret" not registered Jul 23 15:12:37.629942 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.629288 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7627ebf-1afb-4d04-8218-f1242fb9a742-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nfdrv\" (UID: \"d7627ebf-1afb-4d04-8218-f1242fb9a742\") " pod="openshift-multus/multus-additional-cni-plugins-nfdrv" Jul 23 15:12:37.629942 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.629430 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d7627ebf-1afb-4d04-8218-f1242fb9a742-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nfdrv\" (UID: \"d7627ebf-1afb-4d04-8218-f1242fb9a742\") " pod="openshift-multus/multus-additional-cni-plugins-nfdrv" Jul 23 15:12:37.629942 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.629467 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6089d453-26a4-4e10-ae2c-948293b23a47-iptables-alerter-script\") pod \"iptables-alerter-tt2g5\" (UID: \"6089d453-26a4-4e10-ae2c-948293b23a47\") " pod="openshift-network-operator/iptables-alerter-tt2g5" Jul 23 15:12:37.629942 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.629469 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d7627ebf-1afb-4d04-8218-f1242fb9a742-tuning-conf-dir\") pod \"multus-additional-cni-plugins-nfdrv\" (UID: \"d7627ebf-1afb-4d04-8218-f1242fb9a742\") " pod="openshift-multus/multus-additional-cni-plugins-nfdrv" Jul 23 15:12:37.629942 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.629492 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-var-lib-openvswitch\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.629942 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.629516 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-multus-socket-dir-parent\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.629942 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.629530 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/71c26905-7c6e-4291-a1f3-5d8251939199-sys-fs\") pod \"aws-ebs-csi-driver-node-b4v49\" (UID: \"71c26905-7c6e-4291-a1f3-5d8251939199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4v49" Jul 23 15:12:37.629942 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.629666 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-multus-socket-dir-parent\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.629942 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.629746 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-host-run-k8s-cni-cncf-io\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.629942 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.629017 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d7627ebf-1afb-4d04-8218-f1242fb9a742-os-release\") pod \"multus-additional-cni-plugins-nfdrv\" (UID: \"d7627ebf-1afb-4d04-8218-f1242fb9a742\") " pod="openshift-multus/multus-additional-cni-plugins-nfdrv" Jul 23 15:12:37.629942 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.629781 2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 23 15:12:37.629942 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.629817 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-host-var-lib-cni-multus\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.630431 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.629972 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-var-lib-openvswitch\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.630431 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.630192 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d7627ebf-1afb-4d04-8218-f1242fb9a742-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-nfdrv\" (UID: \"d7627ebf-1afb-4d04-8218-f1242fb9a742\") " pod="openshift-multus/multus-additional-cni-plugins-nfdrv" Jul 23 15:12:37.630431 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.630281 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8564870e-3d81-4633-a187-b2ebfd22bd69-etc-systemd\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.630584 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.629788 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-host-var-lib-cni-multus\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.630635 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.630600 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7627ebf-1afb-4d04-8218-f1242fb9a742-system-cni-dir\") pod \"multus-additional-cni-plugins-nfdrv\" (UID: \"d7627ebf-1afb-4d04-8218-f1242fb9a742\") " pod="openshift-multus/multus-additional-cni-plugins-nfdrv" Jul 23 15:12:37.630635 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.630606 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-etc-openvswitch\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.630635 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.630629 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7627ebf-1afb-4d04-8218-f1242fb9a742-cnibin\") pod \"multus-additional-cni-plugins-nfdrv\" (UID: \"d7627ebf-1afb-4d04-8218-f1242fb9a742\") " pod="openshift-multus/multus-additional-cni-plugins-nfdrv" Jul 23 15:12:37.630779 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.630654 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-run-ovn\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.630779 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.630663 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d7627ebf-1afb-4d04-8218-f1242fb9a742-system-cni-dir\") pod \"multus-additional-cni-plugins-nfdrv\" (UID: \"d7627ebf-1afb-4d04-8218-f1242fb9a742\") " pod="openshift-multus/multus-additional-cni-plugins-nfdrv" Jul 23 15:12:37.630779 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.630678 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-host-var-lib-cni-bin\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.630779 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.630700 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-hostroot\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.630779 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.630706 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d7627ebf-1afb-4d04-8218-f1242fb9a742-cnibin\") pod \"multus-additional-cni-plugins-nfdrv\" (UID: \"d7627ebf-1afb-4d04-8218-f1242fb9a742\") " pod="openshift-multus/multus-additional-cni-plugins-nfdrv" Jul 23 15:12:37.630779 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.630724 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q22ph\" (UniqueName: \"kubernetes.io/projected/ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb-kube-api-access-q22ph\") pod \"network-check-target-bsgd9\" (UID: \"ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb\") " pod="openshift-network-diagnostics/network-check-target-bsgd9" Jul 23 15:12:37.630779 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.630739 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-run-ovn\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.630779 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.630745 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-host-var-lib-cni-bin\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.630779 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.630773 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7627ebf-1afb-4d04-8218-f1242fb9a742-cni-binary-copy\") pod \"multus-additional-cni-plugins-nfdrv\" (UID: \"d7627ebf-1afb-4d04-8218-f1242fb9a742\") " pod="openshift-multus/multus-additional-cni-plugins-nfdrv" Jul 23 15:12:37.631233 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.630792 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-hostroot\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.631233 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.630801 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-systemd-units\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.631233 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.630848 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-systemd-units\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.631233 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.630959 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-log-socket\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.631233 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.630984 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8564870e-3d81-4633-a187-b2ebfd22bd69-etc-kubernetes\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.631233 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.631004 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-log-socket\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.631233 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.631006 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8564870e-3d81-4633-a187-b2ebfd22bd69-sys\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.631233 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.631051 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-host-kubelet\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.631233 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.631067 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8564870e-3d81-4633-a187-b2ebfd22bd69-sys\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.631233 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.631080 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fb607685-50d2-4fd7-b238-865b7726e7fa-dbus\") pod \"global-pull-secret-syncer-b7wx7\" (UID: \"fb607685-50d2-4fd7-b238-865b7726e7fa\") " pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:12:37.631233 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.631102 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6089d453-26a4-4e10-ae2c-948293b23a47-iptables-alerter-script\") pod \"iptables-alerter-tt2g5\" (UID: \"6089d453-26a4-4e10-ae2c-948293b23a47\") " pod="openshift-network-operator/iptables-alerter-tt2g5" Jul 23 15:12:37.631233 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.631110 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/71c26905-7c6e-4291-a1f3-5d8251939199-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b4v49\" (UID: \"71c26905-7c6e-4291-a1f3-5d8251939199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4v49" Jul 23 15:12:37.631233 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.631140 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-host-run-netns\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.631233 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.631152 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/71c26905-7c6e-4291-a1f3-5d8251939199-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b4v49\" (UID: \"71c26905-7c6e-4291-a1f3-5d8251939199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4v49" Jul 23 15:12:37.631233 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.631164 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-host-var-lib-kubelet\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.631978 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.631187 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-host-run-multus-certs\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.631978 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.631199 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8564870e-3d81-4633-a187-b2ebfd22bd69-etc-kubernetes\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.631978 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.631207 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/fb607685-50d2-4fd7-b238-865b7726e7fa-dbus\") pod \"global-pull-secret-syncer-b7wx7\" (UID: \"fb607685-50d2-4fd7-b238-865b7726e7fa\") " pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:12:37.631978 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.631211 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-etc-kubernetes\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.631978 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.631234 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8564870e-3d81-4633-a187-b2ebfd22bd69-etc-modprobe-d\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.631978 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.631235 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-host-var-lib-kubelet\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.631978 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.631242 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-host-kubelet\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.631978 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.631263 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e0b34ed2-b27e-4b52-8f86-584ef89bd71e-konnectivity-ca\") pod \"konnectivity-agent-4c6h4\" (UID: \"e0b34ed2-b27e-4b52-8f86-584ef89bd71e\") " pod="kube-system/konnectivity-agent-4c6h4" Jul 23 15:12:37.631978 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.631278 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-host-run-multus-certs\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.631978 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.631291 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffacaf02-b6c9-4245-bee8-eb863a7b117c-metrics-certs\") pod \"network-metrics-daemon-xsdtd\" (UID: \"ffacaf02-b6c9-4245-bee8-eb863a7b117c\") " pod="openshift-multus/network-metrics-daemon-xsdtd" Jul 23 15:12:37.631978 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.631269 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d7627ebf-1afb-4d04-8218-f1242fb9a742-cni-binary-copy\") pod \"multus-additional-cni-plugins-nfdrv\" (UID: \"d7627ebf-1afb-4d04-8218-f1242fb9a742\") " pod="openshift-multus/multus-additional-cni-plugins-nfdrv" Jul 23 15:12:37.631978 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.631311 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-etc-kubernetes\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.631978 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.631327 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwtjq\" (UniqueName: \"kubernetes.io/projected/ffacaf02-b6c9-4245-bee8-eb863a7b117c-kube-api-access-wwtjq\") pod \"network-metrics-daemon-xsdtd\" (UID: \"ffacaf02-b6c9-4245-bee8-eb863a7b117c\") " pod="openshift-multus/network-metrics-daemon-xsdtd" Jul 23 15:12:37.631978 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.631351 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjxs5\" (UniqueName: \"kubernetes.io/projected/6089d453-26a4-4e10-ae2c-948293b23a47-kube-api-access-cjxs5\") pod \"iptables-alerter-tt2g5\" (UID: \"6089d453-26a4-4e10-ae2c-948293b23a47\") " pod="openshift-network-operator/iptables-alerter-tt2g5" Jul 23 15:12:37.631978 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.631354 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8564870e-3d81-4633-a187-b2ebfd22bd69-etc-modprobe-d\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.632716 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.631358 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-host-run-netns\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.632716 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.631376 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7fbc52f2-0509-44c3-91b2-428cc69d99eb-cni-binary-copy\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.632716 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:37.631433 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 15:12:37.632716 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:37.631503 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffacaf02-b6c9-4245-bee8-eb863a7b117c-metrics-certs podName:ffacaf02-b6c9-4245-bee8-eb863a7b117c nodeName:}" failed. No retries permitted until 2026-07-23 15:12:38.131484716 +0000 UTC m=+3.113785541 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ffacaf02-b6c9-4245-bee8-eb863a7b117c-metrics-certs") pod "network-metrics-daemon-xsdtd" (UID: "ffacaf02-b6c9-4245-bee8-eb863a7b117c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 15:12:37.632716 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.631623 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8564870e-3d81-4633-a187-b2ebfd22bd69-etc-sysconfig\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.632716 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.631653 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8564870e-3d81-4633-a187-b2ebfd22bd69-etc-sysctl-d\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.632716 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.631676 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-host-slash\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.632716 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.631703 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8564870e-3d81-4633-a187-b2ebfd22bd69-etc-sysconfig\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.632716 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.631708 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-host-cni-bin\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.644029 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.638007 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/e0b34ed2-b27e-4b52-8f86-584ef89bd71e-konnectivity-ca\") pod \"konnectivity-agent-4c6h4\" (UID: \"e0b34ed2-b27e-4b52-8f86-584ef89bd71e\") " pod="kube-system/konnectivity-agent-4c6h4" Jul 23 15:12:37.644029 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.638239 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7fbc52f2-0509-44c3-91b2-428cc69d99eb-cni-binary-copy\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.644029 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.638316 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fe195eea-0d32-4761-a885-e953d4460bcc-ovnkube-script-lib\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.644029 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.640760 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-host-cni-bin\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.644029 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.640815 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/45cd984a-be03-413a-9229-c3b195e80e25-serviceca\") pod \"node-ca-8qhdh\" (UID: \"45cd984a-be03-413a-9229-c3b195e80e25\") " pod="openshift-image-registry/node-ca-8qhdh" Jul 23 15:12:37.644029 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.640878 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fb607685-50d2-4fd7-b238-865b7726e7fa-kubelet-config\") pod \"global-pull-secret-syncer-b7wx7\" (UID: \"fb607685-50d2-4fd7-b238-865b7726e7fa\") " pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:12:37.644029 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.640912 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8564870e-3d81-4633-a187-b2ebfd22bd69-etc-sysctl-d\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.644029 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.640958 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8564870e-3d81-4633-a187-b2ebfd22bd69-etc-sysctl-conf\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.644029 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.640995 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-host-slash\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.644029 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.641002 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8564870e-3d81-4633-a187-b2ebfd22bd69-run\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.644029 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.641064 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/fb607685-50d2-4fd7-b238-865b7726e7fa-kubelet-config\") pod \"global-pull-secret-syncer-b7wx7\" (UID: \"fb607685-50d2-4fd7-b238-865b7726e7fa\") " pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:12:37.644029 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.641148 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8564870e-3d81-4633-a187-b2ebfd22bd69-etc-tuned\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.644029 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.641194 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nrdm\" (UniqueName: \"kubernetes.io/projected/d7627ebf-1afb-4d04-8218-f1242fb9a742-kube-api-access-4nrdm\") pod \"multus-additional-cni-plugins-nfdrv\" (UID: \"d7627ebf-1afb-4d04-8218-f1242fb9a742\") " pod="openshift-multus/multus-additional-cni-plugins-nfdrv" Jul 23 15:12:37.644029 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.641259 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.644029 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.641338 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8564870e-3d81-4633-a187-b2ebfd22bd69-etc-sysctl-conf\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.644883 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.641592 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/71c26905-7c6e-4291-a1f3-5d8251939199-socket-dir\") pod \"aws-ebs-csi-driver-node-b4v49\" (UID: \"71c26905-7c6e-4291-a1f3-5d8251939199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4v49" Jul 23 15:12:37.644883 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.641631 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-multus-conf-dir\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.644883 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.641694 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8564870e-3d81-4633-a187-b2ebfd22bd69-lib-modules\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.644883 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.641719 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e0b34ed2-b27e-4b52-8f86-584ef89bd71e-agent-certs\") pod \"konnectivity-agent-4c6h4\" (UID: \"e0b34ed2-b27e-4b52-8f86-584ef89bd71e\") " pod="kube-system/konnectivity-agent-4c6h4" Jul 23 15:12:37.644883 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.641747 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fe195eea-0d32-4761-a885-e953d4460bcc-ovnkube-config\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.644883 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.641773 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fe195eea-0d32-4761-a885-e953d4460bcc-env-overrides\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.644883 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.641899 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fe195eea-0d32-4761-a885-e953d4460bcc-ovn-node-metrics-cert\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.644883 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.641929 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twbv5\" (UniqueName: \"kubernetes.io/projected/45cd984a-be03-413a-9229-c3b195e80e25-kube-api-access-twbv5\") pod \"node-ca-8qhdh\" (UID: \"45cd984a-be03-413a-9229-c3b195e80e25\") " pod="openshift-image-registry/node-ca-8qhdh" Jul 23 15:12:37.644883 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.641957 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8564870e-3d81-4633-a187-b2ebfd22bd69-var-lib-kubelet\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.644883 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.641986 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d7627ebf-1afb-4d04-8218-f1242fb9a742-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nfdrv\" (UID: \"d7627ebf-1afb-4d04-8218-f1242fb9a742\") " pod="openshift-multus/multus-additional-cni-plugins-nfdrv" Jul 23 15:12:37.644883 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.642013 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-host-run-netns\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.644883 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.642041 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-run-systemd\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.644883 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.642065 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-node-log\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.644883 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.642097 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwf89\" (UniqueName: \"kubernetes.io/projected/fe195eea-0d32-4761-a885-e953d4460bcc-kube-api-access-jwf89\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.645621 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.642359 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-multus-cni-dir\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.645621 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.642394 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-cnibin\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.645621 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.642482 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-cnibin\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.645621 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.642543 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-multus-cni-dir\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.645621 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.641817 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/71c26905-7c6e-4291-a1f3-5d8251939199-socket-dir\") pod \"aws-ebs-csi-driver-node-b4v49\" (UID: \"71c26905-7c6e-4291-a1f3-5d8251939199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4v49" Jul 23 15:12:37.645621 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.642586 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-os-release\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.645621 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.642624 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7fbc52f2-0509-44c3-91b2-428cc69d99eb-multus-daemon-config\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.645621 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.642656 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-host-cni-netd\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.645621 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.642684 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fe195eea-0d32-4761-a885-e953d4460bcc-env-overrides\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.645621 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.642732 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/71c26905-7c6e-4291-a1f3-5d8251939199-registration-dir\") pod \"aws-ebs-csi-driver-node-b4v49\" (UID: \"71c26905-7c6e-4291-a1f3-5d8251939199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4v49" Jul 23 15:12:37.645621 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.642771 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8564870e-3d81-4633-a187-b2ebfd22bd69-host\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.645621 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.642805 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-run-openvswitch\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.645621 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.642841 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-host-run-ovn-kubernetes\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.645621 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.642988 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-host-run-ovn-kubernetes\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.645621 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.643027 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-multus-conf-dir\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.646370 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.643074 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.646370 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.643429 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8564870e-3d81-4633-a187-b2ebfd22bd69-run\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.646370 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.643529 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8564870e-3d81-4633-a187-b2ebfd22bd69-lib-modules\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.646370 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.643654 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7fbc52f2-0509-44c3-91b2-428cc69d99eb-multus-daemon-config\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.646370 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:37.643877 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 15:12:37.646370 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:37.643901 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 15:12:37.646370 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:37.643925 2582 projected.go:196] Error preparing data for projected volume kube-api-access-q22ph for pod openshift-network-diagnostics/network-check-target-bsgd9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 15:12:37.646370 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:37.644009 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb-kube-api-access-q22ph podName:ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb nodeName:}" failed. No retries permitted until 2026-07-23 15:12:38.143989722 +0000 UTC m=+3.126290545 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-q22ph" (UniqueName: "kubernetes.io/projected/ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb-kube-api-access-q22ph") pod "network-check-target-bsgd9" (UID: "ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 15:12:37.646370 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.644195 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/45cd984a-be03-413a-9229-c3b195e80e25-serviceca\") pod \"node-ca-8qhdh\" (UID: \"45cd984a-be03-413a-9229-c3b195e80e25\") " pod="openshift-image-registry/node-ca-8qhdh" Jul 23 15:12:37.648953 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.647389 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fe195eea-0d32-4761-a885-e953d4460bcc-ovnkube-config\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.648953 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.647975 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-node-log\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.648953 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.648074 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8564870e-3d81-4633-a187-b2ebfd22bd69-var-lib-kubelet\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.648953 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.648080 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-host-cni-netd\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.648953 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.648145 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-run-systemd\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.648953 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.648169 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8564870e-3d81-4633-a187-b2ebfd22bd69-host\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.648953 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.648223 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-run-openvswitch\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.648953 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.648392 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8564870e-3d81-4633-a187-b2ebfd22bd69-etc-tuned\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.648953 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.642806 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7fbc52f2-0509-44c3-91b2-428cc69d99eb-os-release\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.648953 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.648572 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/71c26905-7c6e-4291-a1f3-5d8251939199-registration-dir\") pod \"aws-ebs-csi-driver-node-b4v49\" (UID: \"71c26905-7c6e-4291-a1f3-5d8251939199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4v49" Jul 23 15:12:37.648953 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.648625 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fe195eea-0d32-4761-a885-e953d4460bcc-host-run-netns\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.648953 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.648699 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d7627ebf-1afb-4d04-8218-f1242fb9a742-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-nfdrv\" (UID: \"d7627ebf-1afb-4d04-8218-f1242fb9a742\") " pod="openshift-multus/multus-additional-cni-plugins-nfdrv" Jul 23 15:12:37.650063 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.650040 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8564870e-3d81-4633-a187-b2ebfd22bd69-tmp\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.656778 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.656162 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fe195eea-0d32-4761-a885-e953d4460bcc-ovn-node-metrics-cert\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.656778 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.656323 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nrdm\" (UniqueName: \"kubernetes.io/projected/d7627ebf-1afb-4d04-8218-f1242fb9a742-kube-api-access-4nrdm\") pod \"multus-additional-cni-plugins-nfdrv\" (UID: \"d7627ebf-1afb-4d04-8218-f1242fb9a742\") " pod="openshift-multus/multus-additional-cni-plugins-nfdrv" Jul 23 15:12:37.656778 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.656379 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djts8\" (UniqueName: \"kubernetes.io/projected/71c26905-7c6e-4291-a1f3-5d8251939199-kube-api-access-djts8\") pod \"aws-ebs-csi-driver-node-b4v49\" (UID: \"71c26905-7c6e-4291-a1f3-5d8251939199\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4v49" Jul 23 15:12:37.656778 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.656734 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7czm6\" (UniqueName: \"kubernetes.io/projected/7fbc52f2-0509-44c3-91b2-428cc69d99eb-kube-api-access-7czm6\") pod \"multus-d2249\" (UID: \"7fbc52f2-0509-44c3-91b2-428cc69d99eb\") " pod="openshift-multus/multus-d2249" Jul 23 15:12:37.656778 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.656771 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rxjr\" (UniqueName: \"kubernetes.io/projected/8564870e-3d81-4633-a187-b2ebfd22bd69-kube-api-access-8rxjr\") pod \"tuned-lgn6w\" (UID: \"8564870e-3d81-4633-a187-b2ebfd22bd69\") " pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.657140 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.656815 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwtjq\" (UniqueName: \"kubernetes.io/projected/ffacaf02-b6c9-4245-bee8-eb863a7b117c-kube-api-access-wwtjq\") pod \"network-metrics-daemon-xsdtd\" (UID: \"ffacaf02-b6c9-4245-bee8-eb863a7b117c\") " pod="openshift-multus/network-metrics-daemon-xsdtd" Jul 23 15:12:37.657140 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.656847 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjxs5\" (UniqueName: \"kubernetes.io/projected/6089d453-26a4-4e10-ae2c-948293b23a47-kube-api-access-cjxs5\") pod \"iptables-alerter-tt2g5\" (UID: \"6089d453-26a4-4e10-ae2c-948293b23a47\") " pod="openshift-network-operator/iptables-alerter-tt2g5" Jul 23 15:12:37.657140 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.657076 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/e0b34ed2-b27e-4b52-8f86-584ef89bd71e-agent-certs\") pod \"konnectivity-agent-4c6h4\" (UID: \"e0b34ed2-b27e-4b52-8f86-584ef89bd71e\") " pod="kube-system/konnectivity-agent-4c6h4" Jul 23 15:12:37.657391 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.657371 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwf89\" (UniqueName: \"kubernetes.io/projected/fe195eea-0d32-4761-a885-e953d4460bcc-kube-api-access-jwf89\") pod \"ovnkube-node-pgrx7\" (UID: \"fe195eea-0d32-4761-a885-e953d4460bcc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.664729 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.664677 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twbv5\" (UniqueName: \"kubernetes.io/projected/45cd984a-be03-413a-9229-c3b195e80e25-kube-api-access-twbv5\") pod \"node-ca-8qhdh\" (UID: \"45cd984a-be03-413a-9229-c3b195e80e25\") " pod="openshift-image-registry/node-ca-8qhdh" Jul 23 15:12:37.719678 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.719585 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 15:12:37.766088 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.765801 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4v49" Jul 23 15:12:37.777909 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.777874 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d2249" Jul 23 15:12:37.779272 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:37.779227 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71c26905_7c6e_4291_a1f3_5d8251939199.slice/crio-17df93f15db1c59d776df0090034097fef7bbeb2637cfc50184bd7544e199433 WatchSource:0}: Error finding container 17df93f15db1c59d776df0090034097fef7bbeb2637cfc50184bd7544e199433: Status 404 returned error can't find the container with id 17df93f15db1c59d776df0090034097fef7bbeb2637cfc50184bd7544e199433 Jul 23 15:12:37.785906 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.785883 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" Jul 23 15:12:37.789951 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:37.789920 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fbc52f2_0509_44c3_91b2_428cc69d99eb.slice/crio-9f56834bff336273ad0876d2804297281108a75068f40b3de71fc42c555f2c9a WatchSource:0}: Error finding container 9f56834bff336273ad0876d2804297281108a75068f40b3de71fc42c555f2c9a: Status 404 returned error can't find the container with id 9f56834bff336273ad0876d2804297281108a75068f40b3de71fc42c555f2c9a Jul 23 15:12:37.791069 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.791043 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-nfdrv" Jul 23 15:12:37.796762 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:37.796735 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8564870e_3d81_4633_a187_b2ebfd22bd69.slice/crio-6689fac3fb756afc4ad475264eff97014660f86bbebab3bc062fc06ff171ba69 WatchSource:0}: Error finding container 6689fac3fb756afc4ad475264eff97014660f86bbebab3bc062fc06ff171ba69: Status 404 returned error can't find the container with id 6689fac3fb756afc4ad475264eff97014660f86bbebab3bc062fc06ff171ba69 Jul 23 15:12:37.797870 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.797817 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:12:37.803139 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:37.803113 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7627ebf_1afb_4d04_8218_f1242fb9a742.slice/crio-ce24813d70e48ff3d3b1fa9b184e632381208e29e4ed06f3a2b87ce35e7e842c WatchSource:0}: Error finding container ce24813d70e48ff3d3b1fa9b184e632381208e29e4ed06f3a2b87ce35e7e842c: Status 404 returned error can't find the container with id ce24813d70e48ff3d3b1fa9b184e632381208e29e4ed06f3a2b87ce35e7e842c Jul 23 15:12:37.805008 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.804987 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tt2g5" Jul 23 15:12:37.809547 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:37.809514 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe195eea_0d32_4761_a885_e953d4460bcc.slice/crio-2d9db7c6d253fc082d70da89ce40f4ad9befd97250e910511d1ea29aabaa3bb0 WatchSource:0}: Error finding container 2d9db7c6d253fc082d70da89ce40f4ad9befd97250e910511d1ea29aabaa3bb0: Status 404 returned error can't find the container with id 2d9db7c6d253fc082d70da89ce40f4ad9befd97250e910511d1ea29aabaa3bb0 Jul 23 15:12:37.813828 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.813649 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4c6h4" Jul 23 15:12:37.818760 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.818576 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8qhdh" Jul 23 15:12:37.820024 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:37.819995 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6089d453_26a4_4e10_ae2c_948293b23a47.slice/crio-3d181fe721a83e5c6a7347ade23d2fc3f0163d9bf6204fa9e0d0efa15a18b4d7 WatchSource:0}: Error finding container 3d181fe721a83e5c6a7347ade23d2fc3f0163d9bf6204fa9e0d0efa15a18b4d7: Status 404 returned error can't find the container with id 3d181fe721a83e5c6a7347ade23d2fc3f0163d9bf6204fa9e0d0efa15a18b4d7 Jul 23 15:12:37.834717 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:37.834661 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0b34ed2_b27e_4b52_8f86_584ef89bd71e.slice/crio-c9a910bf3470afa091e85ae198d57010d1372948dccbbc1755976ddaa17f8772 WatchSource:0}: Error finding container c9a910bf3470afa091e85ae198d57010d1372948dccbbc1755976ddaa17f8772: Status 404 returned error can't find the container with id c9a910bf3470afa091e85ae198d57010d1372948dccbbc1755976ddaa17f8772 Jul 23 15:12:37.835274 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:37.835225 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45cd984a_be03_413a_9229_c3b195e80e25.slice/crio-d4fab9ce09971921efcc93ca4ccd23e9da55d7e04a5a6d28f95926d7b8fcac14 WatchSource:0}: Error finding container d4fab9ce09971921efcc93ca4ccd23e9da55d7e04a5a6d28f95926d7b8fcac14: Status 404 returned error can't find the container with id d4fab9ce09971921efcc93ca4ccd23e9da55d7e04a5a6d28f95926d7b8fcac14 Jul 23 15:12:37.981363 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.981265 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tt2g5" event={"ID":"6089d453-26a4-4e10-ae2c-948293b23a47","Type":"ContainerStarted","Data":"3d181fe721a83e5c6a7347ade23d2fc3f0163d9bf6204fa9e0d0efa15a18b4d7"} Jul 23 15:12:37.982622 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.982552 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nfdrv" event={"ID":"d7627ebf-1afb-4d04-8218-f1242fb9a742","Type":"ContainerStarted","Data":"ce24813d70e48ff3d3b1fa9b184e632381208e29e4ed06f3a2b87ce35e7e842c"} Jul 23 15:12:37.983779 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.983752 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" event={"ID":"8564870e-3d81-4633-a187-b2ebfd22bd69","Type":"ContainerStarted","Data":"6689fac3fb756afc4ad475264eff97014660f86bbebab3bc062fc06ff171ba69"} Jul 23 15:12:37.985327 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.985300 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" event={"ID":"fe195eea-0d32-4761-a885-e953d4460bcc","Type":"ContainerStarted","Data":"2d9db7c6d253fc082d70da89ce40f4ad9befd97250e910511d1ea29aabaa3bb0"} Jul 23 15:12:37.986707 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.986660 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d2249" event={"ID":"7fbc52f2-0509-44c3-91b2-428cc69d99eb","Type":"ContainerStarted","Data":"9f56834bff336273ad0876d2804297281108a75068f40b3de71fc42c555f2c9a"} Jul 23 15:12:37.987997 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.987970 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4v49" event={"ID":"71c26905-7c6e-4291-a1f3-5d8251939199","Type":"ContainerStarted","Data":"17df93f15db1c59d776df0090034097fef7bbeb2637cfc50184bd7544e199433"} Jul 23 15:12:37.989117 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.989093 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" event={"ID":"3b0cee6e3f6ab4006080287e7a9b3351","Type":"ContainerStarted","Data":"70c752d39daf9f028358e0a3d016b5d36a48a3a4641cf4d7fdedadc6986aef39"} Jul 23 15:12:37.990374 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.990350 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8qhdh" event={"ID":"45cd984a-be03-413a-9229-c3b195e80e25","Type":"ContainerStarted","Data":"d4fab9ce09971921efcc93ca4ccd23e9da55d7e04a5a6d28f95926d7b8fcac14"} Jul 23 15:12:37.991521 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:37.991493 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4c6h4" event={"ID":"e0b34ed2-b27e-4b52-8f86-584ef89bd71e","Type":"ContainerStarted","Data":"c9a910bf3470afa091e85ae198d57010d1372948dccbbc1755976ddaa17f8772"} Jul 23 15:12:38.146320 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:38.146286 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffacaf02-b6c9-4245-bee8-eb863a7b117c-metrics-certs\") pod \"network-metrics-daemon-xsdtd\" (UID: \"ffacaf02-b6c9-4245-bee8-eb863a7b117c\") " pod="openshift-multus/network-metrics-daemon-xsdtd" Jul 23 15:12:38.146508 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:38.146344 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb607685-50d2-4fd7-b238-865b7726e7fa-original-pull-secret\") pod \"global-pull-secret-syncer-b7wx7\" (UID: \"fb607685-50d2-4fd7-b238-865b7726e7fa\") " pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:12:38.146508 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:38.146392 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q22ph\" (UniqueName: \"kubernetes.io/projected/ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb-kube-api-access-q22ph\") pod \"network-check-target-bsgd9\" (UID: \"ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb\") " pod="openshift-network-diagnostics/network-check-target-bsgd9" Jul 23 15:12:38.146508 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:38.146468 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 15:12:38.146621 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:38.146518 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 15:12:38.146621 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:38.146528 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 15:12:38.146621 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:38.146544 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffacaf02-b6c9-4245-bee8-eb863a7b117c-metrics-certs podName:ffacaf02-b6c9-4245-bee8-eb863a7b117c nodeName:}" failed. No retries permitted until 2026-07-23 15:12:39.146527669 +0000 UTC m=+4.128828497 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ffacaf02-b6c9-4245-bee8-eb863a7b117c-metrics-certs") pod "network-metrics-daemon-xsdtd" (UID: "ffacaf02-b6c9-4245-bee8-eb863a7b117c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 15:12:38.146621 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:38.146548 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 15:12:38.146621 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:38.146559 2582 projected.go:196] Error preparing data for projected volume kube-api-access-q22ph for pod openshift-network-diagnostics/network-check-target-bsgd9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 15:12:38.146621 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:38.146580 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb607685-50d2-4fd7-b238-865b7726e7fa-original-pull-secret podName:fb607685-50d2-4fd7-b238-865b7726e7fa nodeName:}" failed. No retries permitted until 2026-07-23 15:12:39.146562487 +0000 UTC m=+4.128863303 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fb607685-50d2-4fd7-b238-865b7726e7fa-original-pull-secret") pod "global-pull-secret-syncer-b7wx7" (UID: "fb607685-50d2-4fd7-b238-865b7726e7fa") : object "kube-system"/"original-pull-secret" not registered Jul 23 15:12:38.146621 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:38.146599 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb-kube-api-access-q22ph podName:ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb nodeName:}" failed. No retries permitted until 2026-07-23 15:12:39.146589185 +0000 UTC m=+4.128889999 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-q22ph" (UniqueName: "kubernetes.io/projected/ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb-kube-api-access-q22ph") pod "network-check-target-bsgd9" (UID: "ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 15:12:38.524061 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:38.524009 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 15:07:37 +0000 UTC" deadline="2028-02-10 20:44:49.158228449 +0000 UTC" Jul 23 15:12:38.524061 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:38.524056 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13613h32m10.634177811s" Jul 23 15:12:38.976261 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:38.976228 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:12:38.977411 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:38.976365 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7wx7" podUID="fb607685-50d2-4fd7-b238-865b7726e7fa" Jul 23 15:12:38.977411 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:38.976734 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bsgd9" Jul 23 15:12:38.977411 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:38.976828 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bsgd9" podUID="ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb" Jul 23 15:12:38.977411 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:38.976915 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xsdtd" Jul 23 15:12:38.977411 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:38.977002 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xsdtd" podUID="ffacaf02-b6c9-4245-bee8-eb863a7b117c" Jul 23 15:12:39.154710 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:39.154129 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q22ph\" (UniqueName: \"kubernetes.io/projected/ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb-kube-api-access-q22ph\") pod \"network-check-target-bsgd9\" (UID: \"ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb\") " pod="openshift-network-diagnostics/network-check-target-bsgd9" Jul 23 15:12:39.154710 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:39.154180 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffacaf02-b6c9-4245-bee8-eb863a7b117c-metrics-certs\") pod \"network-metrics-daemon-xsdtd\" (UID: \"ffacaf02-b6c9-4245-bee8-eb863a7b117c\") " pod="openshift-multus/network-metrics-daemon-xsdtd" Jul 23 15:12:39.154710 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:39.154231 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb607685-50d2-4fd7-b238-865b7726e7fa-original-pull-secret\") pod \"global-pull-secret-syncer-b7wx7\" (UID: \"fb607685-50d2-4fd7-b238-865b7726e7fa\") " pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:12:39.154710 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:39.154377 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 15:12:39.154710 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:39.154435 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb607685-50d2-4fd7-b238-865b7726e7fa-original-pull-secret podName:fb607685-50d2-4fd7-b238-865b7726e7fa nodeName:}" failed. No retries permitted until 2026-07-23 15:12:41.15441631 +0000 UTC m=+6.136717121 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fb607685-50d2-4fd7-b238-865b7726e7fa-original-pull-secret") pod "global-pull-secret-syncer-b7wx7" (UID: "fb607685-50d2-4fd7-b238-865b7726e7fa") : object "kube-system"/"original-pull-secret" not registered Jul 23 15:12:39.154710 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:39.154538 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 15:12:39.154710 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:39.154554 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 15:12:39.154710 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:39.154566 2582 projected.go:196] Error preparing data for projected volume kube-api-access-q22ph for pod openshift-network-diagnostics/network-check-target-bsgd9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 15:12:39.154710 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:39.154600 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb-kube-api-access-q22ph podName:ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb nodeName:}" failed. No retries permitted until 2026-07-23 15:12:41.154589074 +0000 UTC m=+6.136889883 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-q22ph" (UniqueName: "kubernetes.io/projected/ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb-kube-api-access-q22ph") pod "network-check-target-bsgd9" (UID: "ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 15:12:39.154710 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:39.154658 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 15:12:39.154710 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:39.154687 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffacaf02-b6c9-4245-bee8-eb863a7b117c-metrics-certs podName:ffacaf02-b6c9-4245-bee8-eb863a7b117c nodeName:}" failed. No retries permitted until 2026-07-23 15:12:41.154677763 +0000 UTC m=+6.136978576 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ffacaf02-b6c9-4245-bee8-eb863a7b117c-metrics-certs") pod "network-metrics-daemon-xsdtd" (UID: "ffacaf02-b6c9-4245-bee8-eb863a7b117c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 15:12:39.513319 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:39.513240 2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 15:12:39.524946 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:39.524852 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 15:07:37 +0000 UTC" deadline="2028-04-19 20:49:09.667594974 +0000 UTC" Jul 23 15:12:39.524946 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:39.524902 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15269h36m30.142696903s" Jul 23 15:12:40.010615 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:40.010573 2582 generic.go:356] "Generic (PLEG): container finished" podID="747d68153f2a6e5680c1224eb7cb36a8" containerID="7620499cbf9b072748a3f31d3fcc17f94c1ea72487f6e3b5ee9ef53a596f6330" exitCode=0 Jul 23 15:12:40.011110 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:40.010900 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" event={"ID":"747d68153f2a6e5680c1224eb7cb36a8","Type":"ContainerDied","Data":"7620499cbf9b072748a3f31d3fcc17f94c1ea72487f6e3b5ee9ef53a596f6330"} Jul 23 15:12:40.021924 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:40.019347 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" event={"ID":"3b0cee6e3f6ab4006080287e7a9b3351","Type":"ContainerStarted","Data":"aa94b44d04486db2b47f278bc79c4ee23d3969ecc13dad9d43c8b4554bbba262"} Jul 23 15:12:40.045976 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:40.045801 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-213.ec2.internal" podStartSLOduration=4.045778836 podStartE2EDuration="4.045778836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:12:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:12:40.045124589 +0000 UTC m=+5.027425421" watchObservedRunningTime="2026-07-23 15:12:40.045778836 +0000 UTC m=+5.028079665" Jul 23 15:12:40.976422 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:40.976380 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bsgd9" Jul 23 15:12:40.976609 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:40.976513 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bsgd9" podUID="ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb" Jul 23 15:12:40.977228 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:40.976930 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xsdtd" Jul 23 15:12:40.977228 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:40.977037 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xsdtd" podUID="ffacaf02-b6c9-4245-bee8-eb863a7b117c" Jul 23 15:12:40.977228 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:40.977093 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:12:40.977228 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:40.977168 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7wx7" podUID="fb607685-50d2-4fd7-b238-865b7726e7fa" Jul 23 15:12:41.174810 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:41.174771 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb607685-50d2-4fd7-b238-865b7726e7fa-original-pull-secret\") pod \"global-pull-secret-syncer-b7wx7\" (UID: \"fb607685-50d2-4fd7-b238-865b7726e7fa\") " pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:12:41.175261 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:41.174836 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q22ph\" (UniqueName: \"kubernetes.io/projected/ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb-kube-api-access-q22ph\") pod \"network-check-target-bsgd9\" (UID: \"ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb\") " pod="openshift-network-diagnostics/network-check-target-bsgd9" Jul 23 15:12:41.175261 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:41.174888 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffacaf02-b6c9-4245-bee8-eb863a7b117c-metrics-certs\") pod \"network-metrics-daemon-xsdtd\" (UID: \"ffacaf02-b6c9-4245-bee8-eb863a7b117c\") " pod="openshift-multus/network-metrics-daemon-xsdtd" Jul 23 15:12:41.175261 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:41.174980 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 15:12:41.175261 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:41.175016 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 15:12:41.175261 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:41.175055 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb607685-50d2-4fd7-b238-865b7726e7fa-original-pull-secret podName:fb607685-50d2-4fd7-b238-865b7726e7fa nodeName:}" failed. No retries permitted until 2026-07-23 15:12:45.175034233 +0000 UTC m=+10.157335045 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fb607685-50d2-4fd7-b238-865b7726e7fa-original-pull-secret") pod "global-pull-secret-syncer-b7wx7" (UID: "fb607685-50d2-4fd7-b238-865b7726e7fa") : object "kube-system"/"original-pull-secret" not registered Jul 23 15:12:41.175261 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:41.175075 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffacaf02-b6c9-4245-bee8-eb863a7b117c-metrics-certs podName:ffacaf02-b6c9-4245-bee8-eb863a7b117c nodeName:}" failed. No retries permitted until 2026-07-23 15:12:45.175065015 +0000 UTC m=+10.157365836 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ffacaf02-b6c9-4245-bee8-eb863a7b117c-metrics-certs") pod "network-metrics-daemon-xsdtd" (UID: "ffacaf02-b6c9-4245-bee8-eb863a7b117c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 15:12:41.175261 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:41.175136 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 15:12:41.175261 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:41.175154 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 15:12:41.175261 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:41.175166 2582 projected.go:196] Error preparing data for projected volume kube-api-access-q22ph for pod openshift-network-diagnostics/network-check-target-bsgd9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 15:12:41.175261 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:41.175207 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb-kube-api-access-q22ph podName:ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb nodeName:}" failed. No retries permitted until 2026-07-23 15:12:45.175190146 +0000 UTC m=+10.157490959 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-q22ph" (UniqueName: "kubernetes.io/projected/ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb-kube-api-access-q22ph") pod "network-check-target-bsgd9" (UID: "ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 15:12:42.975956 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:42.975917 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:12:42.975956 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:42.975948 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bsgd9" Jul 23 15:12:42.976461 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:42.976064 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xsdtd" Jul 23 15:12:42.976461 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:42.976069 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7wx7" podUID="fb607685-50d2-4fd7-b238-865b7726e7fa" Jul 23 15:12:42.976461 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:42.976139 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bsgd9" podUID="ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb" Jul 23 15:12:42.976461 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:42.976232 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xsdtd" podUID="ffacaf02-b6c9-4245-bee8-eb863a7b117c" Jul 23 15:12:44.976038 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:44.975998 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:12:44.976537 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:44.976013 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xsdtd" Jul 23 15:12:44.976537 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:44.976142 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bsgd9" Jul 23 15:12:44.976537 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:44.976142 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7wx7" podUID="fb607685-50d2-4fd7-b238-865b7726e7fa" Jul 23 15:12:44.976537 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:44.976244 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xsdtd" podUID="ffacaf02-b6c9-4245-bee8-eb863a7b117c" Jul 23 15:12:44.976537 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:44.976296 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bsgd9" podUID="ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb" Jul 23 15:12:45.211111 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:45.211066 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb607685-50d2-4fd7-b238-865b7726e7fa-original-pull-secret\") pod \"global-pull-secret-syncer-b7wx7\" (UID: \"fb607685-50d2-4fd7-b238-865b7726e7fa\") " pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:12:45.211300 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:45.211144 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q22ph\" (UniqueName: \"kubernetes.io/projected/ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb-kube-api-access-q22ph\") pod \"network-check-target-bsgd9\" (UID: \"ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb\") " pod="openshift-network-diagnostics/network-check-target-bsgd9" Jul 23 15:12:45.211300 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:45.211180 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffacaf02-b6c9-4245-bee8-eb863a7b117c-metrics-certs\") pod \"network-metrics-daemon-xsdtd\" (UID: \"ffacaf02-b6c9-4245-bee8-eb863a7b117c\") " pod="openshift-multus/network-metrics-daemon-xsdtd" Jul 23 15:12:45.211300 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:45.211223 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 15:12:45.211300 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:45.211300 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb607685-50d2-4fd7-b238-865b7726e7fa-original-pull-secret podName:fb607685-50d2-4fd7-b238-865b7726e7fa nodeName:}" failed. No retries permitted until 2026-07-23 15:12:53.211280562 +0000 UTC m=+18.193581389 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fb607685-50d2-4fd7-b238-865b7726e7fa-original-pull-secret") pod "global-pull-secret-syncer-b7wx7" (UID: "fb607685-50d2-4fd7-b238-865b7726e7fa") : object "kube-system"/"original-pull-secret" not registered Jul 23 15:12:45.211528 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:45.211346 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 15:12:45.211528 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:45.211369 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 15:12:45.211528 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:45.211382 2582 projected.go:196] Error preparing data for projected volume kube-api-access-q22ph for pod openshift-network-diagnostics/network-check-target-bsgd9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 15:12:45.211528 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:45.211388 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 15:12:45.211528 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:45.211432 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb-kube-api-access-q22ph podName:ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb nodeName:}" failed. No retries permitted until 2026-07-23 15:12:53.211415397 +0000 UTC m=+18.193716221 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-q22ph" (UniqueName: "kubernetes.io/projected/ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb-kube-api-access-q22ph") pod "network-check-target-bsgd9" (UID: "ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 15:12:45.211528 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:45.211455 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffacaf02-b6c9-4245-bee8-eb863a7b117c-metrics-certs podName:ffacaf02-b6c9-4245-bee8-eb863a7b117c nodeName:}" failed. No retries permitted until 2026-07-23 15:12:53.211443291 +0000 UTC m=+18.193744099 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ffacaf02-b6c9-4245-bee8-eb863a7b117c-metrics-certs") pod "network-metrics-daemon-xsdtd" (UID: "ffacaf02-b6c9-4245-bee8-eb863a7b117c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 15:12:46.976249 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:46.976211 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bsgd9" Jul 23 15:12:46.976249 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:46.976243 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xsdtd" Jul 23 15:12:46.976743 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:46.976211 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:12:46.976743 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:46.976348 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bsgd9" podUID="ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb" Jul 23 15:12:46.976743 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:46.976417 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7wx7" podUID="fb607685-50d2-4fd7-b238-865b7726e7fa" Jul 23 15:12:46.976743 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:46.976536 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xsdtd" podUID="ffacaf02-b6c9-4245-bee8-eb863a7b117c" Jul 23 15:12:48.976205 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:48.976167 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:12:48.976205 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:48.976198 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xsdtd" Jul 23 15:12:48.976205 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:48.976213 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bsgd9" Jul 23 15:12:48.976771 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:48.976306 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7wx7" podUID="fb607685-50d2-4fd7-b238-865b7726e7fa" Jul 23 15:12:48.976771 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:48.976391 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xsdtd" podUID="ffacaf02-b6c9-4245-bee8-eb863a7b117c" Jul 23 15:12:48.976771 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:48.976489 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bsgd9" podUID="ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb" Jul 23 15:12:50.976004 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:50.975977 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:12:50.976004 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:50.976002 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bsgd9" Jul 23 15:12:50.976464 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:50.975983 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xsdtd" Jul 23 15:12:50.976464 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:50.976093 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7wx7" podUID="fb607685-50d2-4fd7-b238-865b7726e7fa" Jul 23 15:12:50.976464 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:50.976233 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xsdtd" podUID="ffacaf02-b6c9-4245-bee8-eb863a7b117c" Jul 23 15:12:50.976464 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:50.976307 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bsgd9" podUID="ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb" Jul 23 15:12:52.976143 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:52.976094 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xsdtd" Jul 23 15:12:52.976143 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:52.976130 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:12:52.976794 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:52.976130 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bsgd9" Jul 23 15:12:52.976794 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:52.976227 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xsdtd" podUID="ffacaf02-b6c9-4245-bee8-eb863a7b117c" Jul 23 15:12:52.976794 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:52.976289 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7wx7" podUID="fb607685-50d2-4fd7-b238-865b7726e7fa" Jul 23 15:12:52.976794 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:52.976355 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bsgd9" podUID="ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb" Jul 23 15:12:53.272702 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:53.272603 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb607685-50d2-4fd7-b238-865b7726e7fa-original-pull-secret\") pod \"global-pull-secret-syncer-b7wx7\" (UID: \"fb607685-50d2-4fd7-b238-865b7726e7fa\") " pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:12:53.272702 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:53.272668 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q22ph\" (UniqueName: \"kubernetes.io/projected/ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb-kube-api-access-q22ph\") pod \"network-check-target-bsgd9\" (UID: \"ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb\") " pod="openshift-network-diagnostics/network-check-target-bsgd9" Jul 23 15:12:53.272702 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:53.272703 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffacaf02-b6c9-4245-bee8-eb863a7b117c-metrics-certs\") pod \"network-metrics-daemon-xsdtd\" (UID: \"ffacaf02-b6c9-4245-bee8-eb863a7b117c\") " pod="openshift-multus/network-metrics-daemon-xsdtd" Jul 23 15:12:53.273044 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:53.272765 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 15:12:53.273044 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:53.272825 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb607685-50d2-4fd7-b238-865b7726e7fa-original-pull-secret podName:fb607685-50d2-4fd7-b238-865b7726e7fa nodeName:}" failed. No retries permitted until 2026-07-23 15:13:09.272810737 +0000 UTC m=+34.255111548 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fb607685-50d2-4fd7-b238-865b7726e7fa-original-pull-secret") pod "global-pull-secret-syncer-b7wx7" (UID: "fb607685-50d2-4fd7-b238-865b7726e7fa") : object "kube-system"/"original-pull-secret" not registered Jul 23 15:12:53.273044 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:53.272851 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 15:12:53.273044 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:53.272888 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 15:12:53.273044 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:53.272902 2582 projected.go:196] Error preparing data for projected volume kube-api-access-q22ph for pod openshift-network-diagnostics/network-check-target-bsgd9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 15:12:53.273044 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:53.272942 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 15:12:53.273044 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:53.272953 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb-kube-api-access-q22ph podName:ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb nodeName:}" failed. No retries permitted until 2026-07-23 15:13:09.272938483 +0000 UTC m=+34.255239314 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-q22ph" (UniqueName: "kubernetes.io/projected/ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb-kube-api-access-q22ph") pod "network-check-target-bsgd9" (UID: "ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 15:12:53.273044 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:53.272994 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffacaf02-b6c9-4245-bee8-eb863a7b117c-metrics-certs podName:ffacaf02-b6c9-4245-bee8-eb863a7b117c nodeName:}" failed. No retries permitted until 2026-07-23 15:13:09.272979066 +0000 UTC m=+34.255279879 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ffacaf02-b6c9-4245-bee8-eb863a7b117c-metrics-certs") pod "network-metrics-daemon-xsdtd" (UID: "ffacaf02-b6c9-4245-bee8-eb863a7b117c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 15:12:54.975739 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:54.975699 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bsgd9" Jul 23 15:12:54.975739 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:54.975745 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:12:54.976231 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:54.975746 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xsdtd" Jul 23 15:12:54.976231 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:54.975831 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bsgd9" podUID="ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb" Jul 23 15:12:54.976231 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:54.975943 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7wx7" podUID="fb607685-50d2-4fd7-b238-865b7726e7fa" Jul 23 15:12:54.976231 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:54.976052 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xsdtd" podUID="ffacaf02-b6c9-4245-bee8-eb863a7b117c" Jul 23 15:12:56.478740 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:56.478694 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-5wkgs"] Jul 23 15:12:56.501833 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:56.501808 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5wkgs" Jul 23 15:12:56.504550 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:56.504527 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-gv85d\"" Jul 23 15:12:56.504767 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:56.504754 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 23 15:12:56.505621 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:56.505605 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 23 15:12:56.594056 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:56.594032 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3555cdac-b6d6-446c-8dbc-73850e135995-hosts-file\") pod \"node-resolver-5wkgs\" (UID: \"3555cdac-b6d6-446c-8dbc-73850e135995\") " pod="openshift-dns/node-resolver-5wkgs" Jul 23 15:12:56.594128 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:56.594081 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6dz7\" (UniqueName: \"kubernetes.io/projected/3555cdac-b6d6-446c-8dbc-73850e135995-kube-api-access-b6dz7\") pod \"node-resolver-5wkgs\" (UID: \"3555cdac-b6d6-446c-8dbc-73850e135995\") " pod="openshift-dns/node-resolver-5wkgs" Jul 23 15:12:56.594200 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:56.594181 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3555cdac-b6d6-446c-8dbc-73850e135995-tmp-dir\") pod \"node-resolver-5wkgs\" (UID: \"3555cdac-b6d6-446c-8dbc-73850e135995\") " pod="openshift-dns/node-resolver-5wkgs" Jul 23 15:12:56.695379 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:56.695345 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3555cdac-b6d6-446c-8dbc-73850e135995-tmp-dir\") pod \"node-resolver-5wkgs\" (UID: \"3555cdac-b6d6-446c-8dbc-73850e135995\") " pod="openshift-dns/node-resolver-5wkgs" Jul 23 15:12:56.695379 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:56.695381 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3555cdac-b6d6-446c-8dbc-73850e135995-hosts-file\") pod \"node-resolver-5wkgs\" (UID: \"3555cdac-b6d6-446c-8dbc-73850e135995\") " pod="openshift-dns/node-resolver-5wkgs" Jul 23 15:12:56.695589 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:56.695412 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6dz7\" (UniqueName: \"kubernetes.io/projected/3555cdac-b6d6-446c-8dbc-73850e135995-kube-api-access-b6dz7\") pod \"node-resolver-5wkgs\" (UID: \"3555cdac-b6d6-446c-8dbc-73850e135995\") " pod="openshift-dns/node-resolver-5wkgs" Jul 23 15:12:56.695589 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:56.695505 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3555cdac-b6d6-446c-8dbc-73850e135995-hosts-file\") pod \"node-resolver-5wkgs\" (UID: \"3555cdac-b6d6-446c-8dbc-73850e135995\") " pod="openshift-dns/node-resolver-5wkgs" Jul 23 15:12:56.695743 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:56.695724 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3555cdac-b6d6-446c-8dbc-73850e135995-tmp-dir\") pod \"node-resolver-5wkgs\" (UID: \"3555cdac-b6d6-446c-8dbc-73850e135995\") " pod="openshift-dns/node-resolver-5wkgs" Jul 23 15:12:56.710186 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:56.710156 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6dz7\" (UniqueName: \"kubernetes.io/projected/3555cdac-b6d6-446c-8dbc-73850e135995-kube-api-access-b6dz7\") pod \"node-resolver-5wkgs\" (UID: \"3555cdac-b6d6-446c-8dbc-73850e135995\") " pod="openshift-dns/node-resolver-5wkgs" Jul 23 15:12:56.810048 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:56.810022 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5wkgs" Jul 23 15:12:56.850903 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:12:56.850873 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3555cdac_b6d6_446c_8dbc_73850e135995.slice/crio-c351db48c3a8e5c0992e443ea991e8e50140b4673dec0485f0a557d062fb873e WatchSource:0}: Error finding container c351db48c3a8e5c0992e443ea991e8e50140b4673dec0485f0a557d062fb873e: Status 404 returned error can't find the container with id c351db48c3a8e5c0992e443ea991e8e50140b4673dec0485f0a557d062fb873e Jul 23 15:12:56.977046 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:56.976201 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:12:56.977046 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:56.976323 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7wx7" podUID="fb607685-50d2-4fd7-b238-865b7726e7fa" Jul 23 15:12:56.977046 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:56.976763 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bsgd9" Jul 23 15:12:56.977046 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:56.976872 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bsgd9" podUID="ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb" Jul 23 15:12:56.977046 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:56.976934 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xsdtd" Jul 23 15:12:56.977046 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:56.977013 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xsdtd" podUID="ffacaf02-b6c9-4245-bee8-eb863a7b117c" Jul 23 15:12:57.062432 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:57.062268 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" event={"ID":"747d68153f2a6e5680c1224eb7cb36a8","Type":"ContainerStarted","Data":"2eb5a421065df2abdaeead7d586cfeaa19950018002128858941929eac0722d2"} Jul 23 15:12:57.063937 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:57.063908 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8qhdh" event={"ID":"45cd984a-be03-413a-9229-c3b195e80e25","Type":"ContainerStarted","Data":"5ace8bf8575a0b90373d6d34497995722b04a4e94846e43ef949b17419a23a88"} Jul 23 15:12:57.069276 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:57.069221 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4c6h4" event={"ID":"e0b34ed2-b27e-4b52-8f86-584ef89bd71e","Type":"ContainerStarted","Data":"e812f31697a00dbade7a231ad537165a5f5fbb38cc7e4ed26271136ce21e442d"} Jul 23 15:12:57.073561 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:57.073531 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nfdrv" event={"ID":"d7627ebf-1afb-4d04-8218-f1242fb9a742","Type":"ContainerStarted","Data":"beabadf0d807336811a0d5a16014474ff9e97adab52feb1439b8bfcbee109be6"} Jul 23 15:12:57.075263 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:57.075147 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" event={"ID":"8564870e-3d81-4633-a187-b2ebfd22bd69","Type":"ContainerStarted","Data":"e26e4c539391e25a29b4796827fe38f1e9c0db804cc9d86d04e9cc2c2b754f05"} Jul 23 15:12:57.076192 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:57.076167 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5wkgs" event={"ID":"3555cdac-b6d6-446c-8dbc-73850e135995","Type":"ContainerStarted","Data":"c351db48c3a8e5c0992e443ea991e8e50140b4673dec0485f0a557d062fb873e"} Jul 23 15:12:57.077530 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:57.077503 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" event={"ID":"fe195eea-0d32-4761-a885-e953d4460bcc","Type":"ContainerStarted","Data":"3ab369532fee829beb8711341403d98b9396a00e8753ca685b4bbe22f33de28d"} Jul 23 15:12:57.078885 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:57.078843 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4v49" event={"ID":"71c26905-7c6e-4291-a1f3-5d8251939199","Type":"ContainerStarted","Data":"ecad7ee0b735ca1d2e6886a90b302a64e82e7c2b0648c6a90c3ac57f142451c5"} Jul 23 15:12:57.080023 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:57.079987 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-213.ec2.internal" podStartSLOduration=21.079976019 podStartE2EDuration="21.079976019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:12:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:12:57.07919761 +0000 UTC m=+22.061498442" watchObservedRunningTime="2026-07-23 15:12:57.079976019 +0000 UTC m=+22.062276848" Jul 23 15:12:57.122651 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:57.122593 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8qhdh" podStartSLOduration=2.165875753 podStartE2EDuration="21.122575029s" totalImagesPullingTime="18.956699276s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:12:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:12:57.121595556 +0000 UTC m=+22.103896386" watchObservedRunningTime="2026-07-23 15:12:57.122575029 +0000 UTC m=+22.104875858" Jul 23 15:12:57.142132 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:57.142013 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lgn6w" podStartSLOduration=2.144340779 podStartE2EDuration="21.141992875s" totalImagesPullingTime="18.997652096s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:12:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:12:57.141450711 +0000 UTC m=+22.123751540" watchObservedRunningTime="2026-07-23 15:12:57.141992875 +0000 UTC m=+22.124293708" Jul 23 15:12:57.184610 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:57.184556 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4c6h4" podStartSLOduration=7.043901403 podStartE2EDuration="21.184536146s" totalImagesPullingTime="14.140634743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:12:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:12:57.176649405 +0000 UTC m=+22.158950234" watchObservedRunningTime="2026-07-23 15:12:57.184536146 +0000 UTC m=+22.166836977" Jul 23 15:12:58.085136 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:58.084965 2582 generic.go:356] "Generic (PLEG): container finished" podID="d7627ebf-1afb-4d04-8218-f1242fb9a742" containerID="beabadf0d807336811a0d5a16014474ff9e97adab52feb1439b8bfcbee109be6" exitCode=0 Jul 23 15:12:58.085875 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:58.085049 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nfdrv" event={"ID":"d7627ebf-1afb-4d04-8218-f1242fb9a742","Type":"ContainerDied","Data":"beabadf0d807336811a0d5a16014474ff9e97adab52feb1439b8bfcbee109be6"} Jul 23 15:12:58.086658 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:58.086639 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5wkgs" event={"ID":"3555cdac-b6d6-446c-8dbc-73850e135995","Type":"ContainerStarted","Data":"23e7cddc85c97204f73cdd846d8afc4c9024af9c8e86b81885b641423249516d"} Jul 23 15:12:58.089467 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:58.089450 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pgrx7_fe195eea-0d32-4761-a885-e953d4460bcc/ovn-acl-logging/0.log" Jul 23 15:12:58.089782 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:58.089764 2582 generic.go:356] "Generic (PLEG): container finished" podID="fe195eea-0d32-4761-a885-e953d4460bcc" containerID="4366c75d78acc4776a45ce8c39d86c78f45883fac831ec3d796d700e6e620148" exitCode=1 Jul 23 15:12:58.089839 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:58.089821 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" event={"ID":"fe195eea-0d32-4761-a885-e953d4460bcc","Type":"ContainerStarted","Data":"e1dbc269c0e2bd0ab157818271db0ffe927ca921f025622b81f933b3c422a08f"} Jul 23 15:12:58.089910 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:58.089885 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" event={"ID":"fe195eea-0d32-4761-a885-e953d4460bcc","Type":"ContainerStarted","Data":"94aff48752ffa002655d5ca37c161ca414790720536f0a9494543022a7bcfdb6"} Jul 23 15:12:58.089958 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:58.089915 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" event={"ID":"fe195eea-0d32-4761-a885-e953d4460bcc","Type":"ContainerStarted","Data":"39b0b3a9d906b1794b9abade74f9694c92a505924744d42afcbd0c4788d0ff41"} Jul 23 15:12:58.089958 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:58.089942 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" event={"ID":"fe195eea-0d32-4761-a885-e953d4460bcc","Type":"ContainerStarted","Data":"f0e7b95985962a2d35a9998daee2c5f6cc80efc74d5e1c7d181edcd59d095f06"} Jul 23 15:12:58.090030 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:58.089968 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" event={"ID":"fe195eea-0d32-4761-a885-e953d4460bcc","Type":"ContainerDied","Data":"4366c75d78acc4776a45ce8c39d86c78f45883fac831ec3d796d700e6e620148"} Jul 23 15:12:58.091281 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:58.091227 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d2249" event={"ID":"7fbc52f2-0509-44c3-91b2-428cc69d99eb","Type":"ContainerStarted","Data":"4521f8246c0347dda61144e54976dadf02ad6ee9598f16faae7a95dc6cd1f0bb"} Jul 23 15:12:58.126874 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:58.126805 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5wkgs" podStartSLOduration=2.126787786 podStartE2EDuration="2.126787786s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:12:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:12:58.126579188 +0000 UTC m=+23.108880022" watchObservedRunningTime="2026-07-23 15:12:58.126787786 +0000 UTC m=+23.109088615" Jul 23 15:12:58.145428 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:58.145377 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-d2249" podStartSLOduration=2.716480976 podStartE2EDuration="22.145361333s" totalImagesPullingTime="19.428880357s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:12:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:12:58.144694633 +0000 UTC m=+23.126995475" watchObservedRunningTime="2026-07-23 15:12:58.145361333 +0000 UTC m=+23.127662162" Jul 23 15:12:58.420795 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:58.420765 2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 23 15:12:58.884230 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:58.883939 2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T15:12:58.42078881Z","UUID":"5eebe0e6-eb61-4332-9cdb-f1eace1c83ee","Handler":null,"Name":"","Endpoint":""} Jul 23 15:12:58.885446 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:58.885421 2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 23 15:12:58.885576 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:58.885465 2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 23 15:12:58.976478 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:58.976444 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:12:58.976694 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:58.976457 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xsdtd" Jul 23 15:12:58.976694 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:58.976578 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7wx7" podUID="fb607685-50d2-4fd7-b238-865b7726e7fa" Jul 23 15:12:58.976694 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:58.976455 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bsgd9" Jul 23 15:12:58.976694 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:58.976677 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xsdtd" podUID="ffacaf02-b6c9-4245-bee8-eb863a7b117c" Jul 23 15:12:58.976999 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:12:58.976786 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bsgd9" podUID="ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb" Jul 23 15:12:59.095871 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:59.095834 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4v49" event={"ID":"71c26905-7c6e-4291-a1f3-5d8251939199","Type":"ContainerStarted","Data":"bd3c6eb5094b5bd3164b4c8ef8ac7d1d3c49b3514fc74459e459fe5ea10884f9"} Jul 23 15:12:59.097704 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:59.097676 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tt2g5" event={"ID":"6089d453-26a4-4e10-ae2c-948293b23a47","Type":"ContainerStarted","Data":"fc284deb58d28902d78028461dcc15d909ac11fb29a4e6c1cfe1561eefd87b46"} Jul 23 15:12:59.114773 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:12:59.114705 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tt2g5" podStartSLOduration=4.148585265 podStartE2EDuration="23.114689284s" totalImagesPullingTime="18.966104019s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:12:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:12:59.114578251 +0000 UTC m=+24.096879082" watchObservedRunningTime="2026-07-23 15:12:59.114689284 +0000 UTC m=+24.096990113" Jul 23 15:13:00.104247 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:00.104220 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pgrx7_fe195eea-0d32-4761-a885-e953d4460bcc/ovn-acl-logging/0.log" Jul 23 15:13:00.104709 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:00.104680 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" event={"ID":"fe195eea-0d32-4761-a885-e953d4460bcc","Type":"ContainerStarted","Data":"09aca8ea91df880ddaf9ccdb6aab0366bf920c5266366da14df7a33de777481f"} Jul 23 15:13:00.106925 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:00.106891 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4v49" event={"ID":"71c26905-7c6e-4291-a1f3-5d8251939199","Type":"ContainerStarted","Data":"c8d5e1e8578481e31107be6775f3f5608aef256596b49f81025d45a9db37a873"} Jul 23 15:13:00.131306 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:00.131243 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b4v49" podStartSLOduration=3.700639408 podStartE2EDuration="25.131226669s" totalImagesPullingTime="21.430587261s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:12:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:13:00.129249604 +0000 UTC m=+25.111550433" watchObservedRunningTime="2026-07-23 15:13:00.131226669 +0000 UTC m=+25.113527499" Jul 23 15:13:00.926573 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:00.926540 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4c6h4" Jul 23 15:13:00.927372 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:00.927346 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4c6h4" Jul 23 15:13:00.976135 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:00.976095 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:13:00.976135 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:00.976132 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xsdtd" Jul 23 15:13:00.976360 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:00.976140 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bsgd9" Jul 23 15:13:00.976360 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:00.976226 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7wx7" podUID="fb607685-50d2-4fd7-b238-865b7726e7fa" Jul 23 15:13:00.976360 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:00.976285 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xsdtd" podUID="ffacaf02-b6c9-4245-bee8-eb863a7b117c" Jul 23 15:13:00.976493 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:00.976389 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bsgd9" podUID="ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb" Jul 23 15:13:01.109922 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:01.109891 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4c6h4" Jul 23 15:13:01.110534 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:01.110389 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4c6h4" Jul 23 15:13:02.976257 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:02.976045 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:13:02.976835 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:02.976071 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bsgd9" Jul 23 15:13:02.976835 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:02.976335 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7wx7" podUID="fb607685-50d2-4fd7-b238-865b7726e7fa" Jul 23 15:13:02.976835 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:02.976386 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bsgd9" podUID="ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb" Jul 23 15:13:02.976835 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:02.976106 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xsdtd" Jul 23 15:13:02.976835 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:02.976503 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xsdtd" podUID="ffacaf02-b6c9-4245-bee8-eb863a7b117c" Jul 23 15:13:03.116123 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:03.116090 2582 generic.go:356] "Generic (PLEG): container finished" podID="d7627ebf-1afb-4d04-8218-f1242fb9a742" containerID="513dedd8e0a9de88b05e230aea819411cf7766375620cc7c828fde9982efa8e4" exitCode=0 Jul 23 15:13:03.116268 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:03.116174 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nfdrv" event={"ID":"d7627ebf-1afb-4d04-8218-f1242fb9a742","Type":"ContainerDied","Data":"513dedd8e0a9de88b05e230aea819411cf7766375620cc7c828fde9982efa8e4"} Jul 23 15:13:03.122339 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:03.122319 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pgrx7_fe195eea-0d32-4761-a885-e953d4460bcc/ovn-acl-logging/0.log" Jul 23 15:13:03.122698 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:03.122671 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" event={"ID":"fe195eea-0d32-4761-a885-e953d4460bcc","Type":"ContainerStarted","Data":"b4514143f45676138bf2e8b2803dc52f50e54aa059c681a82610e46d147a48c6"} Jul 23 15:13:03.123151 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:03.123137 2582 scope.go:117] "RemoveContainer" containerID="4366c75d78acc4776a45ce8c39d86c78f45883fac831ec3d796d700e6e620148" Jul 23 15:13:04.127322 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:04.127229 2582 generic.go:356] "Generic (PLEG): container finished" podID="d7627ebf-1afb-4d04-8218-f1242fb9a742" containerID="2dbff5f6d1791ee6241f2fd237a3b81f298b3e867860186ea1d5ffc9c3cef859" exitCode=0 Jul 23 15:13:04.127322 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:04.127302 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nfdrv" event={"ID":"d7627ebf-1afb-4d04-8218-f1242fb9a742","Type":"ContainerDied","Data":"2dbff5f6d1791ee6241f2fd237a3b81f298b3e867860186ea1d5ffc9c3cef859"} Jul 23 15:13:04.131311 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:04.131294 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pgrx7_fe195eea-0d32-4761-a885-e953d4460bcc/ovn-acl-logging/0.log" Jul 23 15:13:04.131732 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:04.131701 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" event={"ID":"fe195eea-0d32-4761-a885-e953d4460bcc","Type":"ContainerStarted","Data":"e9785111dbdc2e7b2e5d443bd5458037b720b9083540f940c98abf303cc81b7b"} Jul 23 15:13:04.132011 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:04.131992 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:13:04.132094 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:04.132078 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:13:04.132143 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:04.132129 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:13:04.147816 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:04.147788 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:13:04.148177 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:04.148158 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:13:04.910825 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:04.910765 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" podStartSLOduration=9.876154025 podStartE2EDuration="28.910742181s" totalImagesPullingTime="19.034588156s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:12:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:13:04.191401258 +0000 UTC m=+29.173702088" watchObservedRunningTime="2026-07-23 15:13:04.910742181 +0000 UTC m=+29.893043011" Jul 23 15:13:04.911485 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:04.911452 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xsdtd"] Jul 23 15:13:04.911635 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:04.911620 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xsdtd" Jul 23 15:13:04.911796 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:04.911777 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xsdtd" podUID="ffacaf02-b6c9-4245-bee8-eb863a7b117c" Jul 23 15:13:04.917527 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:04.917443 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bsgd9"] Jul 23 15:13:04.917667 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:04.917579 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bsgd9" Jul 23 15:13:04.917786 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:04.917759 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bsgd9" podUID="ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb" Jul 23 15:13:04.918251 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:04.918226 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b7wx7"] Jul 23 15:13:04.918363 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:04.918343 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:13:04.918494 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:04.918446 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7wx7" podUID="fb607685-50d2-4fd7-b238-865b7726e7fa" Jul 23 15:13:05.137027 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:05.136991 2582 generic.go:356] "Generic (PLEG): container finished" podID="d7627ebf-1afb-4d04-8218-f1242fb9a742" containerID="9ed26b055145ead8c3619e90d4f0527c4829957ad256b5b2c44e6a9f0ccdf7a8" exitCode=0 Jul 23 15:13:05.137494 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:05.137079 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nfdrv" event={"ID":"d7627ebf-1afb-4d04-8218-f1242fb9a742","Type":"ContainerDied","Data":"9ed26b055145ead8c3619e90d4f0527c4829957ad256b5b2c44e6a9f0ccdf7a8"} Jul 23 15:13:06.851513 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:06.851436 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:06.941387 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:06.941347 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:06.975791 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:06.975758 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:13:06.975791 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:06.975787 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bsgd9" Jul 23 15:13:06.976065 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:06.975794 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xsdtd" Jul 23 15:13:06.976065 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:06.975901 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7wx7" podUID="fb607685-50d2-4fd7-b238-865b7726e7fa" Jul 23 15:13:06.976065 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:06.976032 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bsgd9" podUID="ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb" Jul 23 15:13:06.976199 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:06.976136 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xsdtd" podUID="ffacaf02-b6c9-4245-bee8-eb863a7b117c" Jul 23 15:13:07.044405 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:07.044368 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:07.144595 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:07.144514 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:08.976365 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:08.976323 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bsgd9" Jul 23 15:13:08.976365 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:08.976351 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xsdtd" Jul 23 15:13:08.976852 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:08.976351 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:13:08.976852 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:08.976465 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bsgd9" podUID="ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb" Jul 23 15:13:08.976852 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:08.976546 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-xsdtd" podUID="ffacaf02-b6c9-4245-bee8-eb863a7b117c" Jul 23 15:13:08.976852 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:08.976615 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b7wx7" podUID="fb607685-50d2-4fd7-b238-865b7726e7fa" Jul 23 15:13:09.281238 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.281140 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q22ph\" (UniqueName: \"kubernetes.io/projected/ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb-kube-api-access-q22ph\") pod \"network-check-target-bsgd9\" (UID: \"ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb\") " pod="openshift-network-diagnostics/network-check-target-bsgd9" Jul 23 15:13:09.281238 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.281205 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffacaf02-b6c9-4245-bee8-eb863a7b117c-metrics-certs\") pod \"network-metrics-daemon-xsdtd\" (UID: \"ffacaf02-b6c9-4245-bee8-eb863a7b117c\") " pod="openshift-multus/network-metrics-daemon-xsdtd" Jul 23 15:13:09.281580 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:09.281334 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 15:13:09.281580 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.281364 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb607685-50d2-4fd7-b238-865b7726e7fa-original-pull-secret\") pod \"global-pull-secret-syncer-b7wx7\" (UID: \"fb607685-50d2-4fd7-b238-865b7726e7fa\") " pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:13:09.281580 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:09.281335 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 15:13:09.281580 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:09.281398 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffacaf02-b6c9-4245-bee8-eb863a7b117c-metrics-certs podName:ffacaf02-b6c9-4245-bee8-eb863a7b117c nodeName:}" failed. No retries permitted until 2026-07-23 15:13:41.281380122 +0000 UTC m=+66.263680952 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ffacaf02-b6c9-4245-bee8-eb863a7b117c-metrics-certs") pod "network-metrics-daemon-xsdtd" (UID: "ffacaf02-b6c9-4245-bee8-eb863a7b117c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 15:13:09.281580 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:09.281402 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 15:13:09.281580 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:09.281415 2582 projected.go:196] Error preparing data for projected volume kube-api-access-q22ph for pod openshift-network-diagnostics/network-check-target-bsgd9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 15:13:09.281580 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:09.281446 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 15:13:09.281580 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:09.281453 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb-kube-api-access-q22ph podName:ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb nodeName:}" failed. No retries permitted until 2026-07-23 15:13:41.2814409 +0000 UTC m=+66.263741709 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-q22ph" (UniqueName: "kubernetes.io/projected/ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb-kube-api-access-q22ph") pod "network-check-target-bsgd9" (UID: "ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 15:13:09.281580 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:09.281528 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fb607685-50d2-4fd7-b238-865b7726e7fa-original-pull-secret podName:fb607685-50d2-4fd7-b238-865b7726e7fa nodeName:}" failed. No retries permitted until 2026-07-23 15:13:41.281506048 +0000 UTC m=+66.263806858 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/fb607685-50d2-4fd7-b238-865b7726e7fa-original-pull-secret") pod "global-pull-secret-syncer-b7wx7" (UID: "fb607685-50d2-4fd7-b238-865b7726e7fa") : object "kube-system"/"original-pull-secret" not registered Jul 23 15:13:09.868504 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.868329 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-213.ec2.internal" event="NodeReady" Jul 23 15:13:09.868631 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.868610 2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 23 15:13:09.917837 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.917797 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68d466d8dd-94b5b"] Jul 23 15:13:09.936248 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.936215 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hth64"] Jul 23 15:13:09.936425 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.936347 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:13:09.943013 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.942398 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 23 15:13:09.943013 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.942511 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zt8sw\"" Jul 23 15:13:09.943013 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.942967 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 23 15:13:09.943220 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.943059 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 23 15:13:09.950235 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.950206 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-j4mcc"] Jul 23 15:13:09.950402 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.950386 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hth64" Jul 23 15:13:09.951579 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.951557 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 23 15:13:09.953064 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.953046 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 23 15:13:09.953159 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.953113 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7fsth\"" Jul 23 15:13:09.954411 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.954389 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 23 15:13:09.968681 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.968659 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68d466d8dd-94b5b"] Jul 23 15:13:09.968803 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.968698 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hth64"] Jul 23 15:13:09.968803 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.968722 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j4mcc"] Jul 23 15:13:09.968803 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.968764 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j4mcc" Jul 23 15:13:09.971506 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.971484 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 23 15:13:09.971797 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.971785 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 23 15:13:09.972142 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.972128 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xt5k8\"" Jul 23 15:13:09.972438 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.972426 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 23 15:13:09.986086 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.986058 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ad0292fd-a3da-4563-b653-7e074c787676-registry-certificates\") pod \"image-registry-68d466d8dd-94b5b\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:13:09.986492 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.986090 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd638ec4-5039-4f53-99f6-5774f533aa7a-metrics-tls\") pod \"dns-default-hth64\" (UID: \"bd638ec4-5039-4f53-99f6-5774f533aa7a\") " pod="openshift-dns/dns-default-hth64" Jul 23 15:13:09.986492 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.986108 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd638ec4-5039-4f53-99f6-5774f533aa7a-tmp-dir\") pod \"dns-default-hth64\" (UID: \"bd638ec4-5039-4f53-99f6-5774f533aa7a\") " pod="openshift-dns/dns-default-hth64" Jul 23 15:13:09.986492 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.986127 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-registry-tls\") pod \"image-registry-68d466d8dd-94b5b\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:13:09.986492 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.986142 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ad0292fd-a3da-4563-b653-7e074c787676-ca-trust-extracted\") pod \"image-registry-68d466d8dd-94b5b\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:13:09.986492 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.986215 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ad0292fd-a3da-4563-b653-7e074c787676-image-registry-private-configuration\") pod \"image-registry-68d466d8dd-94b5b\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:13:09.986492 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.986249 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-bound-sa-token\") pod \"image-registry-68d466d8dd-94b5b\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:13:09.986492 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.986322 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlrsc\" (UniqueName: \"kubernetes.io/projected/bd638ec4-5039-4f53-99f6-5774f533aa7a-kube-api-access-vlrsc\") pod \"dns-default-hth64\" (UID: \"bd638ec4-5039-4f53-99f6-5774f533aa7a\") " pod="openshift-dns/dns-default-hth64" Jul 23 15:13:09.986492 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.986353 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ad0292fd-a3da-4563-b653-7e074c787676-trusted-ca\") pod \"image-registry-68d466d8dd-94b5b\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:13:09.986492 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.986391 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k464m\" (UniqueName: \"kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-kube-api-access-k464m\") pod \"image-registry-68d466d8dd-94b5b\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:13:09.986492 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.986429 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bd638ec4-5039-4f53-99f6-5774f533aa7a-config-volume\") pod \"dns-default-hth64\" (UID: \"bd638ec4-5039-4f53-99f6-5774f533aa7a\") " pod="openshift-dns/dns-default-hth64" Jul 23 15:13:09.986492 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:09.986447 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ad0292fd-a3da-4563-b653-7e074c787676-installation-pull-secrets\") pod \"image-registry-68d466d8dd-94b5b\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:13:10.087748 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.087706 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-bound-sa-token\") pod \"image-registry-68d466d8dd-94b5b\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:13:10.087748 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.087756 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlrsc\" (UniqueName: \"kubernetes.io/projected/bd638ec4-5039-4f53-99f6-5774f533aa7a-kube-api-access-vlrsc\") pod \"dns-default-hth64\" (UID: \"bd638ec4-5039-4f53-99f6-5774f533aa7a\") " pod="openshift-dns/dns-default-hth64" Jul 23 15:13:10.088009 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.087773 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ad0292fd-a3da-4563-b653-7e074c787676-trusted-ca\") pod \"image-registry-68d466d8dd-94b5b\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:13:10.088009 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.087801 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k464m\" (UniqueName: \"kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-kube-api-access-k464m\") pod \"image-registry-68d466d8dd-94b5b\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:13:10.088009 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.087883 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4bbea83b-d4d2-4103-9f4d-b67e865dfea1-cert\") pod \"ingress-canary-j4mcc\" (UID: \"4bbea83b-d4d2-4103-9f4d-b67e865dfea1\") " pod="openshift-ingress-canary/ingress-canary-j4mcc" Jul 23 15:13:10.088009 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.087935 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bd638ec4-5039-4f53-99f6-5774f533aa7a-config-volume\") pod \"dns-default-hth64\" (UID: \"bd638ec4-5039-4f53-99f6-5774f533aa7a\") " pod="openshift-dns/dns-default-hth64" Jul 23 15:13:10.088009 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.087962 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ad0292fd-a3da-4563-b653-7e074c787676-installation-pull-secrets\") pod \"image-registry-68d466d8dd-94b5b\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:13:10.088263 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.088124 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ad0292fd-a3da-4563-b653-7e074c787676-registry-certificates\") pod \"image-registry-68d466d8dd-94b5b\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:13:10.088263 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.088164 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd638ec4-5039-4f53-99f6-5774f533aa7a-metrics-tls\") pod \"dns-default-hth64\" (UID: \"bd638ec4-5039-4f53-99f6-5774f533aa7a\") " pod="openshift-dns/dns-default-hth64" Jul 23 15:13:10.088263 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.088188 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd638ec4-5039-4f53-99f6-5774f533aa7a-tmp-dir\") pod \"dns-default-hth64\" (UID: \"bd638ec4-5039-4f53-99f6-5774f533aa7a\") " pod="openshift-dns/dns-default-hth64" Jul 23 15:13:10.088263 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.088207 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-registry-tls\") pod \"image-registry-68d466d8dd-94b5b\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:13:10.088263 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.088223 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ad0292fd-a3da-4563-b653-7e074c787676-ca-trust-extracted\") pod \"image-registry-68d466d8dd-94b5b\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:13:10.088565 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:10.088340 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 15:13:10.088565 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.088368 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k55qs\" (UniqueName: \"kubernetes.io/projected/4bbea83b-d4d2-4103-9f4d-b67e865dfea1-kube-api-access-k55qs\") pod \"ingress-canary-j4mcc\" (UID: \"4bbea83b-d4d2-4103-9f4d-b67e865dfea1\") " pod="openshift-ingress-canary/ingress-canary-j4mcc" Jul 23 15:13:10.088565 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.088424 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ad0292fd-a3da-4563-b653-7e074c787676-image-registry-private-configuration\") pod \"image-registry-68d466d8dd-94b5b\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:13:10.088565 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:10.088505 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd638ec4-5039-4f53-99f6-5774f533aa7a-metrics-tls podName:bd638ec4-5039-4f53-99f6-5774f533aa7a nodeName:}" failed. No retries permitted until 2026-07-23 15:13:10.588467369 +0000 UTC m=+35.570768188 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd638ec4-5039-4f53-99f6-5774f533aa7a-metrics-tls") pod "dns-default-hth64" (UID: "bd638ec4-5039-4f53-99f6-5774f533aa7a") : secret "dns-default-metrics-tls" not found Jul 23 15:13:10.088565 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.088519 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd638ec4-5039-4f53-99f6-5774f533aa7a-tmp-dir\") pod \"dns-default-hth64\" (UID: \"bd638ec4-5039-4f53-99f6-5774f533aa7a\") " pod="openshift-dns/dns-default-hth64" Jul 23 15:13:10.088565 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:10.088343 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 15:13:10.088565 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:10.088565 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68d466d8dd-94b5b: secret "image-registry-tls" not found Jul 23 15:13:10.088949 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:10.088619 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-registry-tls podName:ad0292fd-a3da-4563-b653-7e074c787676 nodeName:}" failed. No retries permitted until 2026-07-23 15:13:10.588605766 +0000 UTC m=+35.570906578 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-registry-tls") pod "image-registry-68d466d8dd-94b5b" (UID: "ad0292fd-a3da-4563-b653-7e074c787676") : secret "image-registry-tls" not found Jul 23 15:13:10.088949 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.088728 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ad0292fd-a3da-4563-b653-7e074c787676-ca-trust-extracted\") pod \"image-registry-68d466d8dd-94b5b\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:13:10.088949 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.088911 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bd638ec4-5039-4f53-99f6-5774f533aa7a-config-volume\") pod \"dns-default-hth64\" (UID: \"bd638ec4-5039-4f53-99f6-5774f533aa7a\") " pod="openshift-dns/dns-default-hth64" Jul 23 15:13:10.089091 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.088976 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ad0292fd-a3da-4563-b653-7e074c787676-registry-certificates\") pod \"image-registry-68d466d8dd-94b5b\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:13:10.089091 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.089025 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ad0292fd-a3da-4563-b653-7e074c787676-trusted-ca\") pod \"image-registry-68d466d8dd-94b5b\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:13:10.092288 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.092267 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ad0292fd-a3da-4563-b653-7e074c787676-installation-pull-secrets\") pod \"image-registry-68d466d8dd-94b5b\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:13:10.092409 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.092289 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ad0292fd-a3da-4563-b653-7e074c787676-image-registry-private-configuration\") pod \"image-registry-68d466d8dd-94b5b\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:13:10.104445 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.104371 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k464m\" (UniqueName: \"kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-kube-api-access-k464m\") pod \"image-registry-68d466d8dd-94b5b\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:13:10.105323 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.105298 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlrsc\" (UniqueName: \"kubernetes.io/projected/bd638ec4-5039-4f53-99f6-5774f533aa7a-kube-api-access-vlrsc\") pod \"dns-default-hth64\" (UID: \"bd638ec4-5039-4f53-99f6-5774f533aa7a\") " pod="openshift-dns/dns-default-hth64" Jul 23 15:13:10.107292 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.107261 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-bound-sa-token\") pod \"image-registry-68d466d8dd-94b5b\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:13:10.151605 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.151567 2582 generic.go:356] "Generic (PLEG): container finished" podID="d7627ebf-1afb-4d04-8218-f1242fb9a742" containerID="f34663154df152ec2d7747fe792ab3605104dc1f4827d6127f5f07155a4c537e" exitCode=0 Jul 23 15:13:10.151758 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.151639 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nfdrv" event={"ID":"d7627ebf-1afb-4d04-8218-f1242fb9a742","Type":"ContainerDied","Data":"f34663154df152ec2d7747fe792ab3605104dc1f4827d6127f5f07155a4c537e"} Jul 23 15:13:10.188878 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.188821 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4bbea83b-d4d2-4103-9f4d-b67e865dfea1-cert\") pod \"ingress-canary-j4mcc\" (UID: \"4bbea83b-d4d2-4103-9f4d-b67e865dfea1\") " pod="openshift-ingress-canary/ingress-canary-j4mcc" Jul 23 15:13:10.189071 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.188963 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k55qs\" (UniqueName: \"kubernetes.io/projected/4bbea83b-d4d2-4103-9f4d-b67e865dfea1-kube-api-access-k55qs\") pod \"ingress-canary-j4mcc\" (UID: \"4bbea83b-d4d2-4103-9f4d-b67e865dfea1\") " pod="openshift-ingress-canary/ingress-canary-j4mcc" Jul 23 15:13:10.191511 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.191483 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4bbea83b-d4d2-4103-9f4d-b67e865dfea1-cert\") pod \"ingress-canary-j4mcc\" (UID: \"4bbea83b-d4d2-4103-9f4d-b67e865dfea1\") " pod="openshift-ingress-canary/ingress-canary-j4mcc" Jul 23 15:13:10.200509 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.200483 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k55qs\" (UniqueName: \"kubernetes.io/projected/4bbea83b-d4d2-4103-9f4d-b67e865dfea1-kube-api-access-k55qs\") pod \"ingress-canary-j4mcc\" (UID: \"4bbea83b-d4d2-4103-9f4d-b67e865dfea1\") " pod="openshift-ingress-canary/ingress-canary-j4mcc" Jul 23 15:13:10.277053 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.277012 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-j4mcc" Jul 23 15:13:10.458677 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.458645 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-j4mcc"] Jul 23 15:13:10.461779 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:13:10.461750 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bbea83b_d4d2_4103_9f4d_b67e865dfea1.slice/crio-3310a39415925c208eda5416c5ff6822a45ab719cab5aacb9b2b88a83b3e833b WatchSource:0}: Error finding container 3310a39415925c208eda5416c5ff6822a45ab719cab5aacb9b2b88a83b3e833b: Status 404 returned error can't find the container with id 3310a39415925c208eda5416c5ff6822a45ab719cab5aacb9b2b88a83b3e833b Jul 23 15:13:10.592465 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.592423 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd638ec4-5039-4f53-99f6-5774f533aa7a-metrics-tls\") pod \"dns-default-hth64\" (UID: \"bd638ec4-5039-4f53-99f6-5774f533aa7a\") " pod="openshift-dns/dns-default-hth64" Jul 23 15:13:10.592465 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.592464 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-registry-tls\") pod \"image-registry-68d466d8dd-94b5b\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:13:10.592714 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:10.592568 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 15:13:10.592714 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:10.592625 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 15:13:10.592714 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:10.592637 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd638ec4-5039-4f53-99f6-5774f533aa7a-metrics-tls podName:bd638ec4-5039-4f53-99f6-5774f533aa7a nodeName:}" failed. No retries permitted until 2026-07-23 15:13:11.592622069 +0000 UTC m=+36.574922877 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd638ec4-5039-4f53-99f6-5774f533aa7a-metrics-tls") pod "dns-default-hth64" (UID: "bd638ec4-5039-4f53-99f6-5774f533aa7a") : secret "dns-default-metrics-tls" not found Jul 23 15:13:10.592714 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:10.592643 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68d466d8dd-94b5b: secret "image-registry-tls" not found Jul 23 15:13:10.592714 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:10.592695 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-registry-tls podName:ad0292fd-a3da-4563-b653-7e074c787676 nodeName:}" failed. No retries permitted until 2026-07-23 15:13:11.592677953 +0000 UTC m=+36.574978778 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-registry-tls") pod "image-registry-68d466d8dd-94b5b" (UID: "ad0292fd-a3da-4563-b653-7e074c787676") : secret "image-registry-tls" not found Jul 23 15:13:10.976304 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.976269 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:13:10.976304 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.976295 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bsgd9" Jul 23 15:13:10.976539 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.976269 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xsdtd" Jul 23 15:13:10.979254 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.979211 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7hjlh\"" Jul 23 15:13:10.979367 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.979211 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 15:13:10.979367 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.979283 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 15:13:10.983067 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.980379 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-srpb5\"" Jul 23 15:13:10.983067 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.980608 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 15:13:10.983067 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:10.980834 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 15:13:11.158332 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:11.158293 2582 generic.go:356] "Generic (PLEG): container finished" podID="d7627ebf-1afb-4d04-8218-f1242fb9a742" containerID="cf3962257f3ef694044c8e44e02d70cb5b6781fc5f373da1dcaeab5e7daad8e0" exitCode=0 Jul 23 15:13:11.158807 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:11.158374 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nfdrv" event={"ID":"d7627ebf-1afb-4d04-8218-f1242fb9a742","Type":"ContainerDied","Data":"cf3962257f3ef694044c8e44e02d70cb5b6781fc5f373da1dcaeab5e7daad8e0"} Jul 23 15:13:11.160186 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:11.159700 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j4mcc" event={"ID":"4bbea83b-d4d2-4103-9f4d-b67e865dfea1","Type":"ContainerStarted","Data":"3310a39415925c208eda5416c5ff6822a45ab719cab5aacb9b2b88a83b3e833b"} Jul 23 15:13:11.600470 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:11.600294 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd638ec4-5039-4f53-99f6-5774f533aa7a-metrics-tls\") pod \"dns-default-hth64\" (UID: \"bd638ec4-5039-4f53-99f6-5774f533aa7a\") " pod="openshift-dns/dns-default-hth64" Jul 23 15:13:11.600673 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:11.600482 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-registry-tls\") pod \"image-registry-68d466d8dd-94b5b\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:13:11.600673 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:11.600443 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 15:13:11.600673 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:11.600588 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 15:13:11.600673 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:11.600602 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68d466d8dd-94b5b: secret "image-registry-tls" not found Jul 23 15:13:11.600673 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:11.600617 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd638ec4-5039-4f53-99f6-5774f533aa7a-metrics-tls podName:bd638ec4-5039-4f53-99f6-5774f533aa7a nodeName:}" failed. No retries permitted until 2026-07-23 15:13:13.600598471 +0000 UTC m=+38.582899280 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd638ec4-5039-4f53-99f6-5774f533aa7a-metrics-tls") pod "dns-default-hth64" (UID: "bd638ec4-5039-4f53-99f6-5774f533aa7a") : secret "dns-default-metrics-tls" not found Jul 23 15:13:11.600673 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:11.600643 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-registry-tls podName:ad0292fd-a3da-4563-b653-7e074c787676 nodeName:}" failed. No retries permitted until 2026-07-23 15:13:13.600632369 +0000 UTC m=+38.582933176 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-registry-tls") pod "image-registry-68d466d8dd-94b5b" (UID: "ad0292fd-a3da-4563-b653-7e074c787676") : secret "image-registry-tls" not found Jul 23 15:13:12.166287 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:12.166256 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-nfdrv" event={"ID":"d7627ebf-1afb-4d04-8218-f1242fb9a742","Type":"ContainerStarted","Data":"b7086dcf5da77dfa775d92d9745aa64670b852934f85e244f3675ebafb810881"} Jul 23 15:13:12.193012 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:12.192953 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-nfdrv" podStartSLOduration=6.760570204 podStartE2EDuration="36.192928892s" totalImagesPullingTime="29.432358688s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:12:36 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:13:12.192010578 +0000 UTC m=+37.174311409" watchObservedRunningTime="2026-07-23 15:13:12.192928892 +0000 UTC m=+37.175229712" Jul 23 15:13:12.327143 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:12.327101 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:12.398654 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:12.398623 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:12.466901 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:12.466803 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:13.169742 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:13.169709 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-j4mcc" event={"ID":"4bbea83b-d4d2-4103-9f4d-b67e865dfea1","Type":"ContainerStarted","Data":"414526d96f8e31433489d5800aa0ddfeac194515bb2a4866d302944aa848f600"} Jul 23 15:13:13.188138 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:13.188072 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-j4mcc" podStartSLOduration=1.633041905 podStartE2EDuration="4.188054884s" totalImagesPullingTime="2.555012979s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:13:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:13:13.186572586 +0000 UTC m=+38.168873416" watchObservedRunningTime="2026-07-23 15:13:13.188054884 +0000 UTC m=+38.170355713" Jul 23 15:13:13.616136 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:13.616096 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd638ec4-5039-4f53-99f6-5774f533aa7a-metrics-tls\") pod \"dns-default-hth64\" (UID: \"bd638ec4-5039-4f53-99f6-5774f533aa7a\") " pod="openshift-dns/dns-default-hth64" Jul 23 15:13:13.616136 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:13.616138 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-registry-tls\") pod \"image-registry-68d466d8dd-94b5b\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:13:13.616342 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:13.616251 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 15:13:13.616342 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:13.616263 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68d466d8dd-94b5b: secret "image-registry-tls" not found Jul 23 15:13:13.616342 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:13.616307 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-registry-tls podName:ad0292fd-a3da-4563-b653-7e074c787676 nodeName:}" failed. No retries permitted until 2026-07-23 15:13:17.616294748 +0000 UTC m=+42.598595556 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-registry-tls") pod "image-registry-68d466d8dd-94b5b" (UID: "ad0292fd-a3da-4563-b653-7e074c787676") : secret "image-registry-tls" not found Jul 23 15:13:13.616342 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:13.616251 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 15:13:13.616467 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:13.616380 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd638ec4-5039-4f53-99f6-5774f533aa7a-metrics-tls podName:bd638ec4-5039-4f53-99f6-5774f533aa7a nodeName:}" failed. No retries permitted until 2026-07-23 15:13:17.616367715 +0000 UTC m=+42.598668524 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd638ec4-5039-4f53-99f6-5774f533aa7a-metrics-tls") pod "dns-default-hth64" (UID: "bd638ec4-5039-4f53-99f6-5774f533aa7a") : secret "dns-default-metrics-tls" not found Jul 23 15:13:15.247926 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:15.247895 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:15.346764 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:15.346733 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:15.409840 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:15.409809 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:16.824726 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:16.824698 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:16.944209 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:16.944169 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:17.421278 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:17.421244 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:17.646593 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:17.646555 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd638ec4-5039-4f53-99f6-5774f533aa7a-metrics-tls\") pod \"dns-default-hth64\" (UID: \"bd638ec4-5039-4f53-99f6-5774f533aa7a\") " pod="openshift-dns/dns-default-hth64" Jul 23 15:13:17.646593 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:17.646593 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-registry-tls\") pod \"image-registry-68d466d8dd-94b5b\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:13:17.646849 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:17.646708 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 15:13:17.646849 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:17.646720 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68d466d8dd-94b5b: secret "image-registry-tls" not found Jul 23 15:13:17.646849 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:17.646720 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 15:13:17.646849 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:17.646773 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-registry-tls podName:ad0292fd-a3da-4563-b653-7e074c787676 nodeName:}" failed. No retries permitted until 2026-07-23 15:13:25.646756191 +0000 UTC m=+50.629057014 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-registry-tls") pod "image-registry-68d466d8dd-94b5b" (UID: "ad0292fd-a3da-4563-b653-7e074c787676") : secret "image-registry-tls" not found Jul 23 15:13:17.646849 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:17.646786 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd638ec4-5039-4f53-99f6-5774f533aa7a-metrics-tls podName:bd638ec4-5039-4f53-99f6-5774f533aa7a nodeName:}" failed. No retries permitted until 2026-07-23 15:13:25.646780771 +0000 UTC m=+50.629081579 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd638ec4-5039-4f53-99f6-5774f533aa7a-metrics-tls") pod "dns-default-hth64" (UID: "bd638ec4-5039-4f53-99f6-5774f533aa7a") : secret "dns-default-metrics-tls" not found Jul 23 15:13:18.908978 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:18.908943 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:18.978126 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:18.978093 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:19.039697 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:19.039663 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:19.414767 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:19.414722 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jqrpq"] Jul 23 15:13:19.449407 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:19.449372 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:19.452061 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:19.452036 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jqrpq"] Jul 23 15:13:19.452177 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:19.452147 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jqrpq" Jul 23 15:13:19.454908 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:19.454884 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 23 15:13:19.455086 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:19.455069 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m6wjn\"" Jul 23 15:13:19.455898 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:19.455882 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 23 15:13:19.455969 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:19.455903 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 23 15:13:19.456028 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:19.456018 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 23 15:13:19.563442 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:19.563404 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0d05d01d-68f8-48eb-8789-285d901fe7ab-crio-socket\") pod \"insights-runtime-extractor-jqrpq\" (UID: \"0d05d01d-68f8-48eb-8789-285d901fe7ab\") " pod="openshift-insights/insights-runtime-extractor-jqrpq" Jul 23 15:13:19.563608 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:19.563452 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d05d01d-68f8-48eb-8789-285d901fe7ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jqrpq\" (UID: \"0d05d01d-68f8-48eb-8789-285d901fe7ab\") " pod="openshift-insights/insights-runtime-extractor-jqrpq" Jul 23 15:13:19.563608 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:19.563481 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d05d01d-68f8-48eb-8789-285d901fe7ab-data-volume\") pod \"insights-runtime-extractor-jqrpq\" (UID: \"0d05d01d-68f8-48eb-8789-285d901fe7ab\") " pod="openshift-insights/insights-runtime-extractor-jqrpq" Jul 23 15:13:19.563608 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:19.563521 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d05d01d-68f8-48eb-8789-285d901fe7ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jqrpq\" (UID: \"0d05d01d-68f8-48eb-8789-285d901fe7ab\") " pod="openshift-insights/insights-runtime-extractor-jqrpq" Jul 23 15:13:19.563608 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:19.563599 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pscjw\" (UniqueName: \"kubernetes.io/projected/0d05d01d-68f8-48eb-8789-285d901fe7ab-kube-api-access-pscjw\") pod \"insights-runtime-extractor-jqrpq\" (UID: \"0d05d01d-68f8-48eb-8789-285d901fe7ab\") " pod="openshift-insights/insights-runtime-extractor-jqrpq" Jul 23 15:13:19.569336 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:19.569309 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:19.664621 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:19.664584 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pscjw\" (UniqueName: \"kubernetes.io/projected/0d05d01d-68f8-48eb-8789-285d901fe7ab-kube-api-access-pscjw\") pod \"insights-runtime-extractor-jqrpq\" (UID: \"0d05d01d-68f8-48eb-8789-285d901fe7ab\") " pod="openshift-insights/insights-runtime-extractor-jqrpq" Jul 23 15:13:19.664818 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:19.664670 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0d05d01d-68f8-48eb-8789-285d901fe7ab-crio-socket\") pod \"insights-runtime-extractor-jqrpq\" (UID: \"0d05d01d-68f8-48eb-8789-285d901fe7ab\") " pod="openshift-insights/insights-runtime-extractor-jqrpq" Jul 23 15:13:19.664818 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:19.664696 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d05d01d-68f8-48eb-8789-285d901fe7ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jqrpq\" (UID: \"0d05d01d-68f8-48eb-8789-285d901fe7ab\") " pod="openshift-insights/insights-runtime-extractor-jqrpq" Jul 23 15:13:19.664818 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:19.664715 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d05d01d-68f8-48eb-8789-285d901fe7ab-data-volume\") pod \"insights-runtime-extractor-jqrpq\" (UID: \"0d05d01d-68f8-48eb-8789-285d901fe7ab\") " pod="openshift-insights/insights-runtime-extractor-jqrpq" Jul 23 15:13:19.664818 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:19.664732 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d05d01d-68f8-48eb-8789-285d901fe7ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jqrpq\" (UID: \"0d05d01d-68f8-48eb-8789-285d901fe7ab\") " pod="openshift-insights/insights-runtime-extractor-jqrpq" Jul 23 15:13:19.665077 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:19.664843 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 15:13:19.665077 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:19.664905 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 15:13:19.665077 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:19.664945 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d05d01d-68f8-48eb-8789-285d901fe7ab-insights-runtime-extractor-tls podName:0d05d01d-68f8-48eb-8789-285d901fe7ab nodeName:}" failed. No retries permitted until 2026-07-23 15:13:20.164928994 +0000 UTC m=+45.147229803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0d05d01d-68f8-48eb-8789-285d901fe7ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jqrpq" (UID: "0d05d01d-68f8-48eb-8789-285d901fe7ab") : secret "insights-runtime-extractor-tls" not found Jul 23 15:13:19.665077 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:19.664980 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d05d01d-68f8-48eb-8789-285d901fe7ab-kube-rbac-proxy-cm podName:0d05d01d-68f8-48eb-8789-285d901fe7ab nodeName:}" failed. No retries permitted until 2026-07-23 15:13:20.164962468 +0000 UTC m=+45.147263296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0d05d01d-68f8-48eb-8789-285d901fe7ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jqrpq" (UID: "0d05d01d-68f8-48eb-8789-285d901fe7ab") : configmap "kube-rbac-proxy" not found Jul 23 15:13:19.665077 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:19.664843 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0d05d01d-68f8-48eb-8789-285d901fe7ab-crio-socket\") pod \"insights-runtime-extractor-jqrpq\" (UID: \"0d05d01d-68f8-48eb-8789-285d901fe7ab\") " pod="openshift-insights/insights-runtime-extractor-jqrpq" Jul 23 15:13:19.665077 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:19.665074 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d05d01d-68f8-48eb-8789-285d901fe7ab-data-volume\") pod \"insights-runtime-extractor-jqrpq\" (UID: \"0d05d01d-68f8-48eb-8789-285d901fe7ab\") " pod="openshift-insights/insights-runtime-extractor-jqrpq" Jul 23 15:13:19.670531 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:19.670504 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:19.675053 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:19.675027 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pscjw\" (UniqueName: \"kubernetes.io/projected/0d05d01d-68f8-48eb-8789-285d901fe7ab-kube-api-access-pscjw\") pod \"insights-runtime-extractor-jqrpq\" (UID: \"0d05d01d-68f8-48eb-8789-285d901fe7ab\") " pod="openshift-insights/insights-runtime-extractor-jqrpq" Jul 23 15:13:19.973090 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:19.973004 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:20.041845 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:20.041812 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:20.167516 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:20.167476 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d05d01d-68f8-48eb-8789-285d901fe7ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jqrpq\" (UID: \"0d05d01d-68f8-48eb-8789-285d901fe7ab\") " pod="openshift-insights/insights-runtime-extractor-jqrpq" Jul 23 15:13:20.167717 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:20.167525 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d05d01d-68f8-48eb-8789-285d901fe7ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jqrpq\" (UID: \"0d05d01d-68f8-48eb-8789-285d901fe7ab\") " pod="openshift-insights/insights-runtime-extractor-jqrpq" Jul 23 15:13:20.167717 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:20.167612 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 15:13:20.167717 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:20.167649 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 15:13:20.167717 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:20.167694 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d05d01d-68f8-48eb-8789-285d901fe7ab-kube-rbac-proxy-cm podName:0d05d01d-68f8-48eb-8789-285d901fe7ab nodeName:}" failed. No retries permitted until 2026-07-23 15:13:21.167674672 +0000 UTC m=+46.149975479 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0d05d01d-68f8-48eb-8789-285d901fe7ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jqrpq" (UID: "0d05d01d-68f8-48eb-8789-285d901fe7ab") : configmap "kube-rbac-proxy" not found Jul 23 15:13:20.167920 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:20.167769 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d05d01d-68f8-48eb-8789-285d901fe7ab-insights-runtime-extractor-tls podName:0d05d01d-68f8-48eb-8789-285d901fe7ab nodeName:}" failed. No retries permitted until 2026-07-23 15:13:21.167758043 +0000 UTC m=+46.150058852 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0d05d01d-68f8-48eb-8789-285d901fe7ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jqrpq" (UID: "0d05d01d-68f8-48eb-8789-285d901fe7ab") : secret "insights-runtime-extractor-tls" not found Jul 23 15:13:20.189049 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:20.189023 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:20.266532 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:20.266452 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:20.571949 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:20.571917 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:20.667833 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:20.667801 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:20.770769 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:20.770734 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:21.171324 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:21.171299 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5wkgs_3555cdac-b6d6-446c-8dbc-73850e135995/dns-node-resolver/0.log" Jul 23 15:13:21.177571 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:21.177550 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d05d01d-68f8-48eb-8789-285d901fe7ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jqrpq\" (UID: \"0d05d01d-68f8-48eb-8789-285d901fe7ab\") " pod="openshift-insights/insights-runtime-extractor-jqrpq" Jul 23 15:13:21.177669 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:21.177583 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d05d01d-68f8-48eb-8789-285d901fe7ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jqrpq\" (UID: \"0d05d01d-68f8-48eb-8789-285d901fe7ab\") " pod="openshift-insights/insights-runtime-extractor-jqrpq" Jul 23 15:13:21.177724 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:21.177697 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 15:13:21.177773 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:21.177720 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 15:13:21.177773 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:21.177743 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d05d01d-68f8-48eb-8789-285d901fe7ab-kube-rbac-proxy-cm podName:0d05d01d-68f8-48eb-8789-285d901fe7ab nodeName:}" failed. No retries permitted until 2026-07-23 15:13:23.177730963 +0000 UTC m=+48.160031771 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0d05d01d-68f8-48eb-8789-285d901fe7ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jqrpq" (UID: "0d05d01d-68f8-48eb-8789-285d901fe7ab") : configmap "kube-rbac-proxy" not found Jul 23 15:13:21.177879 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:21.177782 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d05d01d-68f8-48eb-8789-285d901fe7ab-insights-runtime-extractor-tls podName:0d05d01d-68f8-48eb-8789-285d901fe7ab nodeName:}" failed. No retries permitted until 2026-07-23 15:13:23.177762383 +0000 UTC m=+48.160063205 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0d05d01d-68f8-48eb-8789-285d901fe7ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jqrpq" (UID: "0d05d01d-68f8-48eb-8789-285d901fe7ab") : secret "insights-runtime-extractor-tls" not found Jul 23 15:13:22.170087 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:22.170056 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8qhdh_45cd984a-be03-413a-9229-c3b195e80e25/node-ca/0.log" Jul 23 15:13:22.271183 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:22.271107 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-kbq56"] Jul 23 15:13:22.306159 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:22.306124 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-kbq56"] Jul 23 15:13:22.306308 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:22.306240 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-kbq56" Jul 23 15:13:22.309075 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:22.309053 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 23 15:13:22.309203 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:22.309096 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 23 15:13:22.310110 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:22.310093 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 23 15:13:22.310200 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:22.310126 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 23 15:13:22.310200 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:22.310093 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-g258g\"" Jul 23 15:13:22.332663 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:22.332639 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:22.388000 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:22.387960 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4a711db5-f36e-4529-9032-5f0249b222a0-signing-key\") pod \"service-ca-58598695f7-kbq56\" (UID: \"4a711db5-f36e-4529-9032-5f0249b222a0\") " pod="openshift-service-ca/service-ca-58598695f7-kbq56" Jul 23 15:13:22.388000 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:22.388002 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8wxp\" (UniqueName: \"kubernetes.io/projected/4a711db5-f36e-4529-9032-5f0249b222a0-kube-api-access-t8wxp\") pod \"service-ca-58598695f7-kbq56\" (UID: \"4a711db5-f36e-4529-9032-5f0249b222a0\") " pod="openshift-service-ca/service-ca-58598695f7-kbq56" Jul 23 15:13:22.388215 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:22.388065 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4a711db5-f36e-4529-9032-5f0249b222a0-signing-cabundle\") pod \"service-ca-58598695f7-kbq56\" (UID: \"4a711db5-f36e-4529-9032-5f0249b222a0\") " pod="openshift-service-ca/service-ca-58598695f7-kbq56" Jul 23 15:13:22.489087 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:22.488940 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4a711db5-f36e-4529-9032-5f0249b222a0-signing-cabundle\") pod \"service-ca-58598695f7-kbq56\" (UID: \"4a711db5-f36e-4529-9032-5f0249b222a0\") " pod="openshift-service-ca/service-ca-58598695f7-kbq56" Jul 23 15:13:22.489212 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:22.489183 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4a711db5-f36e-4529-9032-5f0249b222a0-signing-key\") pod \"service-ca-58598695f7-kbq56\" (UID: \"4a711db5-f36e-4529-9032-5f0249b222a0\") " pod="openshift-service-ca/service-ca-58598695f7-kbq56" Jul 23 15:13:22.489256 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:22.489220 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8wxp\" (UniqueName: \"kubernetes.io/projected/4a711db5-f36e-4529-9032-5f0249b222a0-kube-api-access-t8wxp\") pod \"service-ca-58598695f7-kbq56\" (UID: \"4a711db5-f36e-4529-9032-5f0249b222a0\") " pod="openshift-service-ca/service-ca-58598695f7-kbq56" Jul 23 15:13:22.489721 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:22.489702 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4a711db5-f36e-4529-9032-5f0249b222a0-signing-cabundle\") pod \"service-ca-58598695f7-kbq56\" (UID: \"4a711db5-f36e-4529-9032-5f0249b222a0\") " pod="openshift-service-ca/service-ca-58598695f7-kbq56" Jul 23 15:13:22.491446 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:22.491426 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4a711db5-f36e-4529-9032-5f0249b222a0-signing-key\") pod \"service-ca-58598695f7-kbq56\" (UID: \"4a711db5-f36e-4529-9032-5f0249b222a0\") " pod="openshift-service-ca/service-ca-58598695f7-kbq56" Jul 23 15:13:22.497443 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:22.497417 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8wxp\" (UniqueName: \"kubernetes.io/projected/4a711db5-f36e-4529-9032-5f0249b222a0-kube-api-access-t8wxp\") pod \"service-ca-58598695f7-kbq56\" (UID: \"4a711db5-f36e-4529-9032-5f0249b222a0\") " pod="openshift-service-ca/service-ca-58598695f7-kbq56" Jul 23 15:13:22.615552 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:22.615508 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-kbq56" Jul 23 15:13:22.760578 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:22.760483 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-kbq56"] Jul 23 15:13:22.763498 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:13:22.763472 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a711db5_f36e_4529_9032_5f0249b222a0.slice/crio-7969d5829237c9a3d9dfb565f9c6e6a710874c1053a64c803e77d815356c43e8 WatchSource:0}: Error finding container 7969d5829237c9a3d9dfb565f9c6e6a710874c1053a64c803e77d815356c43e8: Status 404 returned error can't find the container with id 7969d5829237c9a3d9dfb565f9c6e6a710874c1053a64c803e77d815356c43e8 Jul 23 15:13:23.192409 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:23.192374 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-kbq56" event={"ID":"4a711db5-f36e-4529-9032-5f0249b222a0","Type":"ContainerStarted","Data":"7969d5829237c9a3d9dfb565f9c6e6a710874c1053a64c803e77d815356c43e8"} Jul 23 15:13:23.194634 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:23.194615 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d05d01d-68f8-48eb-8789-285d901fe7ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jqrpq\" (UID: \"0d05d01d-68f8-48eb-8789-285d901fe7ab\") " pod="openshift-insights/insights-runtime-extractor-jqrpq" Jul 23 15:13:23.194705 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:23.194650 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d05d01d-68f8-48eb-8789-285d901fe7ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jqrpq\" (UID: \"0d05d01d-68f8-48eb-8789-285d901fe7ab\") " pod="openshift-insights/insights-runtime-extractor-jqrpq" Jul 23 15:13:23.194784 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:23.194770 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 15:13:23.194835 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:23.194826 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d05d01d-68f8-48eb-8789-285d901fe7ab-insights-runtime-extractor-tls podName:0d05d01d-68f8-48eb-8789-285d901fe7ab nodeName:}" failed. No retries permitted until 2026-07-23 15:13:27.194813029 +0000 UTC m=+52.177113840 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0d05d01d-68f8-48eb-8789-285d901fe7ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jqrpq" (UID: "0d05d01d-68f8-48eb-8789-285d901fe7ab") : secret "insights-runtime-extractor-tls" not found Jul 23 15:13:23.194907 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:23.194770 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 15:13:23.194946 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:23.194919 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d05d01d-68f8-48eb-8789-285d901fe7ab-kube-rbac-proxy-cm podName:0d05d01d-68f8-48eb-8789-285d901fe7ab nodeName:}" failed. No retries permitted until 2026-07-23 15:13:27.194906791 +0000 UTC m=+52.177207601 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0d05d01d-68f8-48eb-8789-285d901fe7ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jqrpq" (UID: "0d05d01d-68f8-48eb-8789-285d901fe7ab") : configmap "kube-rbac-proxy" not found Jul 23 15:13:23.371038 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:23.370977 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j4mcc_4bbea83b-d4d2-4103-9f4d-b67e865dfea1/serve-healthcheck-canary/0.log" Jul 23 15:13:23.611481 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:23.611443 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:25.198836 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:25.198804 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-kbq56" event={"ID":"4a711db5-f36e-4529-9032-5f0249b222a0","Type":"ContainerStarted","Data":"fd2b41bd9e5b95d0c3b3ac10869385f4a86ac59ac0b06c1106c08eaca4ee5642"} Jul 23 15:13:25.216882 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:25.216802 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-kbq56" podStartSLOduration=0.891988006 podStartE2EDuration="3.21678333s" totalImagesPullingTime="2.324795324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:13:25.215958106 +0000 UTC m=+50.198258964" watchObservedRunningTime="2026-07-23 15:13:25.21678333 +0000 UTC m=+50.199084171" Jul 23 15:13:25.716909 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:25.716842 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd638ec4-5039-4f53-99f6-5774f533aa7a-metrics-tls\") pod \"dns-default-hth64\" (UID: \"bd638ec4-5039-4f53-99f6-5774f533aa7a\") " pod="openshift-dns/dns-default-hth64" Jul 23 15:13:25.716909 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:25.716906 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-registry-tls\") pod \"image-registry-68d466d8dd-94b5b\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:13:25.717205 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:25.717020 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 15:13:25.717205 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:25.717066 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 15:13:25.717205 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:25.717083 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68d466d8dd-94b5b: secret "image-registry-tls" not found Jul 23 15:13:25.717205 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:25.717098 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd638ec4-5039-4f53-99f6-5774f533aa7a-metrics-tls podName:bd638ec4-5039-4f53-99f6-5774f533aa7a nodeName:}" failed. No retries permitted until 2026-07-23 15:13:41.717078081 +0000 UTC m=+66.699378890 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd638ec4-5039-4f53-99f6-5774f533aa7a-metrics-tls") pod "dns-default-hth64" (UID: "bd638ec4-5039-4f53-99f6-5774f533aa7a") : secret "dns-default-metrics-tls" not found Jul 23 15:13:25.717205 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:25.717126 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-registry-tls podName:ad0292fd-a3da-4563-b653-7e074c787676 nodeName:}" failed. No retries permitted until 2026-07-23 15:13:41.717114814 +0000 UTC m=+66.699415626 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-registry-tls") pod "image-registry-68d466d8dd-94b5b" (UID: "ad0292fd-a3da-4563-b653-7e074c787676") : secret "image-registry-tls" not found Jul 23 15:13:26.668465 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:26.668429 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:26.946832 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:26.946744 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:27.046893 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:27.046842 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:27.147172 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:27.147138 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:27.231152 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:27.231062 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d05d01d-68f8-48eb-8789-285d901fe7ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jqrpq\" (UID: \"0d05d01d-68f8-48eb-8789-285d901fe7ab\") " pod="openshift-insights/insights-runtime-extractor-jqrpq" Jul 23 15:13:27.231152 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:27.231099 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d05d01d-68f8-48eb-8789-285d901fe7ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jqrpq\" (UID: \"0d05d01d-68f8-48eb-8789-285d901fe7ab\") " pod="openshift-insights/insights-runtime-extractor-jqrpq" Jul 23 15:13:27.231380 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:27.231179 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 15:13:27.231380 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:27.231248 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 15:13:27.231380 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:27.231309 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0d05d01d-68f8-48eb-8789-285d901fe7ab-kube-rbac-proxy-cm podName:0d05d01d-68f8-48eb-8789-285d901fe7ab nodeName:}" failed. No retries permitted until 2026-07-23 15:13:35.231272145 +0000 UTC m=+60.213572969 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0d05d01d-68f8-48eb-8789-285d901fe7ab-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jqrpq" (UID: "0d05d01d-68f8-48eb-8789-285d901fe7ab") : configmap "kube-rbac-proxy" not found Jul 23 15:13:27.231380 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:27.231341 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d05d01d-68f8-48eb-8789-285d901fe7ab-insights-runtime-extractor-tls podName:0d05d01d-68f8-48eb-8789-285d901fe7ab nodeName:}" failed. No retries permitted until 2026-07-23 15:13:35.231331321 +0000 UTC m=+60.213632137 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0d05d01d-68f8-48eb-8789-285d901fe7ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jqrpq" (UID: "0d05d01d-68f8-48eb-8789-285d901fe7ab") : secret "insights-runtime-extractor-tls" not found Jul 23 15:13:27.250834 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:27.250787 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:27.447945 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:27.447907 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:28.155728 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:28.155693 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:28.784492 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:28.784458 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:28.969352 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:28.969314 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:29.362373 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:29.362337 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:29.560681 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:29.560651 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:29.665594 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:29.665517 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:29.975620 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:29.975532 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:30.582234 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:30.582197 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:30.718593 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:30.718561 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:30.839143 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:30.839061 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:30.974917 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:30.974884 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:31.180530 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:31.180444 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:31.279630 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:31.279595 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:31.618500 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:31.618474 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:32.373560 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:32.373511 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:32.476764 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:32.476735 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:32.576460 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:32.576429 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:32.758229 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:32.758141 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:33.027206 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:33.027117 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:33.183405 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:33.183375 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:33.344307 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:33.344273 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:33.610116 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:33.610032 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:33.732094 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:33.732057 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:34.397163 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:34.397126 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:34.772045 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:34.771955 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:34.971042 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:34.971006 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:35.188053 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:35.188021 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:35.300022 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:35.299987 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d05d01d-68f8-48eb-8789-285d901fe7ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jqrpq\" (UID: \"0d05d01d-68f8-48eb-8789-285d901fe7ab\") " pod="openshift-insights/insights-runtime-extractor-jqrpq" Jul 23 15:13:35.300022 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:35.300026 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d05d01d-68f8-48eb-8789-285d901fe7ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jqrpq\" (UID: \"0d05d01d-68f8-48eb-8789-285d901fe7ab\") " pod="openshift-insights/insights-runtime-extractor-jqrpq" Jul 23 15:13:35.300239 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:35.300147 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 15:13:35.300239 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:13:35.300230 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d05d01d-68f8-48eb-8789-285d901fe7ab-insights-runtime-extractor-tls podName:0d05d01d-68f8-48eb-8789-285d901fe7ab nodeName:}" failed. No retries permitted until 2026-07-23 15:13:51.300211875 +0000 UTC m=+76.282512684 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0d05d01d-68f8-48eb-8789-285d901fe7ab-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jqrpq" (UID: "0d05d01d-68f8-48eb-8789-285d901fe7ab") : secret "insights-runtime-extractor-tls" not found Jul 23 15:13:35.300505 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:35.300489 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0d05d01d-68f8-48eb-8789-285d901fe7ab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jqrpq\" (UID: \"0d05d01d-68f8-48eb-8789-285d901fe7ab\") " pod="openshift-insights/insights-runtime-extractor-jqrpq" Jul 23 15:13:35.376921 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:35.376882 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:36.149431 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:36.149403 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pgrx7" Jul 23 15:13:36.367341 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:36.367293 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:36.671096 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:36.671063 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:36.772064 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:36.772036 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:36.849605 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:36.849574 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:36.971819 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:36.971731 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:37.182837 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:37.182806 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:37.360328 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:37.360290 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:39.443552 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:39.443516 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:39.543200 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:39.543166 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:39.644187 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:39.644151 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:39.822898 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:39.822849 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:39.938332 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:39.938298 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:40.041971 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:40.041936 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:40.137903 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:40.137800 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:40.247370 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:40.247323 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:40.614471 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:40.614439 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:40.715869 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:40.715834 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:41.351896 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:41.351839 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb607685-50d2-4fd7-b238-865b7726e7fa-original-pull-secret\") pod \"global-pull-secret-syncer-b7wx7\" (UID: \"fb607685-50d2-4fd7-b238-865b7726e7fa\") " pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:13:41.352115 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:41.351916 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q22ph\" (UniqueName: \"kubernetes.io/projected/ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb-kube-api-access-q22ph\") pod \"network-check-target-bsgd9\" (UID: \"ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb\") " pod="openshift-network-diagnostics/network-check-target-bsgd9" Jul 23 15:13:41.352115 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:41.351944 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffacaf02-b6c9-4245-bee8-eb863a7b117c-metrics-certs\") pod \"network-metrics-daemon-xsdtd\" (UID: \"ffacaf02-b6c9-4245-bee8-eb863a7b117c\") " pod="openshift-multus/network-metrics-daemon-xsdtd" Jul 23 15:13:41.354675 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:41.354654 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 15:13:41.355532 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:41.355515 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 15:13:41.355588 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:41.355514 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 15:13:41.365175 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:41.365147 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 15:13:41.365336 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:41.365182 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/fb607685-50d2-4fd7-b238-865b7726e7fa-original-pull-secret\") pod \"global-pull-secret-syncer-b7wx7\" (UID: \"fb607685-50d2-4fd7-b238-865b7726e7fa\") " pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:13:41.365336 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:41.365184 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffacaf02-b6c9-4245-bee8-eb863a7b117c-metrics-certs\") pod \"network-metrics-daemon-xsdtd\" (UID: \"ffacaf02-b6c9-4245-bee8-eb863a7b117c\") " pod="openshift-multus/network-metrics-daemon-xsdtd" Jul 23 15:13:41.375535 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:41.375512 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q22ph\" (UniqueName: \"kubernetes.io/projected/ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb-kube-api-access-q22ph\") pod \"network-check-target-bsgd9\" (UID: \"ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb\") " pod="openshift-network-diagnostics/network-check-target-bsgd9" Jul 23 15:13:41.589285 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:41.589240 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b7wx7" Jul 23 15:13:41.598716 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:41.598694 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7hjlh\"" Jul 23 15:13:41.604894 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:41.604804 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-srpb5\"" Jul 23 15:13:41.606881 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:41.606851 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-xsdtd" Jul 23 15:13:41.613045 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:41.613010 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bsgd9" Jul 23 15:13:41.630098 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:41.629997 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:41.735624 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:41.735592 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b7wx7"] Jul 23 15:13:41.739691 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:13:41.739661 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb607685_50d2_4fd7_b238_865b7726e7fa.slice/crio-d28df2b9974c0b75933b1fc50a7fb580780e29a540abdf2a098ff3270021f50e WatchSource:0}: Error finding container d28df2b9974c0b75933b1fc50a7fb580780e29a540abdf2a098ff3270021f50e: Status 404 returned error can't find the container with id d28df2b9974c0b75933b1fc50a7fb580780e29a540abdf2a098ff3270021f50e Jul 23 15:13:41.754235 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:41.754203 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-xsdtd"] Jul 23 15:13:41.755310 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:41.755284 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd638ec4-5039-4f53-99f6-5774f533aa7a-metrics-tls\") pod \"dns-default-hth64\" (UID: \"bd638ec4-5039-4f53-99f6-5774f533aa7a\") " pod="openshift-dns/dns-default-hth64" Jul 23 15:13:41.755446 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:41.755316 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-registry-tls\") pod \"image-registry-68d466d8dd-94b5b\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:13:41.757692 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:41.757659 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd638ec4-5039-4f53-99f6-5774f533aa7a-metrics-tls\") pod \"dns-default-hth64\" (UID: \"bd638ec4-5039-4f53-99f6-5774f533aa7a\") " pod="openshift-dns/dns-default-hth64" Jul 23 15:13:41.757935 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:41.757918 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-registry-tls\") pod \"image-registry-68d466d8dd-94b5b\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:13:41.758843 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:13:41.758816 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffacaf02_b6c9_4245_bee8_eb863a7b117c.slice/crio-afb1e824456514dce569dcf53ecfc2535dff8978abf6c1b50fb34fad18fd6a3e WatchSource:0}: Error finding container afb1e824456514dce569dcf53ecfc2535dff8978abf6c1b50fb34fad18fd6a3e: Status 404 returned error can't find the container with id afb1e824456514dce569dcf53ecfc2535dff8978abf6c1b50fb34fad18fd6a3e Jul 23 15:13:41.762161 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:41.762139 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7fsth\"" Jul 23 15:13:41.770350 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:41.770325 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hth64" Jul 23 15:13:41.770568 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:41.770525 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bsgd9"] Jul 23 15:13:41.773695 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:13:41.773663 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab9f008f_f8f0_4a1e_99ff_2b1d55acbbdb.slice/crio-c726915e5cb045f6be1a939f57db031195cc447352c57e705dc3aa33eaf42fd6 WatchSource:0}: Error finding container c726915e5cb045f6be1a939f57db031195cc447352c57e705dc3aa33eaf42fd6: Status 404 returned error can't find the container with id c726915e5cb045f6be1a939f57db031195cc447352c57e705dc3aa33eaf42fd6 Jul 23 15:13:41.864655 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:41.864496 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:41.899220 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:41.899181 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hth64"] Jul 23 15:13:41.901772 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:13:41.901745 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd638ec4_5039_4f53_99f6_5774f533aa7a.slice/crio-bb96e76feff357cae84a89c3b9a28bf3398792ba4f88046f48820ab9eaf434c5 WatchSource:0}: Error finding container bb96e76feff357cae84a89c3b9a28bf3398792ba4f88046f48820ab9eaf434c5: Status 404 returned error can't find the container with id bb96e76feff357cae84a89c3b9a28bf3398792ba4f88046f48820ab9eaf434c5 Jul 23 15:13:42.033458 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:42.033425 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:42.049120 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:42.049085 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zt8sw\"" Jul 23 15:13:42.057284 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:42.057251 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:13:42.162240 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:42.162204 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:42.224693 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:42.224657 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68d466d8dd-94b5b"] Jul 23 15:13:42.231097 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:13:42.231052 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad0292fd_a3da_4563_b653_7e074c787676.slice/crio-c434ad3b81675b47a9249f9fa0603b848e94c7d8bdce405f74f648914bfbf384 WatchSource:0}: Error finding container c434ad3b81675b47a9249f9fa0603b848e94c7d8bdce405f74f648914bfbf384: Status 404 returned error can't find the container with id c434ad3b81675b47a9249f9fa0603b848e94c7d8bdce405f74f648914bfbf384 Jul 23 15:13:42.242943 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:42.242910 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b7wx7" event={"ID":"fb607685-50d2-4fd7-b238-865b7726e7fa","Type":"ContainerStarted","Data":"d28df2b9974c0b75933b1fc50a7fb580780e29a540abdf2a098ff3270021f50e"} Jul 23 15:13:42.244596 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:42.244560 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hth64" event={"ID":"bd638ec4-5039-4f53-99f6-5774f533aa7a","Type":"ContainerStarted","Data":"bb96e76feff357cae84a89c3b9a28bf3398792ba4f88046f48820ab9eaf434c5"} Jul 23 15:13:42.247470 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:42.247385 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bsgd9" event={"ID":"ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb","Type":"ContainerStarted","Data":"c726915e5cb045f6be1a939f57db031195cc447352c57e705dc3aa33eaf42fd6"} Jul 23 15:13:42.249104 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:42.249080 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xsdtd" event={"ID":"ffacaf02-b6c9-4245-bee8-eb863a7b117c","Type":"ContainerStarted","Data":"afb1e824456514dce569dcf53ecfc2535dff8978abf6c1b50fb34fad18fd6a3e"} Jul 23 15:13:42.253045 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:42.252980 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" event={"ID":"ad0292fd-a3da-4563-b653-7e074c787676","Type":"ContainerStarted","Data":"c434ad3b81675b47a9249f9fa0603b848e94c7d8bdce405f74f648914bfbf384"} Jul 23 15:13:43.260789 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:43.260690 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xsdtd" event={"ID":"ffacaf02-b6c9-4245-bee8-eb863a7b117c","Type":"ContainerStarted","Data":"9962bbbb971247b3ed8970943bc61423c0514e99f42a8fb97e75fc231b85c2d8"} Jul 23 15:13:43.260789 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:43.260759 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-xsdtd" event={"ID":"ffacaf02-b6c9-4245-bee8-eb863a7b117c","Type":"ContainerStarted","Data":"6f22d0558d18d98d624b9cb5c6a2b288eb69dc465202fc0ea4c7159d08376d08"} Jul 23 15:13:43.263024 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:43.262970 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" event={"ID":"ad0292fd-a3da-4563-b653-7e074c787676","Type":"ContainerStarted","Data":"3e4c7b6dc2c2408368cf789f3aa088928b4338c6ba293a8aa4f67850abf8ac92"} Jul 23 15:13:43.263313 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:43.263267 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:13:43.279747 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:43.279620 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-xsdtd" podStartSLOduration=66.128208 podStartE2EDuration="1m7.279596236s" totalImagesPullingTime="1.151388236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:12:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:13:43.278939994 +0000 UTC m=+68.261240825" watchObservedRunningTime="2026-07-23 15:13:43.279596236 +0000 UTC m=+68.261897067" Jul 23 15:13:43.301218 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:43.301153 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" podStartSLOduration=50.301132271 podStartE2EDuration="50.301132271s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:12:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:13:43.300249917 +0000 UTC m=+68.282550782" watchObservedRunningTime="2026-07-23 15:13:43.301132271 +0000 UTC m=+68.283433086" Jul 23 15:13:44.982888 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:44.982837 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:45.095400 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:45.095329 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:45.302599 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:45.302497 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:45.403582 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:45.403546 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:13:47.276944 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:47.276903 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b7wx7" event={"ID":"fb607685-50d2-4fd7-b238-865b7726e7fa","Type":"ContainerStarted","Data":"db913e61eb12896f1e45b1e4f8159ecf508f9d972414b035bc092dd2c0529af9"} Jul 23 15:13:47.278583 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:47.278559 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hth64" event={"ID":"bd638ec4-5039-4f53-99f6-5774f533aa7a","Type":"ContainerStarted","Data":"2d8a909ea44bface33b238d4951c4395c9bfb2cef230066cab1ebbff5bede840"} Jul 23 15:13:47.278699 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:47.278614 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hth64" Jul 23 15:13:47.278699 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:47.278632 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hth64" event={"ID":"bd638ec4-5039-4f53-99f6-5774f533aa7a","Type":"ContainerStarted","Data":"b1ce2c7913491bbf2bcb147b13934fe0b4e7f419ac3337e2aac3ad95c982bf22"} Jul 23 15:13:47.279920 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:47.279897 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bsgd9" event={"ID":"ab9f008f-f8f0-4a1e-99ff-2b1d55acbbdb","Type":"ContainerStarted","Data":"efe6bdb440b49b3c6b09db3a71cd8200aad93ea28f187ec1ace494f8eff18d58"} Jul 23 15:13:47.280026 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:47.280015 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bsgd9" Jul 23 15:13:47.296070 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:47.296024 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-b7wx7" podStartSLOduration=66.418634913 podStartE2EDuration="1m11.296011315s" totalImagesPullingTime="4.877376402s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:12:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:13:47.295065395 +0000 UTC m=+72.277366228" watchObservedRunningTime="2026-07-23 15:13:47.296011315 +0000 UTC m=+72.278312145" Jul 23 15:13:47.314603 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:47.314555 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hth64" podStartSLOduration=33.617738875 podStartE2EDuration="38.314540273s" totalImagesPullingTime="4.696801398s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:13:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:13:47.313761253 +0000 UTC m=+72.296062083" watchObservedRunningTime="2026-07-23 15:13:47.314540273 +0000 UTC m=+72.296841103" Jul 23 15:13:47.331182 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:47.331131 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bsgd9" podStartSLOduration=67.497398304 podStartE2EDuration="1m12.331120261s" totalImagesPullingTime="4.833721957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:12:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:13:47.33092139 +0000 UTC m=+72.313222225" watchObservedRunningTime="2026-07-23 15:13:47.331120261 +0000 UTC m=+72.313421091" Jul 23 15:13:51.327914 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:51.327840 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d05d01d-68f8-48eb-8789-285d901fe7ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jqrpq\" (UID: \"0d05d01d-68f8-48eb-8789-285d901fe7ab\") " pod="openshift-insights/insights-runtime-extractor-jqrpq" Jul 23 15:13:51.330273 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:51.330248 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0d05d01d-68f8-48eb-8789-285d901fe7ab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jqrpq\" (UID: \"0d05d01d-68f8-48eb-8789-285d901fe7ab\") " pod="openshift-insights/insights-runtime-extractor-jqrpq" Jul 23 15:13:51.564014 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:51.563984 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m6wjn\"" Jul 23 15:13:51.572092 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:51.572071 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jqrpq" Jul 23 15:13:51.736205 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:51.736179 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jqrpq"] Jul 23 15:13:51.738725 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:13:51.738691 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d05d01d_68f8_48eb_8789_285d901fe7ab.slice/crio-4cb3aa62fd03c711d0d6346a665e54344b79f0f2296bca6c0d49c4cd15c9fdfd WatchSource:0}: Error finding container 4cb3aa62fd03c711d0d6346a665e54344b79f0f2296bca6c0d49c4cd15c9fdfd: Status 404 returned error can't find the container with id 4cb3aa62fd03c711d0d6346a665e54344b79f0f2296bca6c0d49c4cd15c9fdfd Jul 23 15:13:52.297954 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:52.297921 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jqrpq" event={"ID":"0d05d01d-68f8-48eb-8789-285d901fe7ab","Type":"ContainerStarted","Data":"4cb3aa62fd03c711d0d6346a665e54344b79f0f2296bca6c0d49c4cd15c9fdfd"} Jul 23 15:13:57.284766 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:57.284737 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hth64" Jul 23 15:13:57.316152 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:13:57.316114 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jqrpq" event={"ID":"0d05d01d-68f8-48eb-8789-285d901fe7ab","Type":"ContainerStarted","Data":"e171232f73b1d661c77f434d962f3f23587a25f014c0543333623cf9eb8f2c13"} Jul 23 15:14:01.334008 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:01.333966 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jqrpq" event={"ID":"0d05d01d-68f8-48eb-8789-285d901fe7ab","Type":"ContainerStarted","Data":"10396c679ebd4a7856740bc99f05df678a3a66dab80c0001a85221fd195f0baa"} Jul 23 15:14:02.062959 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:02.062915 2582 patch_prober.go:28] interesting pod/image-registry-68d466d8dd-94b5b container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 23 15:14:02.063209 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:02.062983 2582 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" podUID="ad0292fd-a3da-4563-b653-7e074c787676" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 23 15:14:04.271228 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:04.271193 2582 patch_prober.go:28] interesting pod/image-registry-68d466d8dd-94b5b container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 23 15:14:04.271698 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:04.271251 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" podUID="ad0292fd-a3da-4563-b653-7e074c787676" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 23 15:14:04.817431 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:04.817398 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:05.350246 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:05.350211 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jqrpq" event={"ID":"0d05d01d-68f8-48eb-8789-285d901fe7ab","Type":"ContainerStarted","Data":"cba4ddc1c6f1200041e6db1e9d082bb9d5ed74fdfb6cb55d2a255c4688715fdd"} Jul 23 15:14:12.062516 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:12.062469 2582 patch_prober.go:28] interesting pod/image-registry-68d466d8dd-94b5b container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 23 15:14:12.063004 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:12.062537 2582 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" podUID="ad0292fd-a3da-4563-b653-7e074c787676" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 23 15:14:14.271098 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:14.271063 2582 patch_prober.go:28] interesting pod/image-registry-68d466d8dd-94b5b container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 23 15:14:14.271491 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:14.271124 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" podUID="ad0292fd-a3da-4563-b653-7e074c787676" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 23 15:14:15.299742 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:15.299710 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:15.368893 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:15.368847 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:18.284722 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:18.284679 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bsgd9" Jul 23 15:14:18.304291 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:18.304241 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jqrpq" podStartSLOduration=46.485899668 podStartE2EDuration="59.304224585s" totalImagesPullingTime="12.818324917s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:13:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:14:05.37589239 +0000 UTC m=+90.358193220" watchObservedRunningTime="2026-07-23 15:14:18.304224585 +0000 UTC m=+103.286525414" Jul 23 15:14:19.609514 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:19.609479 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68d466d8dd-94b5b"] Jul 23 15:14:19.614148 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:19.614112 2582 patch_prober.go:28] interesting pod/image-registry-68d466d8dd-94b5b container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 23 15:14:19.614296 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:19.614188 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" podUID="ad0292fd-a3da-4563-b653-7e074c787676" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 23 15:14:19.763101 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:19.763064 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:19.872109 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:19.872027 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:19.968311 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:19.968274 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:20.111621 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:20.111589 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:22.647519 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:22.647484 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:22.728968 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:22.728931 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:23.086111 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:23.086085 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:26.646136 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:26.646103 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:28.804247 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:28.804215 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:29.022975 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.022941 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:29.032275 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.032238 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-wgqp5"] Jul 23 15:14:29.082180 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.082144 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-97bcd"] Jul 23 15:14:29.082372 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.082293 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wgqp5" Jul 23 15:14:29.086917 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.086893 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 23 15:14:29.087092 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.086965 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 23 15:14:29.087092 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.087029 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 23 15:14:29.087597 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.087568 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-7ws6n"] Jul 23 15:14:29.088884 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.088120 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-97bcd" Jul 23 15:14:29.097414 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.097124 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-dd452\"" Jul 23 15:14:29.097414 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.097287 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 23 15:14:29.097832 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.097807 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fz765\"" Jul 23 15:14:29.097973 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.097836 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 23 15:14:29.102313 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.102228 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 23 15:14:29.102313 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.102252 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 23 15:14:29.102313 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.102293 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 23 15:14:29.111529 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.111504 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-wgqp5"] Jul 23 15:14:29.111663 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.111637 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-7ws6n" Jul 23 15:14:29.117620 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.117497 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 23 15:14:29.117620 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.117539 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-ldd77\"" Jul 23 15:14:29.117850 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.117833 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 23 15:14:29.119266 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.119067 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 23 15:14:29.145927 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.145888 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-7ws6n"] Jul 23 15:14:29.177322 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.177285 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:29.188492 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.188448 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b7586e00-ef48-474b-8da7-e44494f13452-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-wgqp5\" (UID: \"b7586e00-ef48-474b-8da7-e44494f13452\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wgqp5" Jul 23 15:14:29.188685 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.188508 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-7ws6n\" (UID: \"d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7ws6n" Jul 23 15:14:29.188685 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.188539 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glp5d\" (UniqueName: \"kubernetes.io/projected/d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13-kube-api-access-glp5d\") pod \"kube-state-metrics-56c5594674-7ws6n\" (UID: \"d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7ws6n" Jul 23 15:14:29.188685 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.188561 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnldt\" (UniqueName: \"kubernetes.io/projected/62cde94a-2739-470e-8ea7-649461330501-kube-api-access-qnldt\") pod \"node-exporter-97bcd\" (UID: \"62cde94a-2739-470e-8ea7-649461330501\") " pod="openshift-monitoring/node-exporter-97bcd" Jul 23 15:14:29.188685 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.188588 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-7ws6n\" (UID: \"d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7ws6n" Jul 23 15:14:29.188919 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.188716 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-7ws6n\" (UID: \"d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7ws6n" Jul 23 15:14:29.188919 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.188752 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62cde94a-2739-470e-8ea7-649461330501-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-97bcd\" (UID: \"62cde94a-2739-470e-8ea7-649461330501\") " pod="openshift-monitoring/node-exporter-97bcd" Jul 23 15:14:29.188919 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.188780 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7586e00-ef48-474b-8da7-e44494f13452-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-wgqp5\" (UID: \"b7586e00-ef48-474b-8da7-e44494f13452\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wgqp5" Jul 23 15:14:29.188919 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.188813 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/62cde94a-2739-470e-8ea7-649461330501-node-exporter-wtmp\") pod \"node-exporter-97bcd\" (UID: \"62cde94a-2739-470e-8ea7-649461330501\") " pod="openshift-monitoring/node-exporter-97bcd" Jul 23 15:14:29.188919 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.188839 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62cde94a-2739-470e-8ea7-649461330501-metrics-client-ca\") pod \"node-exporter-97bcd\" (UID: \"62cde94a-2739-470e-8ea7-649461330501\") " pod="openshift-monitoring/node-exporter-97bcd" Jul 23 15:14:29.188919 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.188885 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-7ws6n\" (UID: \"d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7ws6n" Jul 23 15:14:29.188919 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.188913 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/62cde94a-2739-470e-8ea7-649461330501-node-exporter-tls\") pod \"node-exporter-97bcd\" (UID: \"62cde94a-2739-470e-8ea7-649461330501\") " pod="openshift-monitoring/node-exporter-97bcd" Jul 23 15:14:29.189261 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.188941 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/62cde94a-2739-470e-8ea7-649461330501-root\") pod \"node-exporter-97bcd\" (UID: \"62cde94a-2739-470e-8ea7-649461330501\") " pod="openshift-monitoring/node-exporter-97bcd" Jul 23 15:14:29.189261 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.188998 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/62cde94a-2739-470e-8ea7-649461330501-node-exporter-textfile\") pod \"node-exporter-97bcd\" (UID: \"62cde94a-2739-470e-8ea7-649461330501\") " pod="openshift-monitoring/node-exporter-97bcd" Jul 23 15:14:29.189261 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.189027 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-7ws6n\" (UID: \"d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7ws6n" Jul 23 15:14:29.189261 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.189048 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62cde94a-2739-470e-8ea7-649461330501-sys\") pod \"node-exporter-97bcd\" (UID: \"62cde94a-2739-470e-8ea7-649461330501\") " pod="openshift-monitoring/node-exporter-97bcd" Jul 23 15:14:29.189261 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.189078 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7586e00-ef48-474b-8da7-e44494f13452-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-wgqp5\" (UID: \"b7586e00-ef48-474b-8da7-e44494f13452\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wgqp5" Jul 23 15:14:29.189261 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.189111 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/62cde94a-2739-470e-8ea7-649461330501-node-exporter-accelerators-collector-config\") pod \"node-exporter-97bcd\" (UID: \"62cde94a-2739-470e-8ea7-649461330501\") " pod="openshift-monitoring/node-exporter-97bcd" Jul 23 15:14:29.189261 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.189141 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bq8r\" (UniqueName: \"kubernetes.io/projected/b7586e00-ef48-474b-8da7-e44494f13452-kube-api-access-9bq8r\") pod \"openshift-state-metrics-79f6958cdf-wgqp5\" (UID: \"b7586e00-ef48-474b-8da7-e44494f13452\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wgqp5" Jul 23 15:14:29.290434 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.290400 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/62cde94a-2739-470e-8ea7-649461330501-node-exporter-tls\") pod \"node-exporter-97bcd\" (UID: \"62cde94a-2739-470e-8ea7-649461330501\") " pod="openshift-monitoring/node-exporter-97bcd" Jul 23 15:14:29.290434 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.290438 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/62cde94a-2739-470e-8ea7-649461330501-root\") pod \"node-exporter-97bcd\" (UID: \"62cde94a-2739-470e-8ea7-649461330501\") " pod="openshift-monitoring/node-exporter-97bcd" Jul 23 15:14:29.290695 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.290457 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/62cde94a-2739-470e-8ea7-649461330501-node-exporter-textfile\") pod \"node-exporter-97bcd\" (UID: \"62cde94a-2739-470e-8ea7-649461330501\") " pod="openshift-monitoring/node-exporter-97bcd" Jul 23 15:14:29.290695 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.290478 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-7ws6n\" (UID: \"d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7ws6n" Jul 23 15:14:29.290695 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.290500 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62cde94a-2739-470e-8ea7-649461330501-sys\") pod \"node-exporter-97bcd\" (UID: \"62cde94a-2739-470e-8ea7-649461330501\") " pod="openshift-monitoring/node-exporter-97bcd" Jul 23 15:14:29.290695 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.290546 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/62cde94a-2739-470e-8ea7-649461330501-sys\") pod \"node-exporter-97bcd\" (UID: \"62cde94a-2739-470e-8ea7-649461330501\") " pod="openshift-monitoring/node-exporter-97bcd" Jul 23 15:14:29.290695 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.290544 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/62cde94a-2739-470e-8ea7-649461330501-root\") pod \"node-exporter-97bcd\" (UID: \"62cde94a-2739-470e-8ea7-649461330501\") " pod="openshift-monitoring/node-exporter-97bcd" Jul 23 15:14:29.290695 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.290587 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7586e00-ef48-474b-8da7-e44494f13452-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-wgqp5\" (UID: \"b7586e00-ef48-474b-8da7-e44494f13452\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wgqp5" Jul 23 15:14:29.290695 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.290612 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/62cde94a-2739-470e-8ea7-649461330501-node-exporter-accelerators-collector-config\") pod \"node-exporter-97bcd\" (UID: \"62cde94a-2739-470e-8ea7-649461330501\") " pod="openshift-monitoring/node-exporter-97bcd" Jul 23 15:14:29.290695 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.290637 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bq8r\" (UniqueName: \"kubernetes.io/projected/b7586e00-ef48-474b-8da7-e44494f13452-kube-api-access-9bq8r\") pod \"openshift-state-metrics-79f6958cdf-wgqp5\" (UID: \"b7586e00-ef48-474b-8da7-e44494f13452\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wgqp5" Jul 23 15:14:29.291095 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.290721 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b7586e00-ef48-474b-8da7-e44494f13452-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-wgqp5\" (UID: \"b7586e00-ef48-474b-8da7-e44494f13452\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wgqp5" Jul 23 15:14:29.291095 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.290755 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-7ws6n\" (UID: \"d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7ws6n" Jul 23 15:14:29.291095 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.290784 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glp5d\" (UniqueName: \"kubernetes.io/projected/d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13-kube-api-access-glp5d\") pod \"kube-state-metrics-56c5594674-7ws6n\" (UID: \"d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7ws6n" Jul 23 15:14:29.291095 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.290809 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnldt\" (UniqueName: \"kubernetes.io/projected/62cde94a-2739-470e-8ea7-649461330501-kube-api-access-qnldt\") pod \"node-exporter-97bcd\" (UID: \"62cde94a-2739-470e-8ea7-649461330501\") " pod="openshift-monitoring/node-exporter-97bcd" Jul 23 15:14:29.291095 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.290837 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-7ws6n\" (UID: \"d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7ws6n" Jul 23 15:14:29.291095 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.290896 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-7ws6n\" (UID: \"d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7ws6n" Jul 23 15:14:29.291095 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.290919 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62cde94a-2739-470e-8ea7-649461330501-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-97bcd\" (UID: \"62cde94a-2739-470e-8ea7-649461330501\") " pod="openshift-monitoring/node-exporter-97bcd" Jul 23 15:14:29.291095 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.290944 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7586e00-ef48-474b-8da7-e44494f13452-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-wgqp5\" (UID: \"b7586e00-ef48-474b-8da7-e44494f13452\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wgqp5" Jul 23 15:14:29.291095 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.290953 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13-volume-directive-shadow\") pod \"kube-state-metrics-56c5594674-7ws6n\" (UID: \"d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7ws6n" Jul 23 15:14:29.291095 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.290975 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/62cde94a-2739-470e-8ea7-649461330501-node-exporter-wtmp\") pod \"node-exporter-97bcd\" (UID: \"62cde94a-2739-470e-8ea7-649461330501\") " pod="openshift-monitoring/node-exporter-97bcd" Jul 23 15:14:29.291095 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.291003 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62cde94a-2739-470e-8ea7-649461330501-metrics-client-ca\") pod \"node-exporter-97bcd\" (UID: \"62cde94a-2739-470e-8ea7-649461330501\") " pod="openshift-monitoring/node-exporter-97bcd" Jul 23 15:14:29.291095 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.291036 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-7ws6n\" (UID: \"d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7ws6n" Jul 23 15:14:29.291095 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:14:29.291056 2582 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 23 15:14:29.291689 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:14:29.291123 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13-kube-state-metrics-tls podName:d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13 nodeName:}" failed. No retries permitted until 2026-07-23 15:14:29.791104016 +0000 UTC m=+114.773404833 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13-kube-state-metrics-tls") pod "kube-state-metrics-56c5594674-7ws6n" (UID: "d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13") : secret "kube-state-metrics-tls" not found Jul 23 15:14:29.291689 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.291343 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b7586e00-ef48-474b-8da7-e44494f13452-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-wgqp5\" (UID: \"b7586e00-ef48-474b-8da7-e44494f13452\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wgqp5" Jul 23 15:14:29.291689 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.291500 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/62cde94a-2739-470e-8ea7-649461330501-node-exporter-wtmp\") pod \"node-exporter-97bcd\" (UID: \"62cde94a-2739-470e-8ea7-649461330501\") " pod="openshift-monitoring/node-exporter-97bcd" Jul 23 15:14:29.291852 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.291739 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56c5594674-7ws6n\" (UID: \"d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7ws6n" Jul 23 15:14:29.292024 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.292000 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/62cde94a-2739-470e-8ea7-649461330501-node-exporter-textfile\") pod \"node-exporter-97bcd\" (UID: \"62cde94a-2739-470e-8ea7-649461330501\") " pod="openshift-monitoring/node-exporter-97bcd" Jul 23 15:14:29.292295 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.292268 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/62cde94a-2739-470e-8ea7-649461330501-node-exporter-accelerators-collector-config\") pod \"node-exporter-97bcd\" (UID: \"62cde94a-2739-470e-8ea7-649461330501\") " pod="openshift-monitoring/node-exporter-97bcd" Jul 23 15:14:29.292374 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.292328 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13-metrics-client-ca\") pod \"kube-state-metrics-56c5594674-7ws6n\" (UID: \"d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7ws6n" Jul 23 15:14:29.292374 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:14:29.292364 2582 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 23 15:14:29.292480 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:14:29.292441 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7586e00-ef48-474b-8da7-e44494f13452-openshift-state-metrics-tls podName:b7586e00-ef48-474b-8da7-e44494f13452 nodeName:}" failed. No retries permitted until 2026-07-23 15:14:29.792422238 +0000 UTC m=+114.774723052 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b7586e00-ef48-474b-8da7-e44494f13452-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-wgqp5" (UID: "b7586e00-ef48-474b-8da7-e44494f13452") : secret "openshift-state-metrics-tls" not found Jul 23 15:14:29.292594 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.292536 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62cde94a-2739-470e-8ea7-649461330501-metrics-client-ca\") pod \"node-exporter-97bcd\" (UID: \"62cde94a-2739-470e-8ea7-649461330501\") " pod="openshift-monitoring/node-exporter-97bcd" Jul 23 15:14:29.295074 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.295045 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56c5594674-7ws6n\" (UID: \"d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7ws6n" Jul 23 15:14:29.295532 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.295506 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/62cde94a-2739-470e-8ea7-649461330501-node-exporter-tls\") pod \"node-exporter-97bcd\" (UID: \"62cde94a-2739-470e-8ea7-649461330501\") " pod="openshift-monitoring/node-exporter-97bcd" Jul 23 15:14:29.295958 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.295937 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b7586e00-ef48-474b-8da7-e44494f13452-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-wgqp5\" (UID: \"b7586e00-ef48-474b-8da7-e44494f13452\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wgqp5" Jul 23 15:14:29.296047 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.295937 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62cde94a-2739-470e-8ea7-649461330501-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-97bcd\" (UID: \"62cde94a-2739-470e-8ea7-649461330501\") " pod="openshift-monitoring/node-exporter-97bcd" Jul 23 15:14:29.300119 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.300086 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:29.304580 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.304530 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnldt\" (UniqueName: \"kubernetes.io/projected/62cde94a-2739-470e-8ea7-649461330501-kube-api-access-qnldt\") pod \"node-exporter-97bcd\" (UID: \"62cde94a-2739-470e-8ea7-649461330501\") " pod="openshift-monitoring/node-exporter-97bcd" Jul 23 15:14:29.305620 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.305599 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glp5d\" (UniqueName: \"kubernetes.io/projected/d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13-kube-api-access-glp5d\") pod \"kube-state-metrics-56c5594674-7ws6n\" (UID: \"d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7ws6n" Jul 23 15:14:29.305770 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.305746 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bq8r\" (UniqueName: \"kubernetes.io/projected/b7586e00-ef48-474b-8da7-e44494f13452-kube-api-access-9bq8r\") pod \"openshift-state-metrics-79f6958cdf-wgqp5\" (UID: \"b7586e00-ef48-474b-8da7-e44494f13452\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wgqp5" Jul 23 15:14:29.398212 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.398109 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:29.404998 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.404968 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-97bcd" Jul 23 15:14:29.465189 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:14:29.465147 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62cde94a_2739_470e_8ea7_649461330501.slice/crio-dae8ebbfaf9ab53b802912fa1556df97d05fcac481c18a190b6857d1c12fb0a3 WatchSource:0}: Error finding container dae8ebbfaf9ab53b802912fa1556df97d05fcac481c18a190b6857d1c12fb0a3: Status 404 returned error can't find the container with id dae8ebbfaf9ab53b802912fa1556df97d05fcac481c18a190b6857d1c12fb0a3 Jul 23 15:14:29.500629 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.500590 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:29.598164 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.598133 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:29.613809 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.613781 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:14:29.699074 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.698991 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:29.795468 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.795418 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-7ws6n\" (UID: \"d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7ws6n" Jul 23 15:14:29.795641 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.795502 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b7586e00-ef48-474b-8da7-e44494f13452-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-wgqp5\" (UID: \"b7586e00-ef48-474b-8da7-e44494f13452\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wgqp5" Jul 23 15:14:29.797997 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.797976 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b7586e00-ef48-474b-8da7-e44494f13452-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-wgqp5\" (UID: \"b7586e00-ef48-474b-8da7-e44494f13452\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wgqp5" Jul 23 15:14:29.798070 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.797985 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13-kube-state-metrics-tls\") pod \"kube-state-metrics-56c5594674-7ws6n\" (UID: \"d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13\") " pod="openshift-monitoring/kube-state-metrics-56c5594674-7ws6n" Jul 23 15:14:29.996347 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:29.996250 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wgqp5" Jul 23 15:14:30.022481 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:30.022447 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56c5594674-7ws6n" Jul 23 15:14:30.202993 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:30.202937 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-wgqp5"] Jul 23 15:14:30.205731 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:14:30.205703 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7586e00_ef48_474b_8da7_e44494f13452.slice/crio-ab17f01b1d090cba6371969c9953b9132551582ba16f4137dafb8657f864ec7c WatchSource:0}: Error finding container ab17f01b1d090cba6371969c9953b9132551582ba16f4137dafb8657f864ec7c: Status 404 returned error can't find the container with id ab17f01b1d090cba6371969c9953b9132551582ba16f4137dafb8657f864ec7c Jul 23 15:14:30.227637 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:30.227597 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56c5594674-7ws6n"] Jul 23 15:14:30.231327 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:14:30.231300 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2594bd3_d7f0_461f_b52d_e3b0a8fb7d13.slice/crio-a44de79ec37c3fbc286c34d7720c683eda8ba9a406a0c39634907727a74311e3 WatchSource:0}: Error finding container a44de79ec37c3fbc286c34d7720c683eda8ba9a406a0c39634907727a74311e3: Status 404 returned error can't find the container with id a44de79ec37c3fbc286c34d7720c683eda8ba9a406a0c39634907727a74311e3 Jul 23 15:14:30.434433 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:30.434391 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-7ws6n" event={"ID":"d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13","Type":"ContainerStarted","Data":"a44de79ec37c3fbc286c34d7720c683eda8ba9a406a0c39634907727a74311e3"} Jul 23 15:14:30.435365 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:30.435339 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-97bcd" event={"ID":"62cde94a-2739-470e-8ea7-649461330501","Type":"ContainerStarted","Data":"dae8ebbfaf9ab53b802912fa1556df97d05fcac481c18a190b6857d1c12fb0a3"} Jul 23 15:14:30.437037 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:30.437011 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wgqp5" event={"ID":"b7586e00-ef48-474b-8da7-e44494f13452","Type":"ContainerStarted","Data":"85641f2dff3c86ce2ba58d3b81f4cd1b20bcc455ab2839fe4c49f4b799f6e79c"} Jul 23 15:14:30.437129 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:30.437063 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wgqp5" event={"ID":"b7586e00-ef48-474b-8da7-e44494f13452","Type":"ContainerStarted","Data":"c849601f525d130a1ff64ec81c9a7a100499f3aa24a685d695323588472ddb6e"} Jul 23 15:14:30.437129 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:30.437084 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wgqp5" event={"ID":"b7586e00-ef48-474b-8da7-e44494f13452","Type":"ContainerStarted","Data":"ab17f01b1d090cba6371969c9953b9132551582ba16f4137dafb8657f864ec7c"} Jul 23 15:14:31.721637 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:31.721600 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:32.448275 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:32.447807 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-7ws6n" event={"ID":"d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13","Type":"ContainerStarted","Data":"275d43451e9f2b8c4e09dcfb8c2c015d20d8361ab5c8e10ebd03675416e3084c"} Jul 23 15:14:32.448275 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:32.447886 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-7ws6n" event={"ID":"d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13","Type":"ContainerStarted","Data":"77afda7d0f7ca313cd7870e93fed44d519052fac1ba3c92f48e1cae707476996"} Jul 23 15:14:32.450038 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:32.450000 2582 generic.go:356] "Generic (PLEG): container finished" podID="62cde94a-2739-470e-8ea7-649461330501" containerID="f22e5f96677f2c74f2a9689f528f9b6c9622f3f3074096e92fedfa5c9f6e3277" exitCode=0 Jul 23 15:14:32.450162 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:32.450080 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-97bcd" event={"ID":"62cde94a-2739-470e-8ea7-649461330501","Type":"ContainerDied","Data":"f22e5f96677f2c74f2a9689f528f9b6c9622f3f3074096e92fedfa5c9f6e3277"} Jul 23 15:14:33.455662 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.455621 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wgqp5" event={"ID":"b7586e00-ef48-474b-8da7-e44494f13452","Type":"ContainerStarted","Data":"795d2304077ab3726af226dd64125daf52e8c97995d4857bdda14e77e0603782"} Jul 23 15:14:33.457592 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.457566 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56c5594674-7ws6n" event={"ID":"d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13","Type":"ContainerStarted","Data":"e1632afcb3d27b2b86d03d99459480ba0e8953bfbbbfa89b10878f696c80f515"} Jul 23 15:14:33.459539 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.459516 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-97bcd" event={"ID":"62cde94a-2739-470e-8ea7-649461330501","Type":"ContainerStarted","Data":"78e9c4f9fb5b11d69f031f2fb743e3c7ab07dc719d65756c9ebbad37061d4ad5"} Jul 23 15:14:33.459636 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.459556 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-97bcd" event={"ID":"62cde94a-2739-470e-8ea7-649461330501","Type":"ContainerStarted","Data":"88e564a4fd70f43fc5449add3439d8881a7a4787ce448b217f4407b4b2f0c948"} Jul 23 15:14:33.482062 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.482009 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-wgqp5" podStartSLOduration=2.246918996 podStartE2EDuration="4.481992213s" totalImagesPullingTime="2.235073217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:14:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:14:33.48035882 +0000 UTC m=+118.462659651" watchObservedRunningTime="2026-07-23 15:14:33.481992213 +0000 UTC m=+118.464293042" Jul 23 15:14:33.504699 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.504637 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56c5594674-7ws6n" podStartSLOduration=2.572283983 podStartE2EDuration="4.504621021s" totalImagesPullingTime="1.932337038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:14:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:14:33.503473708 +0000 UTC m=+118.485774537" watchObservedRunningTime="2026-07-23 15:14:33.504621021 +0000 UTC m=+118.486921850" Jul 23 15:14:33.524925 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.524849 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-97bcd" podStartSLOduration=2.037063026 podStartE2EDuration="4.524836261s" totalImagesPullingTime="2.401208975s" totalInitContainerRuntime="86.56426ms" isStatefulPod=true podCreationTimestamp="2026-07-23 15:14:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:14:33.523403473 +0000 UTC m=+118.505704306" watchObservedRunningTime="2026-07-23 15:14:33.524836261 +0000 UTC m=+118.507137122" Jul 23 15:14:33.611596 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.607525 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7b9ccbf7d9-st2h7"] Jul 23 15:14:33.613298 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.613273 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b9ccbf7d9-st2h7" Jul 23 15:14:33.616537 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.616509 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 23 15:14:33.616760 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.616746 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 23 15:14:33.616844 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.616824 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-65u49ka721ctp\"" Jul 23 15:14:33.617535 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.617517 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-mgqlk\"" Jul 23 15:14:33.617611 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.617535 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 23 15:14:33.617679 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.617615 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 23 15:14:33.623246 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.623218 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b9ccbf7d9-st2h7"] Jul 23 15:14:33.728525 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.728436 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b958251b-b880-46c3-9bc1-182d6c58d657-client-ca-bundle\") pod \"metrics-server-7b9ccbf7d9-st2h7\" (UID: \"b958251b-b880-46c3-9bc1-182d6c58d657\") " pod="openshift-monitoring/metrics-server-7b9ccbf7d9-st2h7" Jul 23 15:14:33.728525 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.728498 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b958251b-b880-46c3-9bc1-182d6c58d657-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b9ccbf7d9-st2h7\" (UID: \"b958251b-b880-46c3-9bc1-182d6c58d657\") " pod="openshift-monitoring/metrics-server-7b9ccbf7d9-st2h7" Jul 23 15:14:33.728525 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.728521 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b958251b-b880-46c3-9bc1-182d6c58d657-secret-metrics-server-client-certs\") pod \"metrics-server-7b9ccbf7d9-st2h7\" (UID: \"b958251b-b880-46c3-9bc1-182d6c58d657\") " pod="openshift-monitoring/metrics-server-7b9ccbf7d9-st2h7" Jul 23 15:14:33.728806 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.728541 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b958251b-b880-46c3-9bc1-182d6c58d657-secret-metrics-server-tls\") pod \"metrics-server-7b9ccbf7d9-st2h7\" (UID: \"b958251b-b880-46c3-9bc1-182d6c58d657\") " pod="openshift-monitoring/metrics-server-7b9ccbf7d9-st2h7" Jul 23 15:14:33.728806 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.728608 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clxm6\" (UniqueName: \"kubernetes.io/projected/b958251b-b880-46c3-9bc1-182d6c58d657-kube-api-access-clxm6\") pod \"metrics-server-7b9ccbf7d9-st2h7\" (UID: \"b958251b-b880-46c3-9bc1-182d6c58d657\") " pod="openshift-monitoring/metrics-server-7b9ccbf7d9-st2h7" Jul 23 15:14:33.728806 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.728686 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b958251b-b880-46c3-9bc1-182d6c58d657-metrics-server-audit-profiles\") pod \"metrics-server-7b9ccbf7d9-st2h7\" (UID: \"b958251b-b880-46c3-9bc1-182d6c58d657\") " pod="openshift-monitoring/metrics-server-7b9ccbf7d9-st2h7" Jul 23 15:14:33.728806 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.728732 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b958251b-b880-46c3-9bc1-182d6c58d657-audit-log\") pod \"metrics-server-7b9ccbf7d9-st2h7\" (UID: \"b958251b-b880-46c3-9bc1-182d6c58d657\") " pod="openshift-monitoring/metrics-server-7b9ccbf7d9-st2h7" Jul 23 15:14:33.829906 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.829852 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b958251b-b880-46c3-9bc1-182d6c58d657-metrics-server-audit-profiles\") pod \"metrics-server-7b9ccbf7d9-st2h7\" (UID: \"b958251b-b880-46c3-9bc1-182d6c58d657\") " pod="openshift-monitoring/metrics-server-7b9ccbf7d9-st2h7" Jul 23 15:14:33.830101 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.829931 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b958251b-b880-46c3-9bc1-182d6c58d657-audit-log\") pod \"metrics-server-7b9ccbf7d9-st2h7\" (UID: \"b958251b-b880-46c3-9bc1-182d6c58d657\") " pod="openshift-monitoring/metrics-server-7b9ccbf7d9-st2h7" Jul 23 15:14:33.830101 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.829972 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b958251b-b880-46c3-9bc1-182d6c58d657-client-ca-bundle\") pod \"metrics-server-7b9ccbf7d9-st2h7\" (UID: \"b958251b-b880-46c3-9bc1-182d6c58d657\") " pod="openshift-monitoring/metrics-server-7b9ccbf7d9-st2h7" Jul 23 15:14:33.830101 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.830027 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b958251b-b880-46c3-9bc1-182d6c58d657-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b9ccbf7d9-st2h7\" (UID: \"b958251b-b880-46c3-9bc1-182d6c58d657\") " pod="openshift-monitoring/metrics-server-7b9ccbf7d9-st2h7" Jul 23 15:14:33.830101 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.830059 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b958251b-b880-46c3-9bc1-182d6c58d657-secret-metrics-server-client-certs\") pod \"metrics-server-7b9ccbf7d9-st2h7\" (UID: \"b958251b-b880-46c3-9bc1-182d6c58d657\") " pod="openshift-monitoring/metrics-server-7b9ccbf7d9-st2h7" Jul 23 15:14:33.830101 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.830083 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b958251b-b880-46c3-9bc1-182d6c58d657-secret-metrics-server-tls\") pod \"metrics-server-7b9ccbf7d9-st2h7\" (UID: \"b958251b-b880-46c3-9bc1-182d6c58d657\") " pod="openshift-monitoring/metrics-server-7b9ccbf7d9-st2h7" Jul 23 15:14:33.830360 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.830116 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clxm6\" (UniqueName: \"kubernetes.io/projected/b958251b-b880-46c3-9bc1-182d6c58d657-kube-api-access-clxm6\") pod \"metrics-server-7b9ccbf7d9-st2h7\" (UID: \"b958251b-b880-46c3-9bc1-182d6c58d657\") " pod="openshift-monitoring/metrics-server-7b9ccbf7d9-st2h7" Jul 23 15:14:33.830421 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.830360 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/b958251b-b880-46c3-9bc1-182d6c58d657-audit-log\") pod \"metrics-server-7b9ccbf7d9-st2h7\" (UID: \"b958251b-b880-46c3-9bc1-182d6c58d657\") " pod="openshift-monitoring/metrics-server-7b9ccbf7d9-st2h7" Jul 23 15:14:33.831596 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.831018 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/b958251b-b880-46c3-9bc1-182d6c58d657-metrics-server-audit-profiles\") pod \"metrics-server-7b9ccbf7d9-st2h7\" (UID: \"b958251b-b880-46c3-9bc1-182d6c58d657\") " pod="openshift-monitoring/metrics-server-7b9ccbf7d9-st2h7" Jul 23 15:14:33.831596 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.831491 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b958251b-b880-46c3-9bc1-182d6c58d657-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7b9ccbf7d9-st2h7\" (UID: \"b958251b-b880-46c3-9bc1-182d6c58d657\") " pod="openshift-monitoring/metrics-server-7b9ccbf7d9-st2h7" Jul 23 15:14:33.833320 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.833294 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/b958251b-b880-46c3-9bc1-182d6c58d657-secret-metrics-server-tls\") pod \"metrics-server-7b9ccbf7d9-st2h7\" (UID: \"b958251b-b880-46c3-9bc1-182d6c58d657\") " pod="openshift-monitoring/metrics-server-7b9ccbf7d9-st2h7" Jul 23 15:14:33.833419 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.833359 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/b958251b-b880-46c3-9bc1-182d6c58d657-secret-metrics-server-client-certs\") pod \"metrics-server-7b9ccbf7d9-st2h7\" (UID: \"b958251b-b880-46c3-9bc1-182d6c58d657\") " pod="openshift-monitoring/metrics-server-7b9ccbf7d9-st2h7" Jul 23 15:14:33.833842 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.833807 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b958251b-b880-46c3-9bc1-182d6c58d657-client-ca-bundle\") pod \"metrics-server-7b9ccbf7d9-st2h7\" (UID: \"b958251b-b880-46c3-9bc1-182d6c58d657\") " pod="openshift-monitoring/metrics-server-7b9ccbf7d9-st2h7" Jul 23 15:14:33.842582 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.842554 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clxm6\" (UniqueName: \"kubernetes.io/projected/b958251b-b880-46c3-9bc1-182d6c58d657-kube-api-access-clxm6\") pod \"metrics-server-7b9ccbf7d9-st2h7\" (UID: \"b958251b-b880-46c3-9bc1-182d6c58d657\") " pod="openshift-monitoring/metrics-server-7b9ccbf7d9-st2h7" Jul 23 15:14:33.884822 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.884785 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cjplf"] Jul 23 15:14:33.888188 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.888165 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cjplf" Jul 23 15:14:33.891096 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.891061 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 23 15:14:33.891259 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.891239 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-4spcj\"" Jul 23 15:14:33.904031 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.903999 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cjplf"] Jul 23 15:14:33.906402 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.906368 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:33.923521 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:33.923480 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7b9ccbf7d9-st2h7" Jul 23 15:14:34.032475 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.032418 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79gvp\" (UniqueName: \"kubernetes.io/projected/a9ba3dc9-d3f2-4317-bc69-e6f739918b88-kube-api-access-79gvp\") pod \"monitoring-plugin-7b7b7bc8bf-cjplf\" (UID: \"a9ba3dc9-d3f2-4317-bc69-e6f739918b88\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cjplf" Jul 23 15:14:34.032676 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.032583 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9ba3dc9-d3f2-4317-bc69-e6f739918b88-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-cjplf\" (UID: \"a9ba3dc9-d3f2-4317-bc69-e6f739918b88\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cjplf" Jul 23 15:14:34.041681 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.041650 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:34.067592 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.067556 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7b9ccbf7d9-st2h7"] Jul 23 15:14:34.070583 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:14:34.070552 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb958251b_b880_46c3_9bc1_182d6c58d657.slice/crio-26b8c8be1da2e03ee9381fa09a49d932ea66fe7df97553a48ed0227d2073eb3c WatchSource:0}: Error finding container 26b8c8be1da2e03ee9381fa09a49d932ea66fe7df97553a48ed0227d2073eb3c: Status 404 returned error can't find the container with id 26b8c8be1da2e03ee9381fa09a49d932ea66fe7df97553a48ed0227d2073eb3c Jul 23 15:14:34.133673 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.133635 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79gvp\" (UniqueName: \"kubernetes.io/projected/a9ba3dc9-d3f2-4317-bc69-e6f739918b88-kube-api-access-79gvp\") pod \"monitoring-plugin-7b7b7bc8bf-cjplf\" (UID: \"a9ba3dc9-d3f2-4317-bc69-e6f739918b88\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cjplf" Jul 23 15:14:34.133818 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.133713 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9ba3dc9-d3f2-4317-bc69-e6f739918b88-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-cjplf\" (UID: \"a9ba3dc9-d3f2-4317-bc69-e6f739918b88\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cjplf" Jul 23 15:14:34.136276 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.136248 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a9ba3dc9-d3f2-4317-bc69-e6f739918b88-monitoring-plugin-cert\") pod \"monitoring-plugin-7b7b7bc8bf-cjplf\" (UID: \"a9ba3dc9-d3f2-4317-bc69-e6f739918b88\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cjplf" Jul 23 15:14:34.144026 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.143946 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79gvp\" (UniqueName: \"kubernetes.io/projected/a9ba3dc9-d3f2-4317-bc69-e6f739918b88-kube-api-access-79gvp\") pod \"monitoring-plugin-7b7b7bc8bf-cjplf\" (UID: \"a9ba3dc9-d3f2-4317-bc69-e6f739918b88\") " pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cjplf" Jul 23 15:14:34.144170 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.144032 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:34.197703 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.197662 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cjplf" Jul 23 15:14:34.342187 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.342026 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cjplf"] Jul 23 15:14:34.344715 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:14:34.344686 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9ba3dc9_d3f2_4317_bc69_e6f739918b88.slice/crio-02c0142e632eda8100fc3de9478286ad3d4669025e9d9dc047e02ab213f2a748 WatchSource:0}: Error finding container 02c0142e632eda8100fc3de9478286ad3d4669025e9d9dc047e02ab213f2a748: Status 404 returned error can't find the container with id 02c0142e632eda8100fc3de9478286ad3d4669025e9d9dc047e02ab213f2a748 Jul 23 15:14:34.406425 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.406389 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-9788ff9cb-6x6q2"] Jul 23 15:14:34.409471 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.409451 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-9788ff9cb-6x6q2" Jul 23 15:14:34.413074 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.413048 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 23 15:14:34.413201 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.413089 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 23 15:14:34.413255 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.413200 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 23 15:14:34.413710 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.413692 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-rd5zh\"" Jul 23 15:14:34.413869 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.413841 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 23 15:14:34.414000 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.413980 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 23 15:14:34.420212 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.420192 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 23 15:14:34.430071 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.430041 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-9788ff9cb-6x6q2"] Jul 23 15:14:34.464275 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.464239 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cjplf" event={"ID":"a9ba3dc9-d3f2-4317-bc69-e6f739918b88","Type":"ContainerStarted","Data":"02c0142e632eda8100fc3de9478286ad3d4669025e9d9dc047e02ab213f2a748"} Jul 23 15:14:34.465550 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.465515 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b9ccbf7d9-st2h7" event={"ID":"b958251b-b880-46c3-9bc1-182d6c58d657","Type":"ContainerStarted","Data":"26b8c8be1da2e03ee9381fa09a49d932ea66fe7df97553a48ed0227d2073eb3c"} Jul 23 15:14:34.537336 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.537241 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c6656a1-6fd3-484a-a0df-a126b11e0f33-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-9788ff9cb-6x6q2\" (UID: \"5c6656a1-6fd3-484a-a0df-a126b11e0f33\") " pod="openshift-monitoring/telemeter-client-9788ff9cb-6x6q2" Jul 23 15:14:34.537336 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.537288 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c6656a1-6fd3-484a-a0df-a126b11e0f33-metrics-client-ca\") pod \"telemeter-client-9788ff9cb-6x6q2\" (UID: \"5c6656a1-6fd3-484a-a0df-a126b11e0f33\") " pod="openshift-monitoring/telemeter-client-9788ff9cb-6x6q2" Jul 23 15:14:34.537576 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.537405 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c6656a1-6fd3-484a-a0df-a126b11e0f33-serving-certs-ca-bundle\") pod \"telemeter-client-9788ff9cb-6x6q2\" (UID: \"5c6656a1-6fd3-484a-a0df-a126b11e0f33\") " pod="openshift-monitoring/telemeter-client-9788ff9cb-6x6q2" Jul 23 15:14:34.537646 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.537583 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c6656a1-6fd3-484a-a0df-a126b11e0f33-telemeter-trusted-ca-bundle\") pod \"telemeter-client-9788ff9cb-6x6q2\" (UID: \"5c6656a1-6fd3-484a-a0df-a126b11e0f33\") " pod="openshift-monitoring/telemeter-client-9788ff9cb-6x6q2" Jul 23 15:14:34.537707 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.537643 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5c6656a1-6fd3-484a-a0df-a126b11e0f33-telemeter-client-tls\") pod \"telemeter-client-9788ff9cb-6x6q2\" (UID: \"5c6656a1-6fd3-484a-a0df-a126b11e0f33\") " pod="openshift-monitoring/telemeter-client-9788ff9cb-6x6q2" Jul 23 15:14:34.537851 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.537828 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmm89\" (UniqueName: \"kubernetes.io/projected/5c6656a1-6fd3-484a-a0df-a126b11e0f33-kube-api-access-gmm89\") pod \"telemeter-client-9788ff9cb-6x6q2\" (UID: \"5c6656a1-6fd3-484a-a0df-a126b11e0f33\") " pod="openshift-monitoring/telemeter-client-9788ff9cb-6x6q2" Jul 23 15:14:34.537942 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.537893 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5c6656a1-6fd3-484a-a0df-a126b11e0f33-secret-telemeter-client\") pod \"telemeter-client-9788ff9cb-6x6q2\" (UID: \"5c6656a1-6fd3-484a-a0df-a126b11e0f33\") " pod="openshift-monitoring/telemeter-client-9788ff9cb-6x6q2" Jul 23 15:14:34.537942 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.537912 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5c6656a1-6fd3-484a-a0df-a126b11e0f33-federate-client-tls\") pod \"telemeter-client-9788ff9cb-6x6q2\" (UID: \"5c6656a1-6fd3-484a-a0df-a126b11e0f33\") " pod="openshift-monitoring/telemeter-client-9788ff9cb-6x6q2" Jul 23 15:14:34.639356 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.639312 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c6656a1-6fd3-484a-a0df-a126b11e0f33-telemeter-trusted-ca-bundle\") pod \"telemeter-client-9788ff9cb-6x6q2\" (UID: \"5c6656a1-6fd3-484a-a0df-a126b11e0f33\") " pod="openshift-monitoring/telemeter-client-9788ff9cb-6x6q2" Jul 23 15:14:34.639584 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.639368 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5c6656a1-6fd3-484a-a0df-a126b11e0f33-telemeter-client-tls\") pod \"telemeter-client-9788ff9cb-6x6q2\" (UID: \"5c6656a1-6fd3-484a-a0df-a126b11e0f33\") " pod="openshift-monitoring/telemeter-client-9788ff9cb-6x6q2" Jul 23 15:14:34.639584 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.639410 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmm89\" (UniqueName: \"kubernetes.io/projected/5c6656a1-6fd3-484a-a0df-a126b11e0f33-kube-api-access-gmm89\") pod \"telemeter-client-9788ff9cb-6x6q2\" (UID: \"5c6656a1-6fd3-484a-a0df-a126b11e0f33\") " pod="openshift-monitoring/telemeter-client-9788ff9cb-6x6q2" Jul 23 15:14:34.639584 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.639439 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5c6656a1-6fd3-484a-a0df-a126b11e0f33-secret-telemeter-client\") pod \"telemeter-client-9788ff9cb-6x6q2\" (UID: \"5c6656a1-6fd3-484a-a0df-a126b11e0f33\") " pod="openshift-monitoring/telemeter-client-9788ff9cb-6x6q2" Jul 23 15:14:34.639584 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.639472 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5c6656a1-6fd3-484a-a0df-a126b11e0f33-federate-client-tls\") pod \"telemeter-client-9788ff9cb-6x6q2\" (UID: \"5c6656a1-6fd3-484a-a0df-a126b11e0f33\") " pod="openshift-monitoring/telemeter-client-9788ff9cb-6x6q2" Jul 23 15:14:34.639584 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.639537 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c6656a1-6fd3-484a-a0df-a126b11e0f33-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-9788ff9cb-6x6q2\" (UID: \"5c6656a1-6fd3-484a-a0df-a126b11e0f33\") " pod="openshift-monitoring/telemeter-client-9788ff9cb-6x6q2" Jul 23 15:14:34.639584 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.639566 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c6656a1-6fd3-484a-a0df-a126b11e0f33-metrics-client-ca\") pod \"telemeter-client-9788ff9cb-6x6q2\" (UID: \"5c6656a1-6fd3-484a-a0df-a126b11e0f33\") " pod="openshift-monitoring/telemeter-client-9788ff9cb-6x6q2" Jul 23 15:14:34.640008 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.639596 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c6656a1-6fd3-484a-a0df-a126b11e0f33-serving-certs-ca-bundle\") pod \"telemeter-client-9788ff9cb-6x6q2\" (UID: \"5c6656a1-6fd3-484a-a0df-a126b11e0f33\") " pod="openshift-monitoring/telemeter-client-9788ff9cb-6x6q2" Jul 23 15:14:34.640523 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.640376 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c6656a1-6fd3-484a-a0df-a126b11e0f33-serving-certs-ca-bundle\") pod \"telemeter-client-9788ff9cb-6x6q2\" (UID: \"5c6656a1-6fd3-484a-a0df-a126b11e0f33\") " pod="openshift-monitoring/telemeter-client-9788ff9cb-6x6q2" Jul 23 15:14:34.640523 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.640460 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c6656a1-6fd3-484a-a0df-a126b11e0f33-telemeter-trusted-ca-bundle\") pod \"telemeter-client-9788ff9cb-6x6q2\" (UID: \"5c6656a1-6fd3-484a-a0df-a126b11e0f33\") " pod="openshift-monitoring/telemeter-client-9788ff9cb-6x6q2" Jul 23 15:14:34.640931 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.640901 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c6656a1-6fd3-484a-a0df-a126b11e0f33-metrics-client-ca\") pod \"telemeter-client-9788ff9cb-6x6q2\" (UID: \"5c6656a1-6fd3-484a-a0df-a126b11e0f33\") " pod="openshift-monitoring/telemeter-client-9788ff9cb-6x6q2" Jul 23 15:14:34.642358 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.642318 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5c6656a1-6fd3-484a-a0df-a126b11e0f33-telemeter-client-tls\") pod \"telemeter-client-9788ff9cb-6x6q2\" (UID: \"5c6656a1-6fd3-484a-a0df-a126b11e0f33\") " pod="openshift-monitoring/telemeter-client-9788ff9cb-6x6q2" Jul 23 15:14:34.642461 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.642440 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c6656a1-6fd3-484a-a0df-a126b11e0f33-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-9788ff9cb-6x6q2\" (UID: \"5c6656a1-6fd3-484a-a0df-a126b11e0f33\") " pod="openshift-monitoring/telemeter-client-9788ff9cb-6x6q2" Jul 23 15:14:34.642739 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.642712 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5c6656a1-6fd3-484a-a0df-a126b11e0f33-federate-client-tls\") pod \"telemeter-client-9788ff9cb-6x6q2\" (UID: \"5c6656a1-6fd3-484a-a0df-a126b11e0f33\") " pod="openshift-monitoring/telemeter-client-9788ff9cb-6x6q2" Jul 23 15:14:34.642837 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.642785 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5c6656a1-6fd3-484a-a0df-a126b11e0f33-secret-telemeter-client\") pod \"telemeter-client-9788ff9cb-6x6q2\" (UID: \"5c6656a1-6fd3-484a-a0df-a126b11e0f33\") " pod="openshift-monitoring/telemeter-client-9788ff9cb-6x6q2" Jul 23 15:14:34.649837 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.649811 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmm89\" (UniqueName: \"kubernetes.io/projected/5c6656a1-6fd3-484a-a0df-a126b11e0f33-kube-api-access-gmm89\") pod \"telemeter-client-9788ff9cb-6x6q2\" (UID: \"5c6656a1-6fd3-484a-a0df-a126b11e0f33\") " pod="openshift-monitoring/telemeter-client-9788ff9cb-6x6q2" Jul 23 15:14:34.719484 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.719435 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-9788ff9cb-6x6q2" Jul 23 15:14:34.766131 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.766049 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:34.867975 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.867942 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:34.882244 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:34.882209 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-9788ff9cb-6x6q2"] Jul 23 15:14:34.885320 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:14:34.885286 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c6656a1_6fd3_484a_a0df_a126b11e0f33.slice/crio-ab88835191ee8ad87b2337429e17906a3d18420387002dd54b5de20d632f5874 WatchSource:0}: Error finding container ab88835191ee8ad87b2337429e17906a3d18420387002dd54b5de20d632f5874: Status 404 returned error can't find the container with id ab88835191ee8ad87b2337429e17906a3d18420387002dd54b5de20d632f5874 Jul 23 15:14:35.471463 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:35.471413 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9788ff9cb-6x6q2" event={"ID":"5c6656a1-6fd3-484a-a0df-a126b11e0f33","Type":"ContainerStarted","Data":"ab88835191ee8ad87b2337429e17906a3d18420387002dd54b5de20d632f5874"} Jul 23 15:14:36.477359 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:36.477309 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cjplf" event={"ID":"a9ba3dc9-d3f2-4317-bc69-e6f739918b88","Type":"ContainerStarted","Data":"6caeb9bdb532b89e9071a7a7067194415fbee27518078e8127fc42bebcd7d58a"} Jul 23 15:14:36.477833 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:36.477421 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cjplf" Jul 23 15:14:36.479097 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:36.479066 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7b9ccbf7d9-st2h7" event={"ID":"b958251b-b880-46c3-9bc1-182d6c58d657","Type":"ContainerStarted","Data":"06d2c7f79c16d30696684312094dddcec5a929532585fe38f5a9de97a46c2226"} Jul 23 15:14:36.483170 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:36.483146 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cjplf" Jul 23 15:14:36.498141 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:36.498086 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-7b7b7bc8bf-cjplf" podStartSLOduration=2.023262653 podStartE2EDuration="3.498064651s" totalImagesPullingTime="1.474801998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:14:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:14:36.4973273 +0000 UTC m=+121.479628130" watchObservedRunningTime="2026-07-23 15:14:36.498064651 +0000 UTC m=+121.480365483" Jul 23 15:14:36.534008 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:36.533936 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7b9ccbf7d9-st2h7" podStartSLOduration=1.7866907090000002 podStartE2EDuration="3.533911967s" totalImagesPullingTime="1.747221258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:14:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:14:36.516747975 +0000 UTC m=+121.499048807" watchObservedRunningTime="2026-07-23 15:14:36.533911967 +0000 UTC m=+121.516212798" Jul 23 15:14:37.486816 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:37.486781 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9788ff9cb-6x6q2" event={"ID":"5c6656a1-6fd3-484a-a0df-a126b11e0f33","Type":"ContainerStarted","Data":"92d074de52be6db6ff7ca3127b1730178f34508b82ce5ddfe22b20d94fa277dc"} Jul 23 15:14:39.497486 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:39.497451 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9788ff9cb-6x6q2" event={"ID":"5c6656a1-6fd3-484a-a0df-a126b11e0f33","Type":"ContainerStarted","Data":"c1234ca8df364a2072ff6cc7f0bc0a10a343dbd1cefa3ebc5aa82d1409c2cc8b"} Jul 23 15:14:39.497911 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:39.497535 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9788ff9cb-6x6q2" event={"ID":"5c6656a1-6fd3-484a-a0df-a126b11e0f33","Type":"ContainerStarted","Data":"7367a65aa0437a7ca9e037b7fc1b9c03d6ae246f8d7aa4c06707fdf95fc8a1cf"} Jul 23 15:14:39.521306 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:39.521249 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-9788ff9cb-6x6q2" podStartSLOduration=1.447383974 podStartE2EDuration="5.521229847s" totalImagesPullingTime="4.073845873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:14:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:14:39.519515136 +0000 UTC m=+124.501815966" watchObservedRunningTime="2026-07-23 15:14:39.521229847 +0000 UTC m=+124.503530677" Jul 23 15:14:40.381626 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:40.381590 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:40.485625 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:40.485592 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:40.624085 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:40.624053 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:42.021897 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:42.021840 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:43.976551 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:43.976514 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:44.630084 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:44.630027 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" podUID="ad0292fd-a3da-4563-b653-7e074c787676" containerName="registry" containerID="cri-o://3e4c7b6dc2c2408368cf789f3aa088928b4338c6ba293a8aa4f67850abf8ac92" gracePeriod=30 Jul 23 15:14:44.860612 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:44.860588 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:14:44.971022 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:44.970939 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:45.024668 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.024633 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-bound-sa-token\") pod \"ad0292fd-a3da-4563-b653-7e074c787676\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " Jul 23 15:14:45.025094 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.024693 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ad0292fd-a3da-4563-b653-7e074c787676-trusted-ca\") pod \"ad0292fd-a3da-4563-b653-7e074c787676\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " Jul 23 15:14:45.025094 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.024714 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-registry-tls\") pod \"ad0292fd-a3da-4563-b653-7e074c787676\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " Jul 23 15:14:45.025094 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.024748 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ad0292fd-a3da-4563-b653-7e074c787676-ca-trust-extracted\") pod \"ad0292fd-a3da-4563-b653-7e074c787676\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " Jul 23 15:14:45.025094 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.024768 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k464m\" (UniqueName: \"kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-kube-api-access-k464m\") pod \"ad0292fd-a3da-4563-b653-7e074c787676\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " Jul 23 15:14:45.025094 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.024798 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ad0292fd-a3da-4563-b653-7e074c787676-image-registry-private-configuration\") pod \"ad0292fd-a3da-4563-b653-7e074c787676\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " Jul 23 15:14:45.025094 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.024827 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ad0292fd-a3da-4563-b653-7e074c787676-installation-pull-secrets\") pod \"ad0292fd-a3da-4563-b653-7e074c787676\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " Jul 23 15:14:45.025094 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.024896 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ad0292fd-a3da-4563-b653-7e074c787676-registry-certificates\") pod \"ad0292fd-a3da-4563-b653-7e074c787676\" (UID: \"ad0292fd-a3da-4563-b653-7e074c787676\") " Jul 23 15:14:45.025444 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.025344 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad0292fd-a3da-4563-b653-7e074c787676-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ad0292fd-a3da-4563-b653-7e074c787676" (UID: "ad0292fd-a3da-4563-b653-7e074c787676"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 15:14:45.025444 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.025421 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad0292fd-a3da-4563-b653-7e074c787676-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ad0292fd-a3da-4563-b653-7e074c787676" (UID: "ad0292fd-a3da-4563-b653-7e074c787676"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 15:14:45.027695 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.027638 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad0292fd-a3da-4563-b653-7e074c787676-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ad0292fd-a3da-4563-b653-7e074c787676" (UID: "ad0292fd-a3da-4563-b653-7e074c787676"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 15:14:45.027806 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.027696 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ad0292fd-a3da-4563-b653-7e074c787676" (UID: "ad0292fd-a3da-4563-b653-7e074c787676"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:14:45.027806 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.027729 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad0292fd-a3da-4563-b653-7e074c787676-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ad0292fd-a3da-4563-b653-7e074c787676" (UID: "ad0292fd-a3da-4563-b653-7e074c787676"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 15:14:45.027806 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.027765 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ad0292fd-a3da-4563-b653-7e074c787676" (UID: "ad0292fd-a3da-4563-b653-7e074c787676"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:14:45.027944 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.027810 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-kube-api-access-k464m" (OuterVolumeSpecName: "kube-api-access-k464m") pod "ad0292fd-a3da-4563-b653-7e074c787676" (UID: "ad0292fd-a3da-4563-b653-7e074c787676"). InnerVolumeSpecName "kube-api-access-k464m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:14:45.031019 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.030984 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:45.033666 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.033641 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad0292fd-a3da-4563-b653-7e074c787676-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ad0292fd-a3da-4563-b653-7e074c787676" (UID: "ad0292fd-a3da-4563-b653-7e074c787676"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 15:14:45.125549 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.125509 2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ad0292fd-a3da-4563-b653-7e074c787676-registry-certificates\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 23 15:14:45.125549 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.125541 2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-bound-sa-token\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 23 15:14:45.125549 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.125552 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ad0292fd-a3da-4563-b653-7e074c787676-trusted-ca\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 23 15:14:45.125549 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.125559 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-registry-tls\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 23 15:14:45.125800 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.125566 2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ad0292fd-a3da-4563-b653-7e074c787676-ca-trust-extracted\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 23 15:14:45.125800 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.125575 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k464m\" (UniqueName: \"kubernetes.io/projected/ad0292fd-a3da-4563-b653-7e074c787676-kube-api-access-k464m\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 23 15:14:45.125800 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.125584 2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ad0292fd-a3da-4563-b653-7e074c787676-image-registry-private-configuration\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 23 15:14:45.125800 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.125593 2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ad0292fd-a3da-4563-b653-7e074c787676-installation-pull-secrets\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 23 15:14:45.286097 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.286021 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:45.387491 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.387445 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:45.521322 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.521291 2582 generic.go:356] "Generic (PLEG): container finished" podID="ad0292fd-a3da-4563-b653-7e074c787676" containerID="3e4c7b6dc2c2408368cf789f3aa088928b4338c6ba293a8aa4f67850abf8ac92" exitCode=0 Jul 23 15:14:45.521507 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.521338 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" Jul 23 15:14:45.521507 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.521372 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" event={"ID":"ad0292fd-a3da-4563-b653-7e074c787676","Type":"ContainerDied","Data":"3e4c7b6dc2c2408368cf789f3aa088928b4338c6ba293a8aa4f67850abf8ac92"} Jul 23 15:14:45.521507 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.521428 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68d466d8dd-94b5b" event={"ID":"ad0292fd-a3da-4563-b653-7e074c787676","Type":"ContainerDied","Data":"c434ad3b81675b47a9249f9fa0603b848e94c7d8bdce405f74f648914bfbf384"} Jul 23 15:14:45.521507 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.521457 2582 scope.go:117] "RemoveContainer" containerID="3e4c7b6dc2c2408368cf789f3aa088928b4338c6ba293a8aa4f67850abf8ac92" Jul 23 15:14:45.529706 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.529690 2582 scope.go:117] "RemoveContainer" containerID="3e4c7b6dc2c2408368cf789f3aa088928b4338c6ba293a8aa4f67850abf8ac92" Jul 23 15:14:45.530013 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:14:45.529990 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e4c7b6dc2c2408368cf789f3aa088928b4338c6ba293a8aa4f67850abf8ac92\": container with ID starting with 3e4c7b6dc2c2408368cf789f3aa088928b4338c6ba293a8aa4f67850abf8ac92 not found: ID does not exist" containerID="3e4c7b6dc2c2408368cf789f3aa088928b4338c6ba293a8aa4f67850abf8ac92" Jul 23 15:14:45.530065 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.530023 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e4c7b6dc2c2408368cf789f3aa088928b4338c6ba293a8aa4f67850abf8ac92"} err="failed to get container status \"3e4c7b6dc2c2408368cf789f3aa088928b4338c6ba293a8aa4f67850abf8ac92\": rpc error: code = NotFound desc = could not find container \"3e4c7b6dc2c2408368cf789f3aa088928b4338c6ba293a8aa4f67850abf8ac92\": container with ID starting with 3e4c7b6dc2c2408368cf789f3aa088928b4338c6ba293a8aa4f67850abf8ac92 not found: ID does not exist" Jul 23 15:14:45.549913 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.549823 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68d466d8dd-94b5b"] Jul 23 15:14:45.555104 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.555070 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-68d466d8dd-94b5b"] Jul 23 15:14:45.980584 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:45.980553 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad0292fd-a3da-4563-b653-7e074c787676" path="/var/lib/kubelet/pods/ad0292fd-a3da-4563-b653-7e074c787676/volumes" Jul 23 15:14:49.703911 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:49.703876 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:53.923669 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:53.923628 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7b9ccbf7d9-st2h7" Jul 23 15:14:53.924104 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:53.923702 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7b9ccbf7d9-st2h7" Jul 23 15:14:54.894708 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:54.894671 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:14:54.956104 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:54.956075 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j4mcc_4bbea83b-d4d2-4103-9f4d-b67e865dfea1/serve-healthcheck-canary/0.log" Jul 23 15:14:54.959402 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:14:54.959378 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:15:00.301873 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:00.301824 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:15:00.400044 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:00.400013 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:15:00.904681 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:00.904649 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:15:00.986924 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:00.986894 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:15:10.001541 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:10.001504 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:15:10.078813 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:10.078776 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:15:11.145067 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:11.145040 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:15:11.447443 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:11.447355 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:15:11.547405 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:11.547365 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:15:11.919373 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:11.919321 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:15:12.022998 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:12.022967 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:15:13.332107 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.332068 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5fd967b47f-sb2th"] Jul 23 15:15:13.332478 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.332426 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad0292fd-a3da-4563-b653-7e074c787676" containerName="registry" Jul 23 15:15:13.332478 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.332439 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad0292fd-a3da-4563-b653-7e074c787676" containerName="registry" Jul 23 15:15:13.332548 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.332483 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad0292fd-a3da-4563-b653-7e074c787676" containerName="registry" Jul 23 15:15:13.338038 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.338010 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fd967b47f-sb2th" Jul 23 15:15:13.340454 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.340432 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 23 15:15:13.340572 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.340434 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 23 15:15:13.341618 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.341596 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 23 15:15:13.341735 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.341603 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zcq7c\"" Jul 23 15:15:13.341735 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.341604 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 23 15:15:13.341735 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.341668 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 23 15:15:13.341735 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.341623 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 23 15:15:13.341735 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.341627 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 23 15:15:13.346522 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.346499 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fd967b47f-sb2th"] Jul 23 15:15:13.433481 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.433438 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d4352bd-e31e-456f-a171-acb6b1c57bc5-console-serving-cert\") pod \"console-5fd967b47f-sb2th\" (UID: \"5d4352bd-e31e-456f-a171-acb6b1c57bc5\") " pod="openshift-console/console-5fd967b47f-sb2th" Jul 23 15:15:13.433481 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.433488 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d4352bd-e31e-456f-a171-acb6b1c57bc5-console-oauth-config\") pod \"console-5fd967b47f-sb2th\" (UID: \"5d4352bd-e31e-456f-a171-acb6b1c57bc5\") " pod="openshift-console/console-5fd967b47f-sb2th" Jul 23 15:15:13.433696 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.433560 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d4352bd-e31e-456f-a171-acb6b1c57bc5-oauth-serving-cert\") pod \"console-5fd967b47f-sb2th\" (UID: \"5d4352bd-e31e-456f-a171-acb6b1c57bc5\") " pod="openshift-console/console-5fd967b47f-sb2th" Jul 23 15:15:13.433696 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.433615 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4352bd-e31e-456f-a171-acb6b1c57bc5-service-ca\") pod \"console-5fd967b47f-sb2th\" (UID: \"5d4352bd-e31e-456f-a171-acb6b1c57bc5\") " pod="openshift-console/console-5fd967b47f-sb2th" Jul 23 15:15:13.433696 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.433652 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d4352bd-e31e-456f-a171-acb6b1c57bc5-console-config\") pod \"console-5fd967b47f-sb2th\" (UID: \"5d4352bd-e31e-456f-a171-acb6b1c57bc5\") " pod="openshift-console/console-5fd967b47f-sb2th" Jul 23 15:15:13.433696 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.433677 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdtcl\" (UniqueName: \"kubernetes.io/projected/5d4352bd-e31e-456f-a171-acb6b1c57bc5-kube-api-access-cdtcl\") pod \"console-5fd967b47f-sb2th\" (UID: \"5d4352bd-e31e-456f-a171-acb6b1c57bc5\") " pod="openshift-console/console-5fd967b47f-sb2th" Jul 23 15:15:13.534215 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.534174 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d4352bd-e31e-456f-a171-acb6b1c57bc5-console-config\") pod \"console-5fd967b47f-sb2th\" (UID: \"5d4352bd-e31e-456f-a171-acb6b1c57bc5\") " pod="openshift-console/console-5fd967b47f-sb2th" Jul 23 15:15:13.534215 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.534216 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdtcl\" (UniqueName: \"kubernetes.io/projected/5d4352bd-e31e-456f-a171-acb6b1c57bc5-kube-api-access-cdtcl\") pod \"console-5fd967b47f-sb2th\" (UID: \"5d4352bd-e31e-456f-a171-acb6b1c57bc5\") " pod="openshift-console/console-5fd967b47f-sb2th" Jul 23 15:15:13.534415 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.534240 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d4352bd-e31e-456f-a171-acb6b1c57bc5-console-serving-cert\") pod \"console-5fd967b47f-sb2th\" (UID: \"5d4352bd-e31e-456f-a171-acb6b1c57bc5\") " pod="openshift-console/console-5fd967b47f-sb2th" Jul 23 15:15:13.534415 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.534271 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d4352bd-e31e-456f-a171-acb6b1c57bc5-console-oauth-config\") pod \"console-5fd967b47f-sb2th\" (UID: \"5d4352bd-e31e-456f-a171-acb6b1c57bc5\") " pod="openshift-console/console-5fd967b47f-sb2th" Jul 23 15:15:13.534415 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.534314 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d4352bd-e31e-456f-a171-acb6b1c57bc5-oauth-serving-cert\") pod \"console-5fd967b47f-sb2th\" (UID: \"5d4352bd-e31e-456f-a171-acb6b1c57bc5\") " pod="openshift-console/console-5fd967b47f-sb2th" Jul 23 15:15:13.534415 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.534349 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4352bd-e31e-456f-a171-acb6b1c57bc5-service-ca\") pod \"console-5fd967b47f-sb2th\" (UID: \"5d4352bd-e31e-456f-a171-acb6b1c57bc5\") " pod="openshift-console/console-5fd967b47f-sb2th" Jul 23 15:15:13.535005 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.534978 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d4352bd-e31e-456f-a171-acb6b1c57bc5-console-config\") pod \"console-5fd967b47f-sb2th\" (UID: \"5d4352bd-e31e-456f-a171-acb6b1c57bc5\") " pod="openshift-console/console-5fd967b47f-sb2th" Jul 23 15:15:13.535119 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.535032 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d4352bd-e31e-456f-a171-acb6b1c57bc5-oauth-serving-cert\") pod \"console-5fd967b47f-sb2th\" (UID: \"5d4352bd-e31e-456f-a171-acb6b1c57bc5\") " pod="openshift-console/console-5fd967b47f-sb2th" Jul 23 15:15:13.535119 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.535099 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4352bd-e31e-456f-a171-acb6b1c57bc5-service-ca\") pod \"console-5fd967b47f-sb2th\" (UID: \"5d4352bd-e31e-456f-a171-acb6b1c57bc5\") " pod="openshift-console/console-5fd967b47f-sb2th" Jul 23 15:15:13.536795 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.536775 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d4352bd-e31e-456f-a171-acb6b1c57bc5-console-serving-cert\") pod \"console-5fd967b47f-sb2th\" (UID: \"5d4352bd-e31e-456f-a171-acb6b1c57bc5\") " pod="openshift-console/console-5fd967b47f-sb2th" Jul 23 15:15:13.536851 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.536835 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d4352bd-e31e-456f-a171-acb6b1c57bc5-console-oauth-config\") pod \"console-5fd967b47f-sb2th\" (UID: \"5d4352bd-e31e-456f-a171-acb6b1c57bc5\") " pod="openshift-console/console-5fd967b47f-sb2th" Jul 23 15:15:13.543309 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.543286 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdtcl\" (UniqueName: \"kubernetes.io/projected/5d4352bd-e31e-456f-a171-acb6b1c57bc5-kube-api-access-cdtcl\") pod \"console-5fd967b47f-sb2th\" (UID: \"5d4352bd-e31e-456f-a171-acb6b1c57bc5\") " pod="openshift-console/console-5fd967b47f-sb2th" Jul 23 15:15:13.648310 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.648209 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fd967b47f-sb2th" Jul 23 15:15:13.792990 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.792955 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fd967b47f-sb2th"] Jul 23 15:15:13.795931 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:15:13.795896 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d4352bd_e31e_456f_a171_acb6b1c57bc5.slice/crio-b95fef638df36c2eeaf9983ef82e63d750aa29b261cfe2d8133fae574944d883 WatchSource:0}: Error finding container b95fef638df36c2eeaf9983ef82e63d750aa29b261cfe2d8133fae574944d883: Status 404 returned error can't find the container with id b95fef638df36c2eeaf9983ef82e63d750aa29b261cfe2d8133fae574944d883 Jul 23 15:15:13.929111 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.929031 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7b9ccbf7d9-st2h7" Jul 23 15:15:13.932820 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:13.932799 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7b9ccbf7d9-st2h7" Jul 23 15:15:14.634418 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:14.634383 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fd967b47f-sb2th" event={"ID":"5d4352bd-e31e-456f-a171-acb6b1c57bc5","Type":"ContainerStarted","Data":"b95fef638df36c2eeaf9983ef82e63d750aa29b261cfe2d8133fae574944d883"} Jul 23 15:15:14.953842 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:14.953710 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:15:15.048685 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:15.048624 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:15:15.307535 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:15.307396 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:15:15.398549 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:15.398500 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:15:15.938316 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:15.938282 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:15:16.340818 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:16.340785 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5664d54f56-bvld9"] Jul 23 15:15:16.343912 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:16.343891 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5664d54f56-bvld9" Jul 23 15:15:16.354002 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:16.353975 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 23 15:15:16.359807 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:16.359780 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5664d54f56-bvld9"] Jul 23 15:15:16.458248 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:16.458211 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0503714-a698-4b89-9b8e-553f211ca1e4-console-config\") pod \"console-5664d54f56-bvld9\" (UID: \"c0503714-a698-4b89-9b8e-553f211ca1e4\") " pod="openshift-console/console-5664d54f56-bvld9" Jul 23 15:15:16.458439 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:16.458282 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0503714-a698-4b89-9b8e-553f211ca1e4-console-oauth-config\") pod \"console-5664d54f56-bvld9\" (UID: \"c0503714-a698-4b89-9b8e-553f211ca1e4\") " pod="openshift-console/console-5664d54f56-bvld9" Jul 23 15:15:16.458439 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:16.458308 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0503714-a698-4b89-9b8e-553f211ca1e4-service-ca\") pod \"console-5664d54f56-bvld9\" (UID: \"c0503714-a698-4b89-9b8e-553f211ca1e4\") " pod="openshift-console/console-5664d54f56-bvld9" Jul 23 15:15:16.458439 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:16.458395 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0503714-a698-4b89-9b8e-553f211ca1e4-trusted-ca-bundle\") pod \"console-5664d54f56-bvld9\" (UID: \"c0503714-a698-4b89-9b8e-553f211ca1e4\") " pod="openshift-console/console-5664d54f56-bvld9" Jul 23 15:15:16.458609 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:16.458453 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0503714-a698-4b89-9b8e-553f211ca1e4-console-serving-cert\") pod \"console-5664d54f56-bvld9\" (UID: \"c0503714-a698-4b89-9b8e-553f211ca1e4\") " pod="openshift-console/console-5664d54f56-bvld9" Jul 23 15:15:16.458609 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:16.458478 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0503714-a698-4b89-9b8e-553f211ca1e4-oauth-serving-cert\") pod \"console-5664d54f56-bvld9\" (UID: \"c0503714-a698-4b89-9b8e-553f211ca1e4\") " pod="openshift-console/console-5664d54f56-bvld9" Jul 23 15:15:16.458609 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:16.458501 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqqt4\" (UniqueName: \"kubernetes.io/projected/c0503714-a698-4b89-9b8e-553f211ca1e4-kube-api-access-lqqt4\") pod \"console-5664d54f56-bvld9\" (UID: \"c0503714-a698-4b89-9b8e-553f211ca1e4\") " pod="openshift-console/console-5664d54f56-bvld9" Jul 23 15:15:16.548775 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:16.548734 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:15:16.559844 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:16.559809 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0503714-a698-4b89-9b8e-553f211ca1e4-oauth-serving-cert\") pod \"console-5664d54f56-bvld9\" (UID: \"c0503714-a698-4b89-9b8e-553f211ca1e4\") " pod="openshift-console/console-5664d54f56-bvld9" Jul 23 15:15:16.560035 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:16.559883 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqqt4\" (UniqueName: \"kubernetes.io/projected/c0503714-a698-4b89-9b8e-553f211ca1e4-kube-api-access-lqqt4\") pod \"console-5664d54f56-bvld9\" (UID: \"c0503714-a698-4b89-9b8e-553f211ca1e4\") " pod="openshift-console/console-5664d54f56-bvld9" Jul 23 15:15:16.560035 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:16.559962 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0503714-a698-4b89-9b8e-553f211ca1e4-console-config\") pod \"console-5664d54f56-bvld9\" (UID: \"c0503714-a698-4b89-9b8e-553f211ca1e4\") " pod="openshift-console/console-5664d54f56-bvld9" Jul 23 15:15:16.560035 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:16.559995 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0503714-a698-4b89-9b8e-553f211ca1e4-console-oauth-config\") pod \"console-5664d54f56-bvld9\" (UID: \"c0503714-a698-4b89-9b8e-553f211ca1e4\") " pod="openshift-console/console-5664d54f56-bvld9" Jul 23 15:15:16.560035 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:16.560016 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0503714-a698-4b89-9b8e-553f211ca1e4-service-ca\") pod \"console-5664d54f56-bvld9\" (UID: \"c0503714-a698-4b89-9b8e-553f211ca1e4\") " pod="openshift-console/console-5664d54f56-bvld9" Jul 23 15:15:16.560225 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:16.560058 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0503714-a698-4b89-9b8e-553f211ca1e4-trusted-ca-bundle\") pod \"console-5664d54f56-bvld9\" (UID: \"c0503714-a698-4b89-9b8e-553f211ca1e4\") " pod="openshift-console/console-5664d54f56-bvld9" Jul 23 15:15:16.560225 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:16.560094 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0503714-a698-4b89-9b8e-553f211ca1e4-console-serving-cert\") pod \"console-5664d54f56-bvld9\" (UID: \"c0503714-a698-4b89-9b8e-553f211ca1e4\") " pod="openshift-console/console-5664d54f56-bvld9" Jul 23 15:15:16.560756 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:16.560678 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0503714-a698-4b89-9b8e-553f211ca1e4-oauth-serving-cert\") pod \"console-5664d54f56-bvld9\" (UID: \"c0503714-a698-4b89-9b8e-553f211ca1e4\") " pod="openshift-console/console-5664d54f56-bvld9" Jul 23 15:15:16.560756 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:16.560744 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0503714-a698-4b89-9b8e-553f211ca1e4-console-config\") pod \"console-5664d54f56-bvld9\" (UID: \"c0503714-a698-4b89-9b8e-553f211ca1e4\") " pod="openshift-console/console-5664d54f56-bvld9" Jul 23 15:15:16.561062 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:16.561036 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0503714-a698-4b89-9b8e-553f211ca1e4-service-ca\") pod \"console-5664d54f56-bvld9\" (UID: \"c0503714-a698-4b89-9b8e-553f211ca1e4\") " pod="openshift-console/console-5664d54f56-bvld9" Jul 23 15:15:16.561180 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:16.561155 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0503714-a698-4b89-9b8e-553f211ca1e4-trusted-ca-bundle\") pod \"console-5664d54f56-bvld9\" (UID: \"c0503714-a698-4b89-9b8e-553f211ca1e4\") " pod="openshift-console/console-5664d54f56-bvld9" Jul 23 15:15:16.562841 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:16.562820 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0503714-a698-4b89-9b8e-553f211ca1e4-console-serving-cert\") pod \"console-5664d54f56-bvld9\" (UID: \"c0503714-a698-4b89-9b8e-553f211ca1e4\") " pod="openshift-console/console-5664d54f56-bvld9" Jul 23 15:15:16.562974 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:16.562940 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0503714-a698-4b89-9b8e-553f211ca1e4-console-oauth-config\") pod \"console-5664d54f56-bvld9\" (UID: \"c0503714-a698-4b89-9b8e-553f211ca1e4\") " pod="openshift-console/console-5664d54f56-bvld9" Jul 23 15:15:16.570120 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:16.570091 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqqt4\" (UniqueName: \"kubernetes.io/projected/c0503714-a698-4b89-9b8e-553f211ca1e4-kube-api-access-lqqt4\") pod \"console-5664d54f56-bvld9\" (UID: \"c0503714-a698-4b89-9b8e-553f211ca1e4\") " pod="openshift-console/console-5664d54f56-bvld9" Jul 23 15:15:16.632600 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:16.632502 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:15:16.655211 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:16.655167 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5664d54f56-bvld9" Jul 23 15:15:17.348036 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:17.348006 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5664d54f56-bvld9"] Jul 23 15:15:17.351626 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:15:17.351599 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0503714_a698_4b89_9b8e_553f211ca1e4.slice/crio-45e37f707e910d0c140b7d1896a334d80dea8126b91f652a4e9d6f01221682e3 WatchSource:0}: Error finding container 45e37f707e910d0c140b7d1896a334d80dea8126b91f652a4e9d6f01221682e3: Status 404 returned error can't find the container with id 45e37f707e910d0c140b7d1896a334d80dea8126b91f652a4e9d6f01221682e3 Jul 23 15:15:17.649228 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:17.649187 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fd967b47f-sb2th" event={"ID":"5d4352bd-e31e-456f-a171-acb6b1c57bc5","Type":"ContainerStarted","Data":"e1279466b4a279938082a5b6ae8b65243b6daadd1900fab18dd20cca6b083eee"} Jul 23 15:15:17.650701 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:17.650677 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5664d54f56-bvld9" event={"ID":"c0503714-a698-4b89-9b8e-553f211ca1e4","Type":"ContainerStarted","Data":"5b1ea1edddcbd64eaed516d5ec4af6a92142d66d7f6cb8ad06d5f6edd8b9d7c5"} Jul 23 15:15:17.650810 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:17.650716 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5664d54f56-bvld9" event={"ID":"c0503714-a698-4b89-9b8e-553f211ca1e4","Type":"ContainerStarted","Data":"45e37f707e910d0c140b7d1896a334d80dea8126b91f652a4e9d6f01221682e3"} Jul 23 15:15:17.675392 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:17.675347 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5fd967b47f-sb2th" podStartSLOduration=1.237374978 podStartE2EDuration="4.675331107s" totalImagesPullingTime="3.437956129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:15:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:15:17.673867478 +0000 UTC m=+162.656168301" watchObservedRunningTime="2026-07-23 15:15:17.675331107 +0000 UTC m=+162.657631938" Jul 23 15:15:17.701439 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:17.701391 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5664d54f56-bvld9" podStartSLOduration=1.7013740510000002 podStartE2EDuration="1.701374051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:15:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:15:17.70023908 +0000 UTC m=+162.682539910" watchObservedRunningTime="2026-07-23 15:15:17.701374051 +0000 UTC m=+162.683674950" Jul 23 15:15:20.705925 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:20.705827 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:15:20.783900 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:20.783840 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:15:23.648615 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:23.648580 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5fd967b47f-sb2th" Jul 23 15:15:23.649032 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:23.648899 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5fd967b47f-sb2th" Jul 23 15:15:23.653726 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:23.653708 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5fd967b47f-sb2th" Jul 23 15:15:23.680090 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:23.680063 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5fd967b47f-sb2th" Jul 23 15:15:23.872647 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:23.872612 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:15:23.970039 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:23.969947 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:15:26.656127 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:26.656093 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5664d54f56-bvld9" Jul 23 15:15:26.656627 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:26.656200 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5664d54f56-bvld9" Jul 23 15:15:26.661104 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:26.661080 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5664d54f56-bvld9" Jul 23 15:15:26.688843 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:26.688807 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5664d54f56-bvld9" Jul 23 15:15:26.737286 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:26.737247 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fd967b47f-sb2th"] Jul 23 15:15:26.853614 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:26.853579 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:15:26.963803 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:26.963687 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:15:27.049754 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:27.049716 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:15:30.290722 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:30.290665 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:15:30.391657 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:30.391628 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:15:38.029626 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:38.029576 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:15:38.241535 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:38.241500 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:15:45.386852 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:45.386808 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:15:45.473488 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:45.473454 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:15:51.764618 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:51.764546 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5fd967b47f-sb2th" podUID="5d4352bd-e31e-456f-a171-acb6b1c57bc5" containerName="console" containerID="cri-o://e1279466b4a279938082a5b6ae8b65243b6daadd1900fab18dd20cca6b083eee" gracePeriod=15 Jul 23 15:15:52.015197 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:52.015135 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fd967b47f-sb2th" Jul 23 15:15:52.149374 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:52.149328 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d4352bd-e31e-456f-a171-acb6b1c57bc5-console-config\") pod \"5d4352bd-e31e-456f-a171-acb6b1c57bc5\" (UID: \"5d4352bd-e31e-456f-a171-acb6b1c57bc5\") " Jul 23 15:15:52.149374 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:52.149377 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4352bd-e31e-456f-a171-acb6b1c57bc5-service-ca\") pod \"5d4352bd-e31e-456f-a171-acb6b1c57bc5\" (UID: \"5d4352bd-e31e-456f-a171-acb6b1c57bc5\") " Jul 23 15:15:52.149619 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:52.149401 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdtcl\" (UniqueName: \"kubernetes.io/projected/5d4352bd-e31e-456f-a171-acb6b1c57bc5-kube-api-access-cdtcl\") pod \"5d4352bd-e31e-456f-a171-acb6b1c57bc5\" (UID: \"5d4352bd-e31e-456f-a171-acb6b1c57bc5\") " Jul 23 15:15:52.149619 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:52.149438 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d4352bd-e31e-456f-a171-acb6b1c57bc5-console-serving-cert\") pod \"5d4352bd-e31e-456f-a171-acb6b1c57bc5\" (UID: \"5d4352bd-e31e-456f-a171-acb6b1c57bc5\") " Jul 23 15:15:52.149619 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:52.149461 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d4352bd-e31e-456f-a171-acb6b1c57bc5-console-oauth-config\") pod \"5d4352bd-e31e-456f-a171-acb6b1c57bc5\" (UID: \"5d4352bd-e31e-456f-a171-acb6b1c57bc5\") " Jul 23 15:15:52.149619 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:52.149492 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d4352bd-e31e-456f-a171-acb6b1c57bc5-oauth-serving-cert\") pod \"5d4352bd-e31e-456f-a171-acb6b1c57bc5\" (UID: \"5d4352bd-e31e-456f-a171-acb6b1c57bc5\") " Jul 23 15:15:52.149822 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:52.149799 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d4352bd-e31e-456f-a171-acb6b1c57bc5-service-ca" (OuterVolumeSpecName: "service-ca") pod "5d4352bd-e31e-456f-a171-acb6b1c57bc5" (UID: "5d4352bd-e31e-456f-a171-acb6b1c57bc5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 15:15:52.149905 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:52.149815 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d4352bd-e31e-456f-a171-acb6b1c57bc5-console-config" (OuterVolumeSpecName: "console-config") pod "5d4352bd-e31e-456f-a171-acb6b1c57bc5" (UID: "5d4352bd-e31e-456f-a171-acb6b1c57bc5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 15:15:52.150065 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:52.150040 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d4352bd-e31e-456f-a171-acb6b1c57bc5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5d4352bd-e31e-456f-a171-acb6b1c57bc5" (UID: "5d4352bd-e31e-456f-a171-acb6b1c57bc5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 15:15:52.151688 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:52.151657 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d4352bd-e31e-456f-a171-acb6b1c57bc5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5d4352bd-e31e-456f-a171-acb6b1c57bc5" (UID: "5d4352bd-e31e-456f-a171-acb6b1c57bc5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 15:15:52.151781 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:52.151684 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d4352bd-e31e-456f-a171-acb6b1c57bc5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5d4352bd-e31e-456f-a171-acb6b1c57bc5" (UID: "5d4352bd-e31e-456f-a171-acb6b1c57bc5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 15:15:52.151781 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:52.151691 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d4352bd-e31e-456f-a171-acb6b1c57bc5-kube-api-access-cdtcl" (OuterVolumeSpecName: "kube-api-access-cdtcl") pod "5d4352bd-e31e-456f-a171-acb6b1c57bc5" (UID: "5d4352bd-e31e-456f-a171-acb6b1c57bc5"). InnerVolumeSpecName "kube-api-access-cdtcl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:15:52.250452 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:52.250418 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5d4352bd-e31e-456f-a171-acb6b1c57bc5-console-config\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 23 15:15:52.250452 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:52.250445 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5d4352bd-e31e-456f-a171-acb6b1c57bc5-service-ca\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 23 15:15:52.250452 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:52.250455 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdtcl\" (UniqueName: \"kubernetes.io/projected/5d4352bd-e31e-456f-a171-acb6b1c57bc5-kube-api-access-cdtcl\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 23 15:15:52.250682 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:52.250465 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5d4352bd-e31e-456f-a171-acb6b1c57bc5-console-serving-cert\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 23 15:15:52.250682 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:52.250474 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5d4352bd-e31e-456f-a171-acb6b1c57bc5-console-oauth-config\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 23 15:15:52.250682 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:52.250483 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5d4352bd-e31e-456f-a171-acb6b1c57bc5-oauth-serving-cert\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 23 15:15:52.777574 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:52.777536 2582 generic.go:356] "Generic (PLEG): container finished" podID="5d4352bd-e31e-456f-a171-acb6b1c57bc5" containerID="e1279466b4a279938082a5b6ae8b65243b6daadd1900fab18dd20cca6b083eee" exitCode=0 Jul 23 15:15:52.778066 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:52.777584 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fd967b47f-sb2th" Jul 23 15:15:52.778066 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:52.777633 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fd967b47f-sb2th" event={"ID":"5d4352bd-e31e-456f-a171-acb6b1c57bc5","Type":"ContainerDied","Data":"e1279466b4a279938082a5b6ae8b65243b6daadd1900fab18dd20cca6b083eee"} Jul 23 15:15:52.778066 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:52.777699 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fd967b47f-sb2th" event={"ID":"5d4352bd-e31e-456f-a171-acb6b1c57bc5","Type":"ContainerDied","Data":"b95fef638df36c2eeaf9983ef82e63d750aa29b261cfe2d8133fae574944d883"} Jul 23 15:15:52.778066 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:52.777732 2582 scope.go:117] "RemoveContainer" containerID="e1279466b4a279938082a5b6ae8b65243b6daadd1900fab18dd20cca6b083eee" Jul 23 15:15:52.786479 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:52.786462 2582 scope.go:117] "RemoveContainer" containerID="e1279466b4a279938082a5b6ae8b65243b6daadd1900fab18dd20cca6b083eee" Jul 23 15:15:52.786790 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:15:52.786771 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1279466b4a279938082a5b6ae8b65243b6daadd1900fab18dd20cca6b083eee\": container with ID starting with e1279466b4a279938082a5b6ae8b65243b6daadd1900fab18dd20cca6b083eee not found: ID does not exist" containerID="e1279466b4a279938082a5b6ae8b65243b6daadd1900fab18dd20cca6b083eee" Jul 23 15:15:52.786839 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:52.786803 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1279466b4a279938082a5b6ae8b65243b6daadd1900fab18dd20cca6b083eee"} err="failed to get container status \"e1279466b4a279938082a5b6ae8b65243b6daadd1900fab18dd20cca6b083eee\": rpc error: code = NotFound desc = could not find container \"e1279466b4a279938082a5b6ae8b65243b6daadd1900fab18dd20cca6b083eee\": container with ID starting with e1279466b4a279938082a5b6ae8b65243b6daadd1900fab18dd20cca6b083eee not found: ID does not exist" Jul 23 15:15:52.800302 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:52.800271 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fd967b47f-sb2th"] Jul 23 15:15:52.805013 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:52.804984 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5fd967b47f-sb2th"] Jul 23 15:15:53.984071 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:15:53.982010 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d4352bd-e31e-456f-a171-acb6b1c57bc5" path="/var/lib/kubelet/pods/5d4352bd-e31e-456f-a171-acb6b1c57bc5/volumes" Jul 23 15:16:25.103796 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:16:25.103758 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:16:25.214744 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:16:25.214712 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:17:19.758801 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:17:19.758758 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:17:22.299497 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:17:22.299462 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:17:35.497044 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:17:35.497011 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pgrx7_fe195eea-0d32-4761-a885-e953d4460bcc/ovn-acl-logging/0.log" Jul 23 15:17:35.497499 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:17:35.497020 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pgrx7_fe195eea-0d32-4761-a885-e953d4460bcc/ovn-acl-logging/0.log" Jul 23 15:17:35.503127 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:17:35.503108 2582 kubelet.go:1648] "Image garbage collection succeeded" Jul 23 15:18:44.973209 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:18:44.973176 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:19:33.248153 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.248103 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:19:33.366376 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.366335 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:19:33.391067 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.391028 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 15:19:33.391440 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.391426 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d4352bd-e31e-456f-a171-acb6b1c57bc5" containerName="console" Jul 23 15:19:33.391485 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.391444 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d4352bd-e31e-456f-a171-acb6b1c57bc5" containerName="console" Jul 23 15:19:33.391524 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.391513 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d4352bd-e31e-456f-a171-acb6b1c57bc5" containerName="console" Jul 23 15:19:33.394468 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.394450 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.398431 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.398409 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 23 15:19:33.398557 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.398410 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 23 15:19:33.398675 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.398660 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 23 15:19:33.398725 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.398677 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 23 15:19:33.398929 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.398912 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 23 15:19:33.399453 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.399435 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 23 15:19:33.399560 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.399505 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 23 15:19:33.399679 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.399660 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-s5rvf\"" Jul 23 15:19:33.430365 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.430333 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 23 15:19:33.435361 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.435334 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 15:19:33.454320 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.454286 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 23 15:19:33.490718 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.490673 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.490718 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.490713 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.491015 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.490744 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xc559\" (UniqueName: \"kubernetes.io/projected/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-kube-api-access-xc559\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.491015 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.490793 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-tls-assets\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.491015 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.490831 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.491015 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.490876 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.491015 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.490903 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.491015 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.490926 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-config-volume\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.491015 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.490947 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-web-config\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.491015 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.490967 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.491420 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.491021 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.491420 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.491046 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-config-out\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.491420 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.491093 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.592067 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.592033 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-web-config\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.592239 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.592075 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.592239 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.592110 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.592239 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.592143 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-config-out\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.592239 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.592174 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.592239 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.592199 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.592239 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.592228 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.592451 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.592267 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xc559\" (UniqueName: \"kubernetes.io/projected/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-kube-api-access-xc559\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.592451 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.592295 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-tls-assets\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.592451 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.592317 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.592451 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.592342 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.592451 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.592378 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.592451 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.592404 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-config-volume\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.593192 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.593165 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.593480 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.593451 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.595602 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.595308 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-tls-assets\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.595602 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.595380 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.595602 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.595522 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-config-volume\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.595602 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.595550 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-config-out\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.595602 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.595581 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.595966 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.595917 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.595966 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.595950 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.596085 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.596006 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-web-config\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.596237 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.596214 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.597339 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.597317 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.603591 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.603567 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xc559\" (UniqueName: \"kubernetes.io/projected/66a1db0e-42ca-46fe-8b90-4f4c2e77b423-kube-api-access-xc559\") pod \"alertmanager-main-0\" (UID: \"66a1db0e-42ca-46fe-8b90-4f4c2e77b423\") " pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.666708 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.666676 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:19:33.703637 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.703602 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 23 15:19:33.857340 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:33.857263 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 23 15:19:33.860669 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:19:33.860636 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66a1db0e_42ca_46fe_8b90_4f4c2e77b423.slice/crio-05cf09a2571fca53a688a21bd2d8aa973ec2f7850170b498d58947cba79fd5da WatchSource:0}: Error finding container 05cf09a2571fca53a688a21bd2d8aa973ec2f7850170b498d58947cba79fd5da: Status 404 returned error can't find the container with id 05cf09a2571fca53a688a21bd2d8aa973ec2f7850170b498d58947cba79fd5da Jul 23 15:19:34.377227 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.377184 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs"] Jul 23 15:19:34.380209 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.380180 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" Jul 23 15:19:34.383093 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.383068 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 23 15:19:34.383239 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.383116 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7hh4v44hfp6pq\"" Jul 23 15:19:34.383239 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.383129 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 23 15:19:34.383364 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.383244 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-pnrgq\"" Jul 23 15:19:34.383364 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.383258 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 23 15:19:34.383810 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.383796 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 23 15:19:34.383894 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.383826 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 23 15:19:34.399092 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.399064 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2ff224b3-acbe-4a2f-a441-5ff187b38662-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d7bf74d9c-l8rqs\" (UID: \"2ff224b3-acbe-4a2f-a441-5ff187b38662\") " pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" Jul 23 15:19:34.399255 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.399119 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpjmt\" (UniqueName: \"kubernetes.io/projected/2ff224b3-acbe-4a2f-a441-5ff187b38662-kube-api-access-kpjmt\") pod \"thanos-querier-6d7bf74d9c-l8rqs\" (UID: \"2ff224b3-acbe-4a2f-a441-5ff187b38662\") " pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" Jul 23 15:19:34.399255 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.399191 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2ff224b3-acbe-4a2f-a441-5ff187b38662-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d7bf74d9c-l8rqs\" (UID: \"2ff224b3-acbe-4a2f-a441-5ff187b38662\") " pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" Jul 23 15:19:34.399255 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.399222 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2ff224b3-acbe-4a2f-a441-5ff187b38662-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d7bf74d9c-l8rqs\" (UID: \"2ff224b3-acbe-4a2f-a441-5ff187b38662\") " pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" Jul 23 15:19:34.399255 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.399249 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ff224b3-acbe-4a2f-a441-5ff187b38662-metrics-client-ca\") pod \"thanos-querier-6d7bf74d9c-l8rqs\" (UID: \"2ff224b3-acbe-4a2f-a441-5ff187b38662\") " pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" Jul 23 15:19:34.399394 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.399283 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2ff224b3-acbe-4a2f-a441-5ff187b38662-secret-thanos-querier-tls\") pod \"thanos-querier-6d7bf74d9c-l8rqs\" (UID: \"2ff224b3-acbe-4a2f-a441-5ff187b38662\") " pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" Jul 23 15:19:34.399394 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.399323 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2ff224b3-acbe-4a2f-a441-5ff187b38662-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d7bf74d9c-l8rqs\" (UID: \"2ff224b3-acbe-4a2f-a441-5ff187b38662\") " pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" Jul 23 15:19:34.399394 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.399340 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2ff224b3-acbe-4a2f-a441-5ff187b38662-secret-grpc-tls\") pod \"thanos-querier-6d7bf74d9c-l8rqs\" (UID: \"2ff224b3-acbe-4a2f-a441-5ff187b38662\") " pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" Jul 23 15:19:34.404542 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.404519 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs"] Jul 23 15:19:34.500522 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.500479 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpjmt\" (UniqueName: \"kubernetes.io/projected/2ff224b3-acbe-4a2f-a441-5ff187b38662-kube-api-access-kpjmt\") pod \"thanos-querier-6d7bf74d9c-l8rqs\" (UID: \"2ff224b3-acbe-4a2f-a441-5ff187b38662\") " pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" Jul 23 15:19:34.500728 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.500531 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2ff224b3-acbe-4a2f-a441-5ff187b38662-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d7bf74d9c-l8rqs\" (UID: \"2ff224b3-acbe-4a2f-a441-5ff187b38662\") " pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" Jul 23 15:19:34.500728 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.500566 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2ff224b3-acbe-4a2f-a441-5ff187b38662-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d7bf74d9c-l8rqs\" (UID: \"2ff224b3-acbe-4a2f-a441-5ff187b38662\") " pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" Jul 23 15:19:34.500728 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.500599 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ff224b3-acbe-4a2f-a441-5ff187b38662-metrics-client-ca\") pod \"thanos-querier-6d7bf74d9c-l8rqs\" (UID: \"2ff224b3-acbe-4a2f-a441-5ff187b38662\") " pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" Jul 23 15:19:34.500728 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.500632 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2ff224b3-acbe-4a2f-a441-5ff187b38662-secret-thanos-querier-tls\") pod \"thanos-querier-6d7bf74d9c-l8rqs\" (UID: \"2ff224b3-acbe-4a2f-a441-5ff187b38662\") " pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" Jul 23 15:19:34.500728 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.500672 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2ff224b3-acbe-4a2f-a441-5ff187b38662-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d7bf74d9c-l8rqs\" (UID: \"2ff224b3-acbe-4a2f-a441-5ff187b38662\") " pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" Jul 23 15:19:34.500728 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.500694 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2ff224b3-acbe-4a2f-a441-5ff187b38662-secret-grpc-tls\") pod \"thanos-querier-6d7bf74d9c-l8rqs\" (UID: \"2ff224b3-acbe-4a2f-a441-5ff187b38662\") " pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" Jul 23 15:19:34.500728 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.500718 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2ff224b3-acbe-4a2f-a441-5ff187b38662-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d7bf74d9c-l8rqs\" (UID: \"2ff224b3-acbe-4a2f-a441-5ff187b38662\") " pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" Jul 23 15:19:34.501608 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.501578 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2ff224b3-acbe-4a2f-a441-5ff187b38662-metrics-client-ca\") pod \"thanos-querier-6d7bf74d9c-l8rqs\" (UID: \"2ff224b3-acbe-4a2f-a441-5ff187b38662\") " pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" Jul 23 15:19:34.503443 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.503410 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2ff224b3-acbe-4a2f-a441-5ff187b38662-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d7bf74d9c-l8rqs\" (UID: \"2ff224b3-acbe-4a2f-a441-5ff187b38662\") " pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" Jul 23 15:19:34.503572 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.503548 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2ff224b3-acbe-4a2f-a441-5ff187b38662-secret-grpc-tls\") pod \"thanos-querier-6d7bf74d9c-l8rqs\" (UID: \"2ff224b3-acbe-4a2f-a441-5ff187b38662\") " pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" Jul 23 15:19:34.503669 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.503644 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2ff224b3-acbe-4a2f-a441-5ff187b38662-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d7bf74d9c-l8rqs\" (UID: \"2ff224b3-acbe-4a2f-a441-5ff187b38662\") " pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" Jul 23 15:19:34.503746 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.503723 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2ff224b3-acbe-4a2f-a441-5ff187b38662-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d7bf74d9c-l8rqs\" (UID: \"2ff224b3-acbe-4a2f-a441-5ff187b38662\") " pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" Jul 23 15:19:34.503781 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.503761 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2ff224b3-acbe-4a2f-a441-5ff187b38662-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d7bf74d9c-l8rqs\" (UID: \"2ff224b3-acbe-4a2f-a441-5ff187b38662\") " pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" Jul 23 15:19:34.503885 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.503851 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2ff224b3-acbe-4a2f-a441-5ff187b38662-secret-thanos-querier-tls\") pod \"thanos-querier-6d7bf74d9c-l8rqs\" (UID: \"2ff224b3-acbe-4a2f-a441-5ff187b38662\") " pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" Jul 23 15:19:34.509237 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.509219 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpjmt\" (UniqueName: \"kubernetes.io/projected/2ff224b3-acbe-4a2f-a441-5ff187b38662-kube-api-access-kpjmt\") pod \"thanos-querier-6d7bf74d9c-l8rqs\" (UID: \"2ff224b3-acbe-4a2f-a441-5ff187b38662\") " pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" Jul 23 15:19:34.532670 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.532629 2582 generic.go:356] "Generic (PLEG): container finished" podID="66a1db0e-42ca-46fe-8b90-4f4c2e77b423" containerID="b47ba0532a983b4f8939ceb6c8cb7d85af5885e54aadca76cdc6bfd0b12a545e" exitCode=0 Jul 23 15:19:34.532822 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.532717 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66a1db0e-42ca-46fe-8b90-4f4c2e77b423","Type":"ContainerDied","Data":"b47ba0532a983b4f8939ceb6c8cb7d85af5885e54aadca76cdc6bfd0b12a545e"} Jul 23 15:19:34.532822 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.532814 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66a1db0e-42ca-46fe-8b90-4f4c2e77b423","Type":"ContainerStarted","Data":"05cf09a2571fca53a688a21bd2d8aa973ec2f7850170b498d58947cba79fd5da"} Jul 23 15:19:34.534016 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.534000 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 15:19:34.689388 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.689298 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" Jul 23 15:19:34.828216 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:34.828108 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs"] Jul 23 15:19:34.830526 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:19:34.830494 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ff224b3_acbe_4a2f_a441_5ff187b38662.slice/crio-1048620ad19b8a83b0005ee9df7df0d21efc3d517f8ba990c5e1210975fcc0aa WatchSource:0}: Error finding container 1048620ad19b8a83b0005ee9df7df0d21efc3d517f8ba990c5e1210975fcc0aa: Status 404 returned error can't find the container with id 1048620ad19b8a83b0005ee9df7df0d21efc3d517f8ba990c5e1210975fcc0aa Jul 23 15:19:35.230015 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:35.229980 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:19:35.304484 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:35.304450 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:19:35.469163 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:35.469104 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:19:35.537333 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:35.537236 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" event={"ID":"2ff224b3-acbe-4a2f-a441-5ff187b38662","Type":"ContainerStarted","Data":"1048620ad19b8a83b0005ee9df7df0d21efc3d517f8ba990c5e1210975fcc0aa"} Jul 23 15:19:35.677756 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:35.677723 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:19:38.547062 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.547012 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:19:38.553782 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.553736 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 15:19:38.557291 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.557260 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.558119 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.558080 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66a1db0e-42ca-46fe-8b90-4f4c2e77b423","Type":"ContainerStarted","Data":"3bd5bff2b38ed0febe07afe2089f4237a4ffbb84944162ffc7c41210dad8e3e0"} Jul 23 15:19:38.558268 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.558167 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66a1db0e-42ca-46fe-8b90-4f4c2e77b423","Type":"ContainerStarted","Data":"e5182b1eab372a0ef35a6193c017ee5c7ff8d2d9d62e3f0d35d2e1ca36e53a3d"} Jul 23 15:19:38.558268 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.558214 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66a1db0e-42ca-46fe-8b90-4f4c2e77b423","Type":"ContainerStarted","Data":"6d2a30d2e1b4200c67a5def1db8791bd8bff16b39931397a31154575670031bb"} Jul 23 15:19:38.558268 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.558253 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66a1db0e-42ca-46fe-8b90-4f4c2e77b423","Type":"ContainerStarted","Data":"40f0206eaa250f9ed4c435ca072e2663c105e46b951933bf28d4e182fc7599e0"} Jul 23 15:19:38.558427 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.558292 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66a1db0e-42ca-46fe-8b90-4f4c2e77b423","Type":"ContainerStarted","Data":"29d3641b9ab19f77e65300d054adec103d2593e536c8daa8e7c2721b598a6cac"} Jul 23 15:19:38.560765 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.560742 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" event={"ID":"2ff224b3-acbe-4a2f-a441-5ff187b38662","Type":"ContainerStarted","Data":"57b215ff3788ef71ebf9fc5bd7f23dc21c73f32454bff85e589866534d648fbe"} Jul 23 15:19:38.560920 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.560808 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" event={"ID":"2ff224b3-acbe-4a2f-a441-5ff187b38662","Type":"ContainerStarted","Data":"11b45edb4401c754b5e1b18788455e5e34977ebad180ee90c9d8b30664700379"} Jul 23 15:19:38.561006 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.560939 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" event={"ID":"2ff224b3-acbe-4a2f-a441-5ff187b38662","Type":"ContainerStarted","Data":"bcb39bcadf6d8470d31c9340f6a5c1a3394b35042bff259e36f852b2bab2295e"} Jul 23 15:19:38.561059 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.561018 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 23 15:19:38.561161 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.561141 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 23 15:19:38.561240 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.561141 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 23 15:19:38.561298 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.561275 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 23 15:19:38.561356 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.561316 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 23 15:19:38.561579 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.561561 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 23 15:19:38.561691 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.561673 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 23 15:19:38.561826 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.561805 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 23 15:19:38.562363 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.562339 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-868637r9a3869\"" Jul 23 15:19:38.562363 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.562351 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 23 15:19:38.562526 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.562411 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 23 15:19:38.562915 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.562771 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 23 15:19:38.562915 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.562777 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xr9fp\"" Jul 23 15:19:38.563110 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.563093 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 23 15:19:38.565119 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.565097 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 23 15:19:38.567973 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.567950 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 23 15:19:38.576675 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.576649 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 15:19:38.636275 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.636245 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7df3a72f-63aa-4104-ae73-8eb46f3059ff-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.636394 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.636304 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7df3a72f-63aa-4104-ae73-8eb46f3059ff-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.636394 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.636333 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7df3a72f-63aa-4104-ae73-8eb46f3059ff-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.636394 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.636360 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7df3a72f-63aa-4104-ae73-8eb46f3059ff-config-out\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.636394 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.636383 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7df3a72f-63aa-4104-ae73-8eb46f3059ff-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.636590 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.636441 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7df3a72f-63aa-4104-ae73-8eb46f3059ff-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.636590 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.636490 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghhpc\" (UniqueName: \"kubernetes.io/projected/7df3a72f-63aa-4104-ae73-8eb46f3059ff-kube-api-access-ghhpc\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.636590 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.636547 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7df3a72f-63aa-4104-ae73-8eb46f3059ff-config\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.636590 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.636577 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7df3a72f-63aa-4104-ae73-8eb46f3059ff-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.636736 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.636606 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7df3a72f-63aa-4104-ae73-8eb46f3059ff-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.636736 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.636655 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7df3a72f-63aa-4104-ae73-8eb46f3059ff-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.636736 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.636691 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7df3a72f-63aa-4104-ae73-8eb46f3059ff-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.636736 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.636715 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7df3a72f-63aa-4104-ae73-8eb46f3059ff-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.636736 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.636730 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7df3a72f-63aa-4104-ae73-8eb46f3059ff-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.636936 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.636770 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7df3a72f-63aa-4104-ae73-8eb46f3059ff-web-config\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.636936 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.636826 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7df3a72f-63aa-4104-ae73-8eb46f3059ff-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.636936 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.636851 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7df3a72f-63aa-4104-ae73-8eb46f3059ff-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.636936 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.636920 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7df3a72f-63aa-4104-ae73-8eb46f3059ff-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.637065 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.636979 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7df3a72f-63aa-4104-ae73-8eb46f3059ff-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.637065 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.637008 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7df3a72f-63aa-4104-ae73-8eb46f3059ff-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.737613 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.737537 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7df3a72f-63aa-4104-ae73-8eb46f3059ff-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.737613 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.737568 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghhpc\" (UniqueName: \"kubernetes.io/projected/7df3a72f-63aa-4104-ae73-8eb46f3059ff-kube-api-access-ghhpc\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.737613 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.737589 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7df3a72f-63aa-4104-ae73-8eb46f3059ff-config\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.737613 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.737610 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7df3a72f-63aa-4104-ae73-8eb46f3059ff-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.737827 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.737734 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7df3a72f-63aa-4104-ae73-8eb46f3059ff-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.737827 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.737767 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7df3a72f-63aa-4104-ae73-8eb46f3059ff-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.737827 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.737799 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7df3a72f-63aa-4104-ae73-8eb46f3059ff-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.737995 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.737829 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7df3a72f-63aa-4104-ae73-8eb46f3059ff-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.737995 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.737852 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7df3a72f-63aa-4104-ae73-8eb46f3059ff-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.737995 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.737906 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7df3a72f-63aa-4104-ae73-8eb46f3059ff-web-config\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.737995 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.737961 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7df3a72f-63aa-4104-ae73-8eb46f3059ff-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.737995 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.737987 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7df3a72f-63aa-4104-ae73-8eb46f3059ff-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.738245 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.738014 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7df3a72f-63aa-4104-ae73-8eb46f3059ff-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.738245 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.738047 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7df3a72f-63aa-4104-ae73-8eb46f3059ff-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.738245 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.738079 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7df3a72f-63aa-4104-ae73-8eb46f3059ff-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.738245 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.738121 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7df3a72f-63aa-4104-ae73-8eb46f3059ff-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.738245 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.738160 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7df3a72f-63aa-4104-ae73-8eb46f3059ff-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.738245 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.738184 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7df3a72f-63aa-4104-ae73-8eb46f3059ff-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.738245 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.738210 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7df3a72f-63aa-4104-ae73-8eb46f3059ff-config-out\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.738245 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.738219 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7df3a72f-63aa-4104-ae73-8eb46f3059ff-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.738245 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.738239 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7df3a72f-63aa-4104-ae73-8eb46f3059ff-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.738681 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.738638 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7df3a72f-63aa-4104-ae73-8eb46f3059ff-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.739769 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.739427 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7df3a72f-63aa-4104-ae73-8eb46f3059ff-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.741633 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.740581 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7df3a72f-63aa-4104-ae73-8eb46f3059ff-config\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.741633 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.741274 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7df3a72f-63aa-4104-ae73-8eb46f3059ff-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.741633 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.741304 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7df3a72f-63aa-4104-ae73-8eb46f3059ff-web-config\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.741633 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.741318 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7df3a72f-63aa-4104-ae73-8eb46f3059ff-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.741633 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.741358 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7df3a72f-63aa-4104-ae73-8eb46f3059ff-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.741955 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.741645 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7df3a72f-63aa-4104-ae73-8eb46f3059ff-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.741955 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.741790 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7df3a72f-63aa-4104-ae73-8eb46f3059ff-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.742056 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.741960 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7df3a72f-63aa-4104-ae73-8eb46f3059ff-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.742273 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.742249 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7df3a72f-63aa-4104-ae73-8eb46f3059ff-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.743546 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.743519 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7df3a72f-63aa-4104-ae73-8eb46f3059ff-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.743651 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.743560 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7df3a72f-63aa-4104-ae73-8eb46f3059ff-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.743762 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.743740 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7df3a72f-63aa-4104-ae73-8eb46f3059ff-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.745000 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.744783 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7df3a72f-63aa-4104-ae73-8eb46f3059ff-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.745000 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.744962 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7df3a72f-63aa-4104-ae73-8eb46f3059ff-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.745165 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.745139 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7df3a72f-63aa-4104-ae73-8eb46f3059ff-config-out\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.746301 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.746277 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghhpc\" (UniqueName: \"kubernetes.io/projected/7df3a72f-63aa-4104-ae73-8eb46f3059ff-kube-api-access-ghhpc\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.746388 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.746362 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7df3a72f-63aa-4104-ae73-8eb46f3059ff-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7df3a72f-63aa-4104-ae73-8eb46f3059ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:38.870724 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:38.870680 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:39.018152 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:39.018124 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 15:19:39.020046 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:19:39.020007 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7df3a72f_63aa_4104_ae73_8eb46f3059ff.slice/crio-ab42d7fe15bfea4c60d50f6a73d9979f696fceb4bc5cc7e429d7b70e91b02815 WatchSource:0}: Error finding container ab42d7fe15bfea4c60d50f6a73d9979f696fceb4bc5cc7e429d7b70e91b02815: Status 404 returned error can't find the container with id ab42d7fe15bfea4c60d50f6a73d9979f696fceb4bc5cc7e429d7b70e91b02815 Jul 23 15:19:39.565626 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:39.565590 2582 generic.go:356] "Generic (PLEG): container finished" podID="7df3a72f-63aa-4104-ae73-8eb46f3059ff" containerID="5bc2b6d2c975a636734bc5c7044c74b66f16b065aeb151f490eec251633303fb" exitCode=0 Jul 23 15:19:39.566111 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:39.565675 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7df3a72f-63aa-4104-ae73-8eb46f3059ff","Type":"ContainerDied","Data":"5bc2b6d2c975a636734bc5c7044c74b66f16b065aeb151f490eec251633303fb"} Jul 23 15:19:39.566111 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:39.565754 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7df3a72f-63aa-4104-ae73-8eb46f3059ff","Type":"ContainerStarted","Data":"ab42d7fe15bfea4c60d50f6a73d9979f696fceb4bc5cc7e429d7b70e91b02815"} Jul 23 15:19:39.568938 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:39.568807 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" event={"ID":"2ff224b3-acbe-4a2f-a441-5ff187b38662","Type":"ContainerStarted","Data":"e473d4cf8add6e6151f00fdf0539d02fcca7555e8d598cb8cb1c421181403476"} Jul 23 15:19:39.568938 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:39.568907 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" event={"ID":"2ff224b3-acbe-4a2f-a441-5ff187b38662","Type":"ContainerStarted","Data":"ecdf73532a4cb5aea10823b693d6c5d9c8e5eb33ebd51978ad0dd3faa442bec8"} Jul 23 15:19:39.569067 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:39.568963 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" Jul 23 15:19:39.569067 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:39.568996 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" event={"ID":"2ff224b3-acbe-4a2f-a441-5ff187b38662","Type":"ContainerStarted","Data":"bdc2e9f1cb9e3ee005458558e55313f6a74891020368e015f0d0e0ae5d46c539"} Jul 23 15:19:39.572105 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:39.572084 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"66a1db0e-42ca-46fe-8b90-4f4c2e77b423","Type":"ContainerStarted","Data":"f0a311764401b27a48f5cc4dcc7d2632d14b0cc5ed4789f637f90a15856c0673"} Jul 23 15:19:39.626223 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:39.626171 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" podStartSLOduration=2.046733505 podStartE2EDuration="5.626152754s" totalImagesPullingTime="3.579419249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:19:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:19:39.624762101 +0000 UTC m=+424.607062934" watchObservedRunningTime="2026-07-23 15:19:39.626152754 +0000 UTC m=+424.608453583" Jul 23 15:19:39.655725 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:39.655670 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.89277102 podStartE2EDuration="6.655652944s" totalImagesPullingTime="3.746279723s" totalInitContainerRuntime="16.602201ms" isStatefulPod=false podCreationTimestamp="2026-07-23 15:19:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:19:39.653512341 +0000 UTC m=+424.635813191" watchObservedRunningTime="2026-07-23 15:19:39.655652944 +0000 UTC m=+424.637953815" Jul 23 15:19:42.589019 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:42.588986 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7df3a72f-63aa-4104-ae73-8eb46f3059ff","Type":"ContainerStarted","Data":"3b3b8d4737d5338e6d3c5233b1db10e569e524b20cee65770c4875163d096fc5"} Jul 23 15:19:43.599156 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:43.599122 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7df3a72f-63aa-4104-ae73-8eb46f3059ff","Type":"ContainerStarted","Data":"82c6a576d30f390d4e9038b864b84f273a3ae79955c57dff7278bc3c9c51da90"} Jul 23 15:19:43.599571 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:43.599198 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7df3a72f-63aa-4104-ae73-8eb46f3059ff","Type":"ContainerStarted","Data":"a1ee3fc133f202700301d96d4b7e7de961d6c243d409fab3d093f6c584741166"} Jul 23 15:19:43.599571 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:43.599227 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7df3a72f-63aa-4104-ae73-8eb46f3059ff","Type":"ContainerStarted","Data":"00a7532a7f38565f13af414598890107f831be7f83610981636a62a64e6fbb4d"} Jul 23 15:19:43.599571 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:43.599256 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7df3a72f-63aa-4104-ae73-8eb46f3059ff","Type":"ContainerStarted","Data":"e77b8654883dc09ee86dbae02c2959071f910cf52a12ee2530ac31e645cbc885"} Jul 23 15:19:43.599571 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:43.599279 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7df3a72f-63aa-4104-ae73-8eb46f3059ff","Type":"ContainerStarted","Data":"a6b2f59617aa656d9973953ca046327cc3395341103c3edabb7d0f89eb47caec"} Jul 23 15:19:43.650399 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:43.650348 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.716968669 podStartE2EDuration="5.650328162s" totalImagesPullingTime="2.915543696s" totalInitContainerRuntime="17.815797ms" isStatefulPod=false podCreationTimestamp="2026-07-23 15:19:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:19:43.634233572 +0000 UTC m=+428.616534448" watchObservedRunningTime="2026-07-23 15:19:43.650328162 +0000 UTC m=+428.632628992" Jul 23 15:19:43.871572 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:43.871475 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:19:45.583692 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:19:45.583666 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6d7bf74d9c-l8rqs" Jul 23 15:20:38.871740 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:38.871697 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:20:38.891015 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:38.890987 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:20:39.841524 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:39.841498 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 15:20:48.407021 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:48.406989 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:20:49.945984 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:49.945952 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:20:55.833047 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:55.833011 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-685684fbcb-vxvb7"] Jul 23 15:20:55.836324 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:55.836301 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-685684fbcb-vxvb7" Jul 23 15:20:55.849235 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:55.849204 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-685684fbcb-vxvb7"] Jul 23 15:20:55.933241 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:55.933205 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddf326f6-6a25-4d86-b8b9-633c8ecb6031-service-ca\") pod \"console-685684fbcb-vxvb7\" (UID: \"ddf326f6-6a25-4d86-b8b9-633c8ecb6031\") " pod="openshift-console/console-685684fbcb-vxvb7" Jul 23 15:20:55.933241 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:55.933257 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddf326f6-6a25-4d86-b8b9-633c8ecb6031-trusted-ca-bundle\") pod \"console-685684fbcb-vxvb7\" (UID: \"ddf326f6-6a25-4d86-b8b9-633c8ecb6031\") " pod="openshift-console/console-685684fbcb-vxvb7" Jul 23 15:20:55.933515 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:55.933357 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46dmd\" (UniqueName: \"kubernetes.io/projected/ddf326f6-6a25-4d86-b8b9-633c8ecb6031-kube-api-access-46dmd\") pod \"console-685684fbcb-vxvb7\" (UID: \"ddf326f6-6a25-4d86-b8b9-633c8ecb6031\") " pod="openshift-console/console-685684fbcb-vxvb7" Jul 23 15:20:55.933515 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:55.933414 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddf326f6-6a25-4d86-b8b9-633c8ecb6031-console-serving-cert\") pod \"console-685684fbcb-vxvb7\" (UID: \"ddf326f6-6a25-4d86-b8b9-633c8ecb6031\") " pod="openshift-console/console-685684fbcb-vxvb7" Jul 23 15:20:55.933515 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:55.933440 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddf326f6-6a25-4d86-b8b9-633c8ecb6031-oauth-serving-cert\") pod \"console-685684fbcb-vxvb7\" (UID: \"ddf326f6-6a25-4d86-b8b9-633c8ecb6031\") " pod="openshift-console/console-685684fbcb-vxvb7" Jul 23 15:20:55.933515 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:55.933504 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddf326f6-6a25-4d86-b8b9-633c8ecb6031-console-oauth-config\") pod \"console-685684fbcb-vxvb7\" (UID: \"ddf326f6-6a25-4d86-b8b9-633c8ecb6031\") " pod="openshift-console/console-685684fbcb-vxvb7" Jul 23 15:20:55.933694 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:55.933538 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddf326f6-6a25-4d86-b8b9-633c8ecb6031-console-config\") pod \"console-685684fbcb-vxvb7\" (UID: \"ddf326f6-6a25-4d86-b8b9-633c8ecb6031\") " pod="openshift-console/console-685684fbcb-vxvb7" Jul 23 15:20:55.955945 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:55.955910 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:20:56.022307 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:56.022272 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:20:56.034982 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:56.034948 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46dmd\" (UniqueName: \"kubernetes.io/projected/ddf326f6-6a25-4d86-b8b9-633c8ecb6031-kube-api-access-46dmd\") pod \"console-685684fbcb-vxvb7\" (UID: \"ddf326f6-6a25-4d86-b8b9-633c8ecb6031\") " pod="openshift-console/console-685684fbcb-vxvb7" Jul 23 15:20:56.035089 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:56.034999 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddf326f6-6a25-4d86-b8b9-633c8ecb6031-console-serving-cert\") pod \"console-685684fbcb-vxvb7\" (UID: \"ddf326f6-6a25-4d86-b8b9-633c8ecb6031\") " pod="openshift-console/console-685684fbcb-vxvb7" Jul 23 15:20:56.035089 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:56.035018 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddf326f6-6a25-4d86-b8b9-633c8ecb6031-oauth-serving-cert\") pod \"console-685684fbcb-vxvb7\" (UID: \"ddf326f6-6a25-4d86-b8b9-633c8ecb6031\") " pod="openshift-console/console-685684fbcb-vxvb7" Jul 23 15:20:56.035089 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:56.035049 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddf326f6-6a25-4d86-b8b9-633c8ecb6031-console-oauth-config\") pod \"console-685684fbcb-vxvb7\" (UID: \"ddf326f6-6a25-4d86-b8b9-633c8ecb6031\") " pod="openshift-console/console-685684fbcb-vxvb7" Jul 23 15:20:56.035239 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:56.035087 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddf326f6-6a25-4d86-b8b9-633c8ecb6031-console-config\") pod \"console-685684fbcb-vxvb7\" (UID: \"ddf326f6-6a25-4d86-b8b9-633c8ecb6031\") " pod="openshift-console/console-685684fbcb-vxvb7" Jul 23 15:20:56.035239 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:56.035140 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddf326f6-6a25-4d86-b8b9-633c8ecb6031-service-ca\") pod \"console-685684fbcb-vxvb7\" (UID: \"ddf326f6-6a25-4d86-b8b9-633c8ecb6031\") " pod="openshift-console/console-685684fbcb-vxvb7" Jul 23 15:20:56.035239 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:56.035199 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddf326f6-6a25-4d86-b8b9-633c8ecb6031-trusted-ca-bundle\") pod \"console-685684fbcb-vxvb7\" (UID: \"ddf326f6-6a25-4d86-b8b9-633c8ecb6031\") " pod="openshift-console/console-685684fbcb-vxvb7" Jul 23 15:20:56.035935 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:56.035905 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ddf326f6-6a25-4d86-b8b9-633c8ecb6031-oauth-serving-cert\") pod \"console-685684fbcb-vxvb7\" (UID: \"ddf326f6-6a25-4d86-b8b9-633c8ecb6031\") " pod="openshift-console/console-685684fbcb-vxvb7" Jul 23 15:20:56.036067 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:56.036013 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ddf326f6-6a25-4d86-b8b9-633c8ecb6031-service-ca\") pod \"console-685684fbcb-vxvb7\" (UID: \"ddf326f6-6a25-4d86-b8b9-633c8ecb6031\") " pod="openshift-console/console-685684fbcb-vxvb7" Jul 23 15:20:56.036133 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:56.036094 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ddf326f6-6a25-4d86-b8b9-633c8ecb6031-console-config\") pod \"console-685684fbcb-vxvb7\" (UID: \"ddf326f6-6a25-4d86-b8b9-633c8ecb6031\") " pod="openshift-console/console-685684fbcb-vxvb7" Jul 23 15:20:56.036277 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:56.036255 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddf326f6-6a25-4d86-b8b9-633c8ecb6031-trusted-ca-bundle\") pod \"console-685684fbcb-vxvb7\" (UID: \"ddf326f6-6a25-4d86-b8b9-633c8ecb6031\") " pod="openshift-console/console-685684fbcb-vxvb7" Jul 23 15:20:56.037651 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:56.037630 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ddf326f6-6a25-4d86-b8b9-633c8ecb6031-console-oauth-config\") pod \"console-685684fbcb-vxvb7\" (UID: \"ddf326f6-6a25-4d86-b8b9-633c8ecb6031\") " pod="openshift-console/console-685684fbcb-vxvb7" Jul 23 15:20:56.037890 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:56.037871 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ddf326f6-6a25-4d86-b8b9-633c8ecb6031-console-serving-cert\") pod \"console-685684fbcb-vxvb7\" (UID: \"ddf326f6-6a25-4d86-b8b9-633c8ecb6031\") " pod="openshift-console/console-685684fbcb-vxvb7" Jul 23 15:20:56.045907 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:56.045879 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46dmd\" (UniqueName: \"kubernetes.io/projected/ddf326f6-6a25-4d86-b8b9-633c8ecb6031-kube-api-access-46dmd\") pod \"console-685684fbcb-vxvb7\" (UID: \"ddf326f6-6a25-4d86-b8b9-633c8ecb6031\") " pod="openshift-console/console-685684fbcb-vxvb7" Jul 23 15:20:56.145700 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:56.145604 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-685684fbcb-vxvb7" Jul 23 15:20:56.285090 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:56.285056 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-685684fbcb-vxvb7"] Jul 23 15:20:56.288488 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:20:56.288460 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddf326f6_6a25_4d86_b8b9_633c8ecb6031.slice/crio-af3fe85d3134610e1844a20cb2caf2ed2e0bb9ae8bf57384eaf4a05ae37eb106 WatchSource:0}: Error finding container af3fe85d3134610e1844a20cb2caf2ed2e0bb9ae8bf57384eaf4a05ae37eb106: Status 404 returned error can't find the container with id af3fe85d3134610e1844a20cb2caf2ed2e0bb9ae8bf57384eaf4a05ae37eb106 Jul 23 15:20:56.897572 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:56.897531 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-685684fbcb-vxvb7" event={"ID":"ddf326f6-6a25-4d86-b8b9-633c8ecb6031","Type":"ContainerStarted","Data":"540a1dea6a27ed586a06383ad08da3a67bfe2d66da234252812f3442c70a73d7"} Jul 23 15:20:56.897572 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:56.897578 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-685684fbcb-vxvb7" event={"ID":"ddf326f6-6a25-4d86-b8b9-633c8ecb6031","Type":"ContainerStarted","Data":"af3fe85d3134610e1844a20cb2caf2ed2e0bb9ae8bf57384eaf4a05ae37eb106"} Jul 23 15:20:56.919354 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:20:56.919275 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-685684fbcb-vxvb7" podStartSLOduration=1.919258412 podStartE2EDuration="1.919258412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:20:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:20:56.918674429 +0000 UTC m=+501.900975260" watchObservedRunningTime="2026-07-23 15:20:56.919258412 +0000 UTC m=+501.901559243" Jul 23 15:21:00.330750 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:00.330717 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:21:00.430734 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:00.430700 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:21:06.145771 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:06.145738 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-685684fbcb-vxvb7" Jul 23 15:21:06.146259 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:06.145808 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-685684fbcb-vxvb7" Jul 23 15:21:06.150828 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:06.150797 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-685684fbcb-vxvb7" Jul 23 15:21:06.940185 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:06.940156 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-685684fbcb-vxvb7" Jul 23 15:21:06.992234 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:06.992198 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5664d54f56-bvld9"] Jul 23 15:21:07.108726 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:07.108687 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:21:07.211649 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:07.211565 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:21:07.309457 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:07.309427 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:21:15.301067 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:15.301030 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:21:15.398753 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:15.398717 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:21:32.014204 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:32.014145 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5664d54f56-bvld9" podUID="c0503714-a698-4b89-9b8e-553f211ca1e4" containerName="console" containerID="cri-o://5b1ea1edddcbd64eaed516d5ec4af6a92142d66d7f6cb8ad06d5f6edd8b9d7c5" gracePeriod=15 Jul 23 15:21:32.258028 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:32.258004 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5664d54f56-bvld9" Jul 23 15:21:32.354295 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:32.354260 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0503714-a698-4b89-9b8e-553f211ca1e4-trusted-ca-bundle\") pod \"c0503714-a698-4b89-9b8e-553f211ca1e4\" (UID: \"c0503714-a698-4b89-9b8e-553f211ca1e4\") " Jul 23 15:21:32.354471 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:32.354305 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0503714-a698-4b89-9b8e-553f211ca1e4-console-config\") pod \"c0503714-a698-4b89-9b8e-553f211ca1e4\" (UID: \"c0503714-a698-4b89-9b8e-553f211ca1e4\") " Jul 23 15:21:32.354471 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:32.354321 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0503714-a698-4b89-9b8e-553f211ca1e4-service-ca\") pod \"c0503714-a698-4b89-9b8e-553f211ca1e4\" (UID: \"c0503714-a698-4b89-9b8e-553f211ca1e4\") " Jul 23 15:21:32.354471 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:32.354365 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0503714-a698-4b89-9b8e-553f211ca1e4-oauth-serving-cert\") pod \"c0503714-a698-4b89-9b8e-553f211ca1e4\" (UID: \"c0503714-a698-4b89-9b8e-553f211ca1e4\") " Jul 23 15:21:32.354617 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:32.354467 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0503714-a698-4b89-9b8e-553f211ca1e4-console-oauth-config\") pod \"c0503714-a698-4b89-9b8e-553f211ca1e4\" (UID: \"c0503714-a698-4b89-9b8e-553f211ca1e4\") " Jul 23 15:21:32.354617 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:32.354545 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqqt4\" (UniqueName: \"kubernetes.io/projected/c0503714-a698-4b89-9b8e-553f211ca1e4-kube-api-access-lqqt4\") pod \"c0503714-a698-4b89-9b8e-553f211ca1e4\" (UID: \"c0503714-a698-4b89-9b8e-553f211ca1e4\") " Jul 23 15:21:32.354617 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:32.354591 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0503714-a698-4b89-9b8e-553f211ca1e4-console-serving-cert\") pod \"c0503714-a698-4b89-9b8e-553f211ca1e4\" (UID: \"c0503714-a698-4b89-9b8e-553f211ca1e4\") " Jul 23 15:21:32.354801 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:32.354762 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0503714-a698-4b89-9b8e-553f211ca1e4-console-config" (OuterVolumeSpecName: "console-config") pod "c0503714-a698-4b89-9b8e-553f211ca1e4" (UID: "c0503714-a698-4b89-9b8e-553f211ca1e4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 15:21:32.354801 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:32.354779 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0503714-a698-4b89-9b8e-553f211ca1e4-service-ca" (OuterVolumeSpecName: "service-ca") pod "c0503714-a698-4b89-9b8e-553f211ca1e4" (UID: "c0503714-a698-4b89-9b8e-553f211ca1e4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 15:21:32.354801 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:32.354789 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0503714-a698-4b89-9b8e-553f211ca1e4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c0503714-a698-4b89-9b8e-553f211ca1e4" (UID: "c0503714-a698-4b89-9b8e-553f211ca1e4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 15:21:32.354801 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:32.354798 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c0503714-a698-4b89-9b8e-553f211ca1e4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c0503714-a698-4b89-9b8e-553f211ca1e4" (UID: "c0503714-a698-4b89-9b8e-553f211ca1e4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 15:21:32.355047 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:32.354923 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0503714-a698-4b89-9b8e-553f211ca1e4-trusted-ca-bundle\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 23 15:21:32.355047 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:32.354936 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c0503714-a698-4b89-9b8e-553f211ca1e4-console-config\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 23 15:21:32.355047 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:32.354946 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c0503714-a698-4b89-9b8e-553f211ca1e4-service-ca\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 23 15:21:32.355047 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:32.354953 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c0503714-a698-4b89-9b8e-553f211ca1e4-oauth-serving-cert\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 23 15:21:32.356691 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:32.356656 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0503714-a698-4b89-9b8e-553f211ca1e4-kube-api-access-lqqt4" (OuterVolumeSpecName: "kube-api-access-lqqt4") pod "c0503714-a698-4b89-9b8e-553f211ca1e4" (UID: "c0503714-a698-4b89-9b8e-553f211ca1e4"). InnerVolumeSpecName "kube-api-access-lqqt4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 15:21:32.356691 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:32.356661 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0503714-a698-4b89-9b8e-553f211ca1e4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c0503714-a698-4b89-9b8e-553f211ca1e4" (UID: "c0503714-a698-4b89-9b8e-553f211ca1e4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 15:21:32.357009 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:32.356735 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c0503714-a698-4b89-9b8e-553f211ca1e4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c0503714-a698-4b89-9b8e-553f211ca1e4" (UID: "c0503714-a698-4b89-9b8e-553f211ca1e4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 15:21:32.455852 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:32.455811 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqqt4\" (UniqueName: \"kubernetes.io/projected/c0503714-a698-4b89-9b8e-553f211ca1e4-kube-api-access-lqqt4\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 23 15:21:32.455852 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:32.455844 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c0503714-a698-4b89-9b8e-553f211ca1e4-console-serving-cert\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 23 15:21:32.456057 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:32.455882 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c0503714-a698-4b89-9b8e-553f211ca1e4-console-oauth-config\") on node \"ip-10-0-128-213.ec2.internal\" DevicePath \"\"" Jul 23 15:21:33.040553 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:33.040518 2582 generic.go:356] "Generic (PLEG): container finished" podID="c0503714-a698-4b89-9b8e-553f211ca1e4" containerID="5b1ea1edddcbd64eaed516d5ec4af6a92142d66d7f6cb8ad06d5f6edd8b9d7c5" exitCode=0 Jul 23 15:21:33.040973 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:33.040565 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5664d54f56-bvld9" Jul 23 15:21:33.040973 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:33.040600 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5664d54f56-bvld9" event={"ID":"c0503714-a698-4b89-9b8e-553f211ca1e4","Type":"ContainerDied","Data":"5b1ea1edddcbd64eaed516d5ec4af6a92142d66d7f6cb8ad06d5f6edd8b9d7c5"} Jul 23 15:21:33.040973 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:33.040647 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5664d54f56-bvld9" event={"ID":"c0503714-a698-4b89-9b8e-553f211ca1e4","Type":"ContainerDied","Data":"45e37f707e910d0c140b7d1896a334d80dea8126b91f652a4e9d6f01221682e3"} Jul 23 15:21:33.040973 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:33.040668 2582 scope.go:117] "RemoveContainer" containerID="5b1ea1edddcbd64eaed516d5ec4af6a92142d66d7f6cb8ad06d5f6edd8b9d7c5" Jul 23 15:21:33.050448 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:33.050429 2582 scope.go:117] "RemoveContainer" containerID="5b1ea1edddcbd64eaed516d5ec4af6a92142d66d7f6cb8ad06d5f6edd8b9d7c5" Jul 23 15:21:33.050733 ip-10-0-128-213 kubenswrapper[2582]: E0723 15:21:33.050713 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b1ea1edddcbd64eaed516d5ec4af6a92142d66d7f6cb8ad06d5f6edd8b9d7c5\": container with ID starting with 5b1ea1edddcbd64eaed516d5ec4af6a92142d66d7f6cb8ad06d5f6edd8b9d7c5 not found: ID does not exist" containerID="5b1ea1edddcbd64eaed516d5ec4af6a92142d66d7f6cb8ad06d5f6edd8b9d7c5" Jul 23 15:21:33.050775 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:33.050744 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b1ea1edddcbd64eaed516d5ec4af6a92142d66d7f6cb8ad06d5f6edd8b9d7c5"} err="failed to get container status \"5b1ea1edddcbd64eaed516d5ec4af6a92142d66d7f6cb8ad06d5f6edd8b9d7c5\": rpc error: code = NotFound desc = could not find container \"5b1ea1edddcbd64eaed516d5ec4af6a92142d66d7f6cb8ad06d5f6edd8b9d7c5\": container with ID starting with 5b1ea1edddcbd64eaed516d5ec4af6a92142d66d7f6cb8ad06d5f6edd8b9d7c5 not found: ID does not exist" Jul 23 15:21:33.063038 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:33.063011 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5664d54f56-bvld9"] Jul 23 15:21:33.067014 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:33.066988 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5664d54f56-bvld9"] Jul 23 15:21:33.985945 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:33.985916 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0503714-a698-4b89-9b8e-553f211ca1e4" path="/var/lib/kubelet/pods/c0503714-a698-4b89-9b8e-553f211ca1e4/volumes" Jul 23 15:21:38.935082 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:38.935044 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:21:39.125172 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:21:39.125133 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:00.678374 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:00.678331 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:01.706777 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:01.706736 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:04.329624 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:04.329590 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:04.868950 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:04.868916 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:05.776943 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:05.776904 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:05.878977 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:05.878935 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:05.996036 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:05.996007 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:06.113268 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:06.113214 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:08.543301 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:08.543264 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:09.138673 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:09.138638 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:11.096151 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:11.096102 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:11.196722 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:11.196674 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:14.519172 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:14.519124 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:14.584633 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:14.584601 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:15.943835 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:15.943788 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:16.373435 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:16.373400 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-q2ln2"] Jul 23 15:22:16.373741 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:16.373730 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0503714-a698-4b89-9b8e-553f211ca1e4" containerName="console" Jul 23 15:22:16.373784 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:16.373743 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0503714-a698-4b89-9b8e-553f211ca1e4" containerName="console" Jul 23 15:22:16.373817 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:16.373807 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0503714-a698-4b89-9b8e-553f211ca1e4" containerName="console" Jul 23 15:22:16.375841 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:16.375821 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-q2ln2" Jul 23 15:22:16.378522 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:16.378497 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 23 15:22:16.378639 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:16.378497 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 23 15:22:16.379541 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:16.379524 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-t6jsz\"" Jul 23 15:22:16.387653 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:16.387630 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-q2ln2"] Jul 23 15:22:16.447578 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:16.447539 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca5e3c33-d15b-4c85-8be7-67e2bc6ceaa1-bound-sa-token\") pod \"cert-manager-55b4d954d5-q2ln2\" (UID: \"ca5e3c33-d15b-4c85-8be7-67e2bc6ceaa1\") " pod="cert-manager/cert-manager-55b4d954d5-q2ln2" Jul 23 15:22:16.447753 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:16.447590 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9xkm\" (UniqueName: \"kubernetes.io/projected/ca5e3c33-d15b-4c85-8be7-67e2bc6ceaa1-kube-api-access-f9xkm\") pod \"cert-manager-55b4d954d5-q2ln2\" (UID: \"ca5e3c33-d15b-4c85-8be7-67e2bc6ceaa1\") " pod="cert-manager/cert-manager-55b4d954d5-q2ln2" Jul 23 15:22:16.521476 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:16.521438 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bzm9m"] Jul 23 15:22:16.524450 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:16.524433 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bzm9m" Jul 23 15:22:16.527190 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:16.527168 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 23 15:22:16.527311 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:16.527292 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-lhhxc\"" Jul 23 15:22:16.527385 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:16.527292 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 23 15:22:16.535890 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:16.535840 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bzm9m"] Jul 23 15:22:16.548425 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:16.548386 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca5e3c33-d15b-4c85-8be7-67e2bc6ceaa1-bound-sa-token\") pod \"cert-manager-55b4d954d5-q2ln2\" (UID: \"ca5e3c33-d15b-4c85-8be7-67e2bc6ceaa1\") " pod="cert-manager/cert-manager-55b4d954d5-q2ln2" Jul 23 15:22:16.548425 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:16.548430 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9xkm\" (UniqueName: \"kubernetes.io/projected/ca5e3c33-d15b-4c85-8be7-67e2bc6ceaa1-kube-api-access-f9xkm\") pod \"cert-manager-55b4d954d5-q2ln2\" (UID: \"ca5e3c33-d15b-4c85-8be7-67e2bc6ceaa1\") " pod="cert-manager/cert-manager-55b4d954d5-q2ln2" Jul 23 15:22:16.557334 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:16.557302 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9xkm\" (UniqueName: \"kubernetes.io/projected/ca5e3c33-d15b-4c85-8be7-67e2bc6ceaa1-kube-api-access-f9xkm\") pod \"cert-manager-55b4d954d5-q2ln2\" (UID: \"ca5e3c33-d15b-4c85-8be7-67e2bc6ceaa1\") " pod="cert-manager/cert-manager-55b4d954d5-q2ln2" Jul 23 15:22:16.557566 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:16.557547 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ca5e3c33-d15b-4c85-8be7-67e2bc6ceaa1-bound-sa-token\") pod \"cert-manager-55b4d954d5-q2ln2\" (UID: \"ca5e3c33-d15b-4c85-8be7-67e2bc6ceaa1\") " pod="cert-manager/cert-manager-55b4d954d5-q2ln2" Jul 23 15:22:16.648982 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:16.648889 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82mbt\" (UniqueName: \"kubernetes.io/projected/f6c6bf79-547e-451a-bc58-fd45f71acdef-kube-api-access-82mbt\") pod \"openshift-lws-operator-fd8ccff4c-bzm9m\" (UID: \"f6c6bf79-547e-451a-bc58-fd45f71acdef\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bzm9m" Jul 23 15:22:16.648982 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:16.648944 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6c6bf79-547e-451a-bc58-fd45f71acdef-tmp\") pod \"openshift-lws-operator-fd8ccff4c-bzm9m\" (UID: \"f6c6bf79-547e-451a-bc58-fd45f71acdef\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bzm9m" Jul 23 15:22:16.695981 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:16.695936 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-q2ln2" Jul 23 15:22:16.749403 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:16.749376 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82mbt\" (UniqueName: \"kubernetes.io/projected/f6c6bf79-547e-451a-bc58-fd45f71acdef-kube-api-access-82mbt\") pod \"openshift-lws-operator-fd8ccff4c-bzm9m\" (UID: \"f6c6bf79-547e-451a-bc58-fd45f71acdef\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bzm9m" Jul 23 15:22:16.749516 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:16.749422 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6c6bf79-547e-451a-bc58-fd45f71acdef-tmp\") pod \"openshift-lws-operator-fd8ccff4c-bzm9m\" (UID: \"f6c6bf79-547e-451a-bc58-fd45f71acdef\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bzm9m" Jul 23 15:22:16.749780 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:16.749763 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6c6bf79-547e-451a-bc58-fd45f71acdef-tmp\") pod \"openshift-lws-operator-fd8ccff4c-bzm9m\" (UID: \"f6c6bf79-547e-451a-bc58-fd45f71acdef\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bzm9m" Jul 23 15:22:16.760708 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:16.760642 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82mbt\" (UniqueName: \"kubernetes.io/projected/f6c6bf79-547e-451a-bc58-fd45f71acdef-kube-api-access-82mbt\") pod \"openshift-lws-operator-fd8ccff4c-bzm9m\" (UID: \"f6c6bf79-547e-451a-bc58-fd45f71acdef\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bzm9m" Jul 23 15:22:16.829896 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:16.829847 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-q2ln2"] Jul 23 15:22:16.831940 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:22:16.831913 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca5e3c33_d15b_4c85_8be7_67e2bc6ceaa1.slice/crio-a1aed51f28c84e83fb3b06b9e6bc811566706a11bfd9ead7b1d71a1c114631f4 WatchSource:0}: Error finding container a1aed51f28c84e83fb3b06b9e6bc811566706a11bfd9ead7b1d71a1c114631f4: Status 404 returned error can't find the container with id a1aed51f28c84e83fb3b06b9e6bc811566706a11bfd9ead7b1d71a1c114631f4 Jul 23 15:22:16.833299 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:16.833282 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bzm9m" Jul 23 15:22:16.971662 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:16.971637 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bzm9m"] Jul 23 15:22:16.974184 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:22:16.974155 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf6c6bf79_547e_451a_bc58_fd45f71acdef.slice/crio-d0bd71812e19e64d8da700aa59d6a415b95814a68381d35eb681d5d71702c8b6 WatchSource:0}: Error finding container d0bd71812e19e64d8da700aa59d6a415b95814a68381d35eb681d5d71702c8b6: Status 404 returned error can't find the container with id d0bd71812e19e64d8da700aa59d6a415b95814a68381d35eb681d5d71702c8b6 Jul 23 15:22:17.234573 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:17.234473 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-q2ln2" event={"ID":"ca5e3c33-d15b-4c85-8be7-67e2bc6ceaa1","Type":"ContainerStarted","Data":"a1aed51f28c84e83fb3b06b9e6bc811566706a11bfd9ead7b1d71a1c114631f4"} Jul 23 15:22:17.235696 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:17.235664 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bzm9m" event={"ID":"f6c6bf79-547e-451a-bc58-fd45f71acdef","Type":"ContainerStarted","Data":"d0bd71812e19e64d8da700aa59d6a415b95814a68381d35eb681d5d71702c8b6"} Jul 23 15:22:22.264098 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:22.264060 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bzm9m" event={"ID":"f6c6bf79-547e-451a-bc58-fd45f71acdef","Type":"ContainerStarted","Data":"aa5c1422838f99269ed69b4d28600ca5272af3d94ea622ac654ccab603592228"} Jul 23 15:22:22.265620 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:22.265595 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-q2ln2" event={"ID":"ca5e3c33-d15b-4c85-8be7-67e2bc6ceaa1","Type":"ContainerStarted","Data":"88a1779953420f1a4ec09acf22ae07cef2129ec417fbeb4c765915604f0392b9"} Jul 23 15:22:22.280844 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:22.280789 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bzm9m" podStartSLOduration=2.033142404 podStartE2EDuration="6.280768361s" totalImagesPullingTime="4.247625957s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:22:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:22:22.280218767 +0000 UTC m=+587.262519598" watchObservedRunningTime="2026-07-23 15:22:22.280768361 +0000 UTC m=+587.263069171" Jul 23 15:22:22.297320 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:22.297265 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-q2ln2" podStartSLOduration=1.9171660510000001 podStartE2EDuration="6.29724776s" totalImagesPullingTime="4.380081709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:22:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:22:22.296808948 +0000 UTC m=+587.279109782" watchObservedRunningTime="2026-07-23 15:22:22.29724776 +0000 UTC m=+587.279548591" Jul 23 15:22:22.982052 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:22.982016 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:23.080601 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:23.080566 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:24.929577 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:24.929535 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:29.313197 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:29.313161 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:35.530546 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:35.530515 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pgrx7_fe195eea-0d32-4761-a885-e953d4460bcc/ovn-acl-logging/0.log" Jul 23 15:22:35.531312 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:35.530989 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pgrx7_fe195eea-0d32-4761-a885-e953d4460bcc/ovn-acl-logging/0.log" Jul 23 15:22:36.580630 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:36.580593 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:36.711131 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:36.711097 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:37.212420 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:37.212389 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:37.415908 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:37.415847 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:37.544330 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:37.544250 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:37.677350 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:37.677314 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-777bc59866-lgl4h"] Jul 23 15:22:37.684718 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:37.684691 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-777bc59866-lgl4h" Jul 23 15:22:37.688931 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:37.688908 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 23 15:22:37.693007 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:37.692988 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 23 15:22:37.693460 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:37.693445 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 23 15:22:37.694261 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:37.694240 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-g8kmd\"" Jul 23 15:22:37.694620 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:37.694603 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 23 15:22:37.702458 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:37.702434 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-777bc59866-lgl4h"] Jul 23 15:22:37.741435 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:37.741394 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc43f416-946a-46c5-a52c-17eb54e0726f-webhook-cert\") pod \"opendatahub-operator-controller-manager-777bc59866-lgl4h\" (UID: \"fc43f416-946a-46c5-a52c-17eb54e0726f\") " pod="opendatahub/opendatahub-operator-controller-manager-777bc59866-lgl4h" Jul 23 15:22:37.741435 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:37.741442 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fc43f416-946a-46c5-a52c-17eb54e0726f-manifests\") pod \"opendatahub-operator-controller-manager-777bc59866-lgl4h\" (UID: \"fc43f416-946a-46c5-a52c-17eb54e0726f\") " pod="opendatahub/opendatahub-operator-controller-manager-777bc59866-lgl4h" Jul 23 15:22:37.741698 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:37.741461 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fc43f416-946a-46c5-a52c-17eb54e0726f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-777bc59866-lgl4h\" (UID: \"fc43f416-946a-46c5-a52c-17eb54e0726f\") " pod="opendatahub/opendatahub-operator-controller-manager-777bc59866-lgl4h" Jul 23 15:22:37.741698 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:37.741540 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l5mv\" (UniqueName: \"kubernetes.io/projected/fc43f416-946a-46c5-a52c-17eb54e0726f-kube-api-access-5l5mv\") pod \"opendatahub-operator-controller-manager-777bc59866-lgl4h\" (UID: \"fc43f416-946a-46c5-a52c-17eb54e0726f\") " pod="opendatahub/opendatahub-operator-controller-manager-777bc59866-lgl4h" Jul 23 15:22:37.741698 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:37.741573 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc43f416-946a-46c5-a52c-17eb54e0726f-tmp\") pod \"opendatahub-operator-controller-manager-777bc59866-lgl4h\" (UID: \"fc43f416-946a-46c5-a52c-17eb54e0726f\") " pod="opendatahub/opendatahub-operator-controller-manager-777bc59866-lgl4h" Jul 23 15:22:37.842593 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:37.842550 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc43f416-946a-46c5-a52c-17eb54e0726f-webhook-cert\") pod \"opendatahub-operator-controller-manager-777bc59866-lgl4h\" (UID: \"fc43f416-946a-46c5-a52c-17eb54e0726f\") " pod="opendatahub/opendatahub-operator-controller-manager-777bc59866-lgl4h" Jul 23 15:22:37.842773 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:37.842607 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fc43f416-946a-46c5-a52c-17eb54e0726f-manifests\") pod \"opendatahub-operator-controller-manager-777bc59866-lgl4h\" (UID: \"fc43f416-946a-46c5-a52c-17eb54e0726f\") " pod="opendatahub/opendatahub-operator-controller-manager-777bc59866-lgl4h" Jul 23 15:22:37.842773 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:37.842725 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fc43f416-946a-46c5-a52c-17eb54e0726f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-777bc59866-lgl4h\" (UID: \"fc43f416-946a-46c5-a52c-17eb54e0726f\") " pod="opendatahub/opendatahub-operator-controller-manager-777bc59866-lgl4h" Jul 23 15:22:37.842948 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:37.842927 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l5mv\" (UniqueName: \"kubernetes.io/projected/fc43f416-946a-46c5-a52c-17eb54e0726f-kube-api-access-5l5mv\") pod \"opendatahub-operator-controller-manager-777bc59866-lgl4h\" (UID: \"fc43f416-946a-46c5-a52c-17eb54e0726f\") " pod="opendatahub/opendatahub-operator-controller-manager-777bc59866-lgl4h" Jul 23 15:22:37.843007 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:37.842962 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fc43f416-946a-46c5-a52c-17eb54e0726f-manifests\") pod \"opendatahub-operator-controller-manager-777bc59866-lgl4h\" (UID: \"fc43f416-946a-46c5-a52c-17eb54e0726f\") " pod="opendatahub/opendatahub-operator-controller-manager-777bc59866-lgl4h" Jul 23 15:22:37.843007 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:37.842989 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc43f416-946a-46c5-a52c-17eb54e0726f-tmp\") pod \"opendatahub-operator-controller-manager-777bc59866-lgl4h\" (UID: \"fc43f416-946a-46c5-a52c-17eb54e0726f\") " pod="opendatahub/opendatahub-operator-controller-manager-777bc59866-lgl4h" Jul 23 15:22:37.845201 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:37.845167 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc43f416-946a-46c5-a52c-17eb54e0726f-tmp\") pod \"opendatahub-operator-controller-manager-777bc59866-lgl4h\" (UID: \"fc43f416-946a-46c5-a52c-17eb54e0726f\") " pod="opendatahub/opendatahub-operator-controller-manager-777bc59866-lgl4h" Jul 23 15:22:37.845347 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:37.845327 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fc43f416-946a-46c5-a52c-17eb54e0726f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-777bc59866-lgl4h\" (UID: \"fc43f416-946a-46c5-a52c-17eb54e0726f\") " pod="opendatahub/opendatahub-operator-controller-manager-777bc59866-lgl4h" Jul 23 15:22:37.845393 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:37.845372 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc43f416-946a-46c5-a52c-17eb54e0726f-webhook-cert\") pod \"opendatahub-operator-controller-manager-777bc59866-lgl4h\" (UID: \"fc43f416-946a-46c5-a52c-17eb54e0726f\") " pod="opendatahub/opendatahub-operator-controller-manager-777bc59866-lgl4h" Jul 23 15:22:37.872785 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:37.872745 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l5mv\" (UniqueName: \"kubernetes.io/projected/fc43f416-946a-46c5-a52c-17eb54e0726f-kube-api-access-5l5mv\") pod \"opendatahub-operator-controller-manager-777bc59866-lgl4h\" (UID: \"fc43f416-946a-46c5-a52c-17eb54e0726f\") " pod="opendatahub/opendatahub-operator-controller-manager-777bc59866-lgl4h" Jul 23 15:22:37.917321 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:37.917287 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:37.995349 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:37.995300 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-777bc59866-lgl4h" Jul 23 15:22:38.052311 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:38.052266 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:38.171595 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:38.171571 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-777bc59866-lgl4h"] Jul 23 15:22:38.173933 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:22:38.173903 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc43f416_946a_46c5_a52c_17eb54e0726f.slice/crio-aebaab5b7e9c5c14696045859b89e75c9a11d63b9193462edfa231be530bc318 WatchSource:0}: Error finding container aebaab5b7e9c5c14696045859b89e75c9a11d63b9193462edfa231be530bc318: Status 404 returned error can't find the container with id aebaab5b7e9c5c14696045859b89e75c9a11d63b9193462edfa231be530bc318 Jul 23 15:22:38.261772 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:38.261730 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:38.336506 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:38.336418 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-777bc59866-lgl4h" event={"ID":"fc43f416-946a-46c5-a52c-17eb54e0726f","Type":"ContainerStarted","Data":"aebaab5b7e9c5c14696045859b89e75c9a11d63b9193462edfa231be530bc318"} Jul 23 15:22:38.410557 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:38.410523 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:39.856361 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:39.856316 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:39.976368 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:39.976336 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:41.353886 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:41.353064 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-777bc59866-lgl4h" event={"ID":"fc43f416-946a-46c5-a52c-17eb54e0726f","Type":"ContainerStarted","Data":"d4da5c879a271348c81fc3583ec04f978aabb8f7e8c3aedb346cd0255f47aa98"} Jul 23 15:22:43.364003 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:43.363971 2582 generic.go:356] "Generic (PLEG): container finished" podID="fc43f416-946a-46c5-a52c-17eb54e0726f" containerID="d4da5c879a271348c81fc3583ec04f978aabb8f7e8c3aedb346cd0255f47aa98" exitCode=0 Jul 23 15:22:43.364377 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:43.364046 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-777bc59866-lgl4h" event={"ID":"fc43f416-946a-46c5-a52c-17eb54e0726f","Type":"ContainerDied","Data":"d4da5c879a271348c81fc3583ec04f978aabb8f7e8c3aedb346cd0255f47aa98"} Jul 23 15:22:44.370572 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:44.370535 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-777bc59866-lgl4h" event={"ID":"fc43f416-946a-46c5-a52c-17eb54e0726f","Type":"ContainerStarted","Data":"688b32a3cf2c5800d3e0365644669e37078cc0153c56e388c0f3a5c491b09b35"} Jul 23 15:22:44.371053 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:44.370771 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-777bc59866-lgl4h" Jul 23 15:22:44.398947 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:44.398890 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-777bc59866-lgl4h" podStartSLOduration=2.919379785 podStartE2EDuration="7.398870674s" totalImagesPullingTime="3.432196872s" totalInitContainerRuntime="1.047294017s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:22:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:22:44.396215254 +0000 UTC m=+609.378516109" watchObservedRunningTime="2026-07-23 15:22:44.398870674 +0000 UTC m=+609.381171494" Jul 23 15:22:53.598315 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:53.598277 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:53.699461 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:53.699428 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:55.377647 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:55.377610 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-777bc59866-lgl4h" Jul 23 15:22:56.088549 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:56.088507 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-67dd799c75-tfscg"] Jul 23 15:22:56.096884 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:56.096834 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67dd799c75-tfscg" Jul 23 15:22:56.100637 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:56.100603 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 23 15:22:56.100637 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:56.100619 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 23 15:22:56.100637 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:56.100640 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 23 15:22:56.100878 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:56.100603 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-7nt4x\"" Jul 23 15:22:56.110397 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:56.110373 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67dd799c75-tfscg"] Jul 23 15:22:56.209753 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:56.209708 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4113a90f-177b-4d36-a026-5aae9bd0b3d2-manager-config\") pod \"lws-controller-manager-67dd799c75-tfscg\" (UID: \"4113a90f-177b-4d36-a026-5aae9bd0b3d2\") " pod="openshift-lws-operator/lws-controller-manager-67dd799c75-tfscg" Jul 23 15:22:56.209967 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:56.209777 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4113a90f-177b-4d36-a026-5aae9bd0b3d2-cert\") pod \"lws-controller-manager-67dd799c75-tfscg\" (UID: \"4113a90f-177b-4d36-a026-5aae9bd0b3d2\") " pod="openshift-lws-operator/lws-controller-manager-67dd799c75-tfscg" Jul 23 15:22:56.209967 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:56.209795 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sz9l7\" (UniqueName: \"kubernetes.io/projected/4113a90f-177b-4d36-a026-5aae9bd0b3d2-kube-api-access-sz9l7\") pod \"lws-controller-manager-67dd799c75-tfscg\" (UID: \"4113a90f-177b-4d36-a026-5aae9bd0b3d2\") " pod="openshift-lws-operator/lws-controller-manager-67dd799c75-tfscg" Jul 23 15:22:56.209967 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:56.209818 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4113a90f-177b-4d36-a026-5aae9bd0b3d2-metrics-cert\") pod \"lws-controller-manager-67dd799c75-tfscg\" (UID: \"4113a90f-177b-4d36-a026-5aae9bd0b3d2\") " pod="openshift-lws-operator/lws-controller-manager-67dd799c75-tfscg" Jul 23 15:22:56.311301 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:56.311267 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4113a90f-177b-4d36-a026-5aae9bd0b3d2-cert\") pod \"lws-controller-manager-67dd799c75-tfscg\" (UID: \"4113a90f-177b-4d36-a026-5aae9bd0b3d2\") " pod="openshift-lws-operator/lws-controller-manager-67dd799c75-tfscg" Jul 23 15:22:56.311301 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:56.311302 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sz9l7\" (UniqueName: \"kubernetes.io/projected/4113a90f-177b-4d36-a026-5aae9bd0b3d2-kube-api-access-sz9l7\") pod \"lws-controller-manager-67dd799c75-tfscg\" (UID: \"4113a90f-177b-4d36-a026-5aae9bd0b3d2\") " pod="openshift-lws-operator/lws-controller-manager-67dd799c75-tfscg" Jul 23 15:22:56.311521 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:56.311335 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4113a90f-177b-4d36-a026-5aae9bd0b3d2-metrics-cert\") pod \"lws-controller-manager-67dd799c75-tfscg\" (UID: \"4113a90f-177b-4d36-a026-5aae9bd0b3d2\") " pod="openshift-lws-operator/lws-controller-manager-67dd799c75-tfscg" Jul 23 15:22:56.311521 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:56.311384 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4113a90f-177b-4d36-a026-5aae9bd0b3d2-manager-config\") pod \"lws-controller-manager-67dd799c75-tfscg\" (UID: \"4113a90f-177b-4d36-a026-5aae9bd0b3d2\") " pod="openshift-lws-operator/lws-controller-manager-67dd799c75-tfscg" Jul 23 15:22:56.312044 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:56.312025 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4113a90f-177b-4d36-a026-5aae9bd0b3d2-manager-config\") pod \"lws-controller-manager-67dd799c75-tfscg\" (UID: \"4113a90f-177b-4d36-a026-5aae9bd0b3d2\") " pod="openshift-lws-operator/lws-controller-manager-67dd799c75-tfscg" Jul 23 15:22:56.313909 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:56.313883 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4113a90f-177b-4d36-a026-5aae9bd0b3d2-metrics-cert\") pod \"lws-controller-manager-67dd799c75-tfscg\" (UID: \"4113a90f-177b-4d36-a026-5aae9bd0b3d2\") " pod="openshift-lws-operator/lws-controller-manager-67dd799c75-tfscg" Jul 23 15:22:56.314037 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:56.313919 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4113a90f-177b-4d36-a026-5aae9bd0b3d2-cert\") pod \"lws-controller-manager-67dd799c75-tfscg\" (UID: \"4113a90f-177b-4d36-a026-5aae9bd0b3d2\") " pod="openshift-lws-operator/lws-controller-manager-67dd799c75-tfscg" Jul 23 15:22:56.321517 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:56.321492 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sz9l7\" (UniqueName: \"kubernetes.io/projected/4113a90f-177b-4d36-a026-5aae9bd0b3d2-kube-api-access-sz9l7\") pod \"lws-controller-manager-67dd799c75-tfscg\" (UID: \"4113a90f-177b-4d36-a026-5aae9bd0b3d2\") " pod="openshift-lws-operator/lws-controller-manager-67dd799c75-tfscg" Jul 23 15:22:56.406642 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:56.406546 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67dd799c75-tfscg" Jul 23 15:22:56.559493 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:56.559464 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67dd799c75-tfscg"] Jul 23 15:22:56.561907 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:22:56.561874 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4113a90f_177b_4d36_a026_5aae9bd0b3d2.slice/crio-71cf81a075198f7f9924f7e4078467cd9ee400da5a97950f587ba28c48dc953a WatchSource:0}: Error finding container 71cf81a075198f7f9924f7e4078467cd9ee400da5a97950f587ba28c48dc953a: Status 404 returned error can't find the container with id 71cf81a075198f7f9924f7e4078467cd9ee400da5a97950f587ba28c48dc953a Jul 23 15:22:57.198326 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:57.198205 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:57.324428 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:57.324364 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:57.437562 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:57.437523 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67dd799c75-tfscg" event={"ID":"4113a90f-177b-4d36-a026-5aae9bd0b3d2","Type":"ContainerStarted","Data":"71cf81a075198f7f9924f7e4078467cd9ee400da5a97950f587ba28c48dc953a"} Jul 23 15:22:57.788251 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:57.788215 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:57.961839 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:57.961785 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-77f87dcdfb-fvq7k"] Jul 23 15:22:57.965255 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:57.965230 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-77f87dcdfb-fvq7k" Jul 23 15:22:57.969152 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:57.969124 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 23 15:22:57.969152 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:57.969153 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 23 15:22:57.969401 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:57.969220 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 23 15:22:57.969467 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:57.969438 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 23 15:22:57.970336 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:57.970317 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-wn2bp\"" Jul 23 15:22:57.983127 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:57.983102 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-77f87dcdfb-fvq7k"] Jul 23 15:22:58.027069 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:58.027046 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56215053-b59c-4b46-8cd7-1899cf20ea56-tls-certs\") pod \"kube-auth-proxy-77f87dcdfb-fvq7k\" (UID: \"56215053-b59c-4b46-8cd7-1899cf20ea56\") " pod="openshift-ingress/kube-auth-proxy-77f87dcdfb-fvq7k" Jul 23 15:22:58.027191 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:58.027089 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56215053-b59c-4b46-8cd7-1899cf20ea56-tmp\") pod \"kube-auth-proxy-77f87dcdfb-fvq7k\" (UID: \"56215053-b59c-4b46-8cd7-1899cf20ea56\") " pod="openshift-ingress/kube-auth-proxy-77f87dcdfb-fvq7k" Jul 23 15:22:58.027191 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:58.027149 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrnwv\" (UniqueName: \"kubernetes.io/projected/56215053-b59c-4b46-8cd7-1899cf20ea56-kube-api-access-qrnwv\") pod \"kube-auth-proxy-77f87dcdfb-fvq7k\" (UID: \"56215053-b59c-4b46-8cd7-1899cf20ea56\") " pod="openshift-ingress/kube-auth-proxy-77f87dcdfb-fvq7k" Jul 23 15:22:58.128797 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:58.128463 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56215053-b59c-4b46-8cd7-1899cf20ea56-tls-certs\") pod \"kube-auth-proxy-77f87dcdfb-fvq7k\" (UID: \"56215053-b59c-4b46-8cd7-1899cf20ea56\") " pod="openshift-ingress/kube-auth-proxy-77f87dcdfb-fvq7k" Jul 23 15:22:58.128989 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:58.128879 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56215053-b59c-4b46-8cd7-1899cf20ea56-tmp\") pod \"kube-auth-proxy-77f87dcdfb-fvq7k\" (UID: \"56215053-b59c-4b46-8cd7-1899cf20ea56\") " pod="openshift-ingress/kube-auth-proxy-77f87dcdfb-fvq7k" Jul 23 15:22:58.128989 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:58.128934 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrnwv\" (UniqueName: \"kubernetes.io/projected/56215053-b59c-4b46-8cd7-1899cf20ea56-kube-api-access-qrnwv\") pod \"kube-auth-proxy-77f87dcdfb-fvq7k\" (UID: \"56215053-b59c-4b46-8cd7-1899cf20ea56\") " pod="openshift-ingress/kube-auth-proxy-77f87dcdfb-fvq7k" Jul 23 15:22:58.131051 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:58.131024 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/56215053-b59c-4b46-8cd7-1899cf20ea56-tmp\") pod \"kube-auth-proxy-77f87dcdfb-fvq7k\" (UID: \"56215053-b59c-4b46-8cd7-1899cf20ea56\") " pod="openshift-ingress/kube-auth-proxy-77f87dcdfb-fvq7k" Jul 23 15:22:58.131197 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:58.131024 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/56215053-b59c-4b46-8cd7-1899cf20ea56-tls-certs\") pod \"kube-auth-proxy-77f87dcdfb-fvq7k\" (UID: \"56215053-b59c-4b46-8cd7-1899cf20ea56\") " pod="openshift-ingress/kube-auth-proxy-77f87dcdfb-fvq7k" Jul 23 15:22:58.146365 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:58.146333 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrnwv\" (UniqueName: \"kubernetes.io/projected/56215053-b59c-4b46-8cd7-1899cf20ea56-kube-api-access-qrnwv\") pod \"kube-auth-proxy-77f87dcdfb-fvq7k\" (UID: \"56215053-b59c-4b46-8cd7-1899cf20ea56\") " pod="openshift-ingress/kube-auth-proxy-77f87dcdfb-fvq7k" Jul 23 15:22:58.147646 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:58.147623 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:58.258130 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:58.258088 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:58.276167 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:58.276128 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-77f87dcdfb-fvq7k" Jul 23 15:22:58.341168 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:58.341131 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:58.430021 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:58.429996 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-77f87dcdfb-fvq7k"] Jul 23 15:22:58.430814 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:22:58.430792 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56215053_b59c_4b46_8cd7_1899cf20ea56.slice/crio-66b7af3f3bc36e8c6e0c1976fdf3f6eeec3f9dde2f617d05d23edf663e9fdaf0 WatchSource:0}: Error finding container 66b7af3f3bc36e8c6e0c1976fdf3f6eeec3f9dde2f617d05d23edf663e9fdaf0: Status 404 returned error can't find the container with id 66b7af3f3bc36e8c6e0c1976fdf3f6eeec3f9dde2f617d05d23edf663e9fdaf0 Jul 23 15:22:58.444848 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:58.444819 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67dd799c75-tfscg" event={"ID":"4113a90f-177b-4d36-a026-5aae9bd0b3d2","Type":"ContainerStarted","Data":"1316aaf8dca97c76d1a4cf6cb4d0d54aca47d10638f07e25fe2cc9b9e983dade"} Jul 23 15:22:58.445303 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:58.444975 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-67dd799c75-tfscg" Jul 23 15:22:58.446070 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:58.446045 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-77f87dcdfb-fvq7k" event={"ID":"56215053-b59c-4b46-8cd7-1899cf20ea56","Type":"ContainerStarted","Data":"66b7af3f3bc36e8c6e0c1976fdf3f6eeec3f9dde2f617d05d23edf663e9fdaf0"} Jul 23 15:22:58.468188 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:58.468155 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:58.609903 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:58.609782 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:59.239453 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:59.239415 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:59.534480 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:59.534398 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:22:59.621870 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:22:59.621811 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:00.884850 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:00.884780 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:01.464613 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:01.464578 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-77f87dcdfb-fvq7k" event={"ID":"56215053-b59c-4b46-8cd7-1899cf20ea56","Type":"ContainerStarted","Data":"15024000f9b88ac016f074c8ae6f9351dcb5eb8e191260a52243e3074fe0def2"} Jul 23 15:23:01.486483 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:01.486351 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-67dd799c75-tfscg" podStartSLOduration=4.031301217 podStartE2EDuration="5.486326714s" totalImagesPullingTime="1.455025497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:22:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:22:58.495894607 +0000 UTC m=+623.478195436" watchObservedRunningTime="2026-07-23 15:23:01.486326714 +0000 UTC m=+626.468627545" Jul 23 15:23:01.487104 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:01.487071 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-77f87dcdfb-fvq7k" podStartSLOduration=1.699106718 podStartE2EDuration="4.487061858s" totalImagesPullingTime="2.78795514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:22:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:23:01.486520867 +0000 UTC m=+626.468821698" watchObservedRunningTime="2026-07-23 15:23:01.487061858 +0000 UTC m=+626.469362687" Jul 23 15:23:05.187702 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:05.187665 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:05.301301 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:05.301256 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:06.289233 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:06.289204 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:06.697169 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:06.697136 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:06.812628 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:06.812593 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:09.455809 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:09.455780 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-67dd799c75-tfscg" Jul 23 15:23:09.545678 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:09.545629 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:09.655884 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:09.655823 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:09.689125 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:09.689072 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-m4vn9"] Jul 23 15:23:09.692949 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:09.692923 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m4vn9" Jul 23 15:23:09.698885 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:09.698831 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 23 15:23:09.699375 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:09.699353 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-7lf86\"" Jul 23 15:23:09.714853 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:09.714773 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-m4vn9"] Jul 23 15:23:09.762675 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:09.762638 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:09.845983 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:09.845951 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53c3a9a1-9954-4d87-8ea6-f1604c461564-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-m4vn9\" (UID: \"53c3a9a1-9954-4d87-8ea6-f1604c461564\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m4vn9" Jul 23 15:23:09.846135 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:09.846086 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fm8c\" (UniqueName: \"kubernetes.io/projected/53c3a9a1-9954-4d87-8ea6-f1604c461564-kube-api-access-2fm8c\") pod \"llmisvc-controller-manager-777c6bd7d5-m4vn9\" (UID: \"53c3a9a1-9954-4d87-8ea6-f1604c461564\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m4vn9" Jul 23 15:23:09.943209 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:09.943152 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:09.947600 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:09.947564 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fm8c\" (UniqueName: \"kubernetes.io/projected/53c3a9a1-9954-4d87-8ea6-f1604c461564-kube-api-access-2fm8c\") pod \"llmisvc-controller-manager-777c6bd7d5-m4vn9\" (UID: \"53c3a9a1-9954-4d87-8ea6-f1604c461564\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m4vn9" Jul 23 15:23:09.947843 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:09.947662 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53c3a9a1-9954-4d87-8ea6-f1604c461564-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-m4vn9\" (UID: \"53c3a9a1-9954-4d87-8ea6-f1604c461564\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m4vn9" Jul 23 15:23:09.951004 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:09.950962 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/53c3a9a1-9954-4d87-8ea6-f1604c461564-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-m4vn9\" (UID: \"53c3a9a1-9954-4d87-8ea6-f1604c461564\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m4vn9" Jul 23 15:23:09.991725 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:09.991644 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fm8c\" (UniqueName: \"kubernetes.io/projected/53c3a9a1-9954-4d87-8ea6-f1604c461564-kube-api-access-2fm8c\") pod \"llmisvc-controller-manager-777c6bd7d5-m4vn9\" (UID: \"53c3a9a1-9954-4d87-8ea6-f1604c461564\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m4vn9" Jul 23 15:23:10.004432 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:10.004398 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m4vn9" Jul 23 15:23:10.087880 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:10.083718 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:10.197621 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:23:10.197593 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod53c3a9a1_9954_4d87_8ea6_f1604c461564.slice/crio-a718d8f4ffde193cf182975eb59de16f65b3f3a5905450970c627b511fec4af8 WatchSource:0}: Error finding container a718d8f4ffde193cf182975eb59de16f65b3f3a5905450970c627b511fec4af8: Status 404 returned error can't find the container with id a718d8f4ffde193cf182975eb59de16f65b3f3a5905450970c627b511fec4af8 Jul 23 15:23:10.200157 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:10.200133 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-m4vn9"] Jul 23 15:23:10.233905 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:10.233849 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:10.508602 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:10.508570 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m4vn9" event={"ID":"53c3a9a1-9954-4d87-8ea6-f1604c461564","Type":"ContainerStarted","Data":"a718d8f4ffde193cf182975eb59de16f65b3f3a5905450970c627b511fec4af8"} Jul 23 15:23:14.531926 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:14.531884 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m4vn9" event={"ID":"53c3a9a1-9954-4d87-8ea6-f1604c461564","Type":"ContainerStarted","Data":"e4d070e25539fc25fe43433b686ac150e2d2b3baffba6f8fb735c35124daf898"} Jul 23 15:23:14.534169 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:14.532037 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m4vn9" Jul 23 15:23:14.552908 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:14.552834 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m4vn9" podStartSLOduration=2.193056303 podStartE2EDuration="5.552813236s" totalImagesPullingTime="3.359756933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:23:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:23:14.550414548 +0000 UTC m=+639.532715379" watchObservedRunningTime="2026-07-23 15:23:14.552813236 +0000 UTC m=+639.535114068" Jul 23 15:23:28.971667 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:28.971627 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:29.096896 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:29.096848 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:42.554180 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:42.554145 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:45.538970 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:45.538926 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m4vn9" Jul 23 15:23:48.199735 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:48.199704 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:58.663342 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:58.663303 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:58.768023 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:58.767983 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:23:58.837192 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:23:58.837156 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:01.504593 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:24:01.504556 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:01.601027 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:24:01.600995 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:27.415978 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:24:27.415898 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:28.014144 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:24:28.014115 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:32.648725 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:24:32.648686 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:35.088397 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:24:35.088365 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:35.217271 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:24:35.217228 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:35.450888 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:24:35.450785 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:36.698890 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:24:36.698844 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:38.119463 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:24:38.119427 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:40.045433 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:24:40.045402 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:41.935075 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:24:41.935028 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:43.048718 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:24:43.048679 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:43.145717 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:24:43.145686 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:43.433490 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:24:43.433456 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:43.527335 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:24:43.527303 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:47.564412 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:24:47.564370 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:47.637399 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:24:47.637333 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:48.562515 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:24:48.562474 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:48.732164 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:24:48.732131 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:51.857047 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:24:51.857011 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:51.961835 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:24:51.961800 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:58.660353 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:24:58.660313 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:24:58.758565 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:24:58.758534 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:02.434011 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:02.433969 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:02.522764 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:02.522729 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:02.627290 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:02.627252 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:02.733657 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:02.733577 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:04.284355 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:04.284311 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:04.408737 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:04.408701 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:09.465750 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:09.465716 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:09.562682 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:09.562643 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:16.528512 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:16.528478 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:16.633348 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:16.633316 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:20.264718 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:20.264684 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:20.366907 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:20.366849 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:20.860829 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:20.860801 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:20.922411 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:20.922379 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:23.274291 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:23.274249 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:23.371164 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:23.371123 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:28.465950 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:28.465890 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:28.581171 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:28.581127 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:31.828191 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:31.828157 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:32.189742 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:32.189648 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:35.072241 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:35.072207 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:35.192247 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:35.192210 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:39.943779 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:39.943748 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:40.004236 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:40.004205 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:44.287871 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:44.287820 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:44.452981 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:44.452949 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:44.539663 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:44.539576 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:44.638666 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:44.638632 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:44.832290 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:44.832258 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-95ghc"] Jul 23 15:25:44.835691 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:44.835670 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-95ghc" Jul 23 15:25:44.838316 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:44.838287 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 23 15:25:44.838432 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:44.838333 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 23 15:25:44.839260 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:44.839243 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4h6zx\"" Jul 23 15:25:44.839359 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:44.839277 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 23 15:25:44.844951 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:44.844927 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-95ghc"] Jul 23 15:25:44.879298 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:44.879258 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-95ghc"] Jul 23 15:25:44.900654 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:44.900617 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-684mr\" (UniqueName: \"kubernetes.io/projected/3f1d0963-c74d-45b5-b38a-597c0d57d4ac-kube-api-access-684mr\") pod \"limitador-limitador-54d6d988d5-95ghc\" (UID: \"3f1d0963-c74d-45b5-b38a-597c0d57d4ac\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-95ghc" Jul 23 15:25:44.900775 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:44.900684 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3f1d0963-c74d-45b5-b38a-597c0d57d4ac-config-file\") pod \"limitador-limitador-54d6d988d5-95ghc\" (UID: \"3f1d0963-c74d-45b5-b38a-597c0d57d4ac\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-95ghc" Jul 23 15:25:45.001731 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:45.001679 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-684mr\" (UniqueName: \"kubernetes.io/projected/3f1d0963-c74d-45b5-b38a-597c0d57d4ac-kube-api-access-684mr\") pod \"limitador-limitador-54d6d988d5-95ghc\" (UID: \"3f1d0963-c74d-45b5-b38a-597c0d57d4ac\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-95ghc" Jul 23 15:25:45.001938 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:45.001767 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3f1d0963-c74d-45b5-b38a-597c0d57d4ac-config-file\") pod \"limitador-limitador-54d6d988d5-95ghc\" (UID: \"3f1d0963-c74d-45b5-b38a-597c0d57d4ac\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-95ghc" Jul 23 15:25:45.002412 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:45.002394 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3f1d0963-c74d-45b5-b38a-597c0d57d4ac-config-file\") pod \"limitador-limitador-54d6d988d5-95ghc\" (UID: \"3f1d0963-c74d-45b5-b38a-597c0d57d4ac\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-95ghc" Jul 23 15:25:45.011107 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:45.011084 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-684mr\" (UniqueName: \"kubernetes.io/projected/3f1d0963-c74d-45b5-b38a-597c0d57d4ac-kube-api-access-684mr\") pod \"limitador-limitador-54d6d988d5-95ghc\" (UID: \"3f1d0963-c74d-45b5-b38a-597c0d57d4ac\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-95ghc" Jul 23 15:25:45.147371 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:45.147267 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-95ghc" Jul 23 15:25:45.267072 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:45.267045 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:45.283782 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:45.283751 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-95ghc"] Jul 23 15:25:45.286747 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:25:45.286721 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f1d0963_c74d_45b5_b38a_597c0d57d4ac.slice/crio-784dec346c623329ab43ff3b7b5f130332cc3a61ddbecbe58186a24a07ac0ec9 WatchSource:0}: Error finding container 784dec346c623329ab43ff3b7b5f130332cc3a61ddbecbe58186a24a07ac0ec9: Status 404 returned error can't find the container with id 784dec346c623329ab43ff3b7b5f130332cc3a61ddbecbe58186a24a07ac0ec9 Jul 23 15:25:45.288628 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:45.288614 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 15:25:45.368226 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:45.368175 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:25:46.232766 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:46.232727 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-95ghc" event={"ID":"3f1d0963-c74d-45b5-b38a-597c0d57d4ac","Type":"ContainerStarted","Data":"784dec346c623329ab43ff3b7b5f130332cc3a61ddbecbe58186a24a07ac0ec9"} Jul 23 15:25:48.244829 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:48.244792 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-95ghc" event={"ID":"3f1d0963-c74d-45b5-b38a-597c0d57d4ac","Type":"ContainerStarted","Data":"747e282fb7b10d7597ec212902b8250ebe129f13f6c4630e17608cd19e25ecc9"} Jul 23 15:25:48.245262 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:48.244964 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-95ghc" Jul 23 15:25:48.261985 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:48.261927 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-95ghc" podStartSLOduration=1.7772854470000001 podStartE2EDuration="4.261911189s" totalImagesPullingTime="2.484625742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 15:25:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:25:48.261370283 +0000 UTC m=+793.243671128" watchObservedRunningTime="2026-07-23 15:25:48.261911189 +0000 UTC m=+793.244212019" Jul 23 15:25:59.250479 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:25:59.250387 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-95ghc" Jul 23 15:26:05.329610 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:26:05.329575 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:26:06.587678 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:26:06.583418 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:26:16.065483 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:26:16.065450 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:26:16.127914 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:26:16.127882 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:26:17.420426 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:26:17.420393 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:26:17.641155 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:26:17.641123 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:26:24.318186 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:26:24.318148 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:26:24.420150 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:26:24.420116 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:26:24.491533 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:26:24.491497 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:26:24.783806 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:26:24.783771 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:26:27.668755 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:26:27.668714 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:26:27.912435 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:26:27.912399 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:26:59.412100 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:26:59.412064 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:26:59.507905 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:26:59.507869 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:00.029755 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:00.029717 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:00.120418 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:00.120382 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:00.772729 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:00.772694 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:00.885190 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:00.885152 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:01.263446 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:01.263405 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-95ghc"] Jul 23 15:27:11.040783 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:11.040749 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:11.138664 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:11.138632 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:18.787825 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:18.787790 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-m4vn9_53c3a9a1-9954-4d87-8ea6-f1604c461564/manager/0.log" Jul 23 15:27:19.293845 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:19.293818 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-777bc59866-lgl4h_fc43f416-946a-46c5-a52c-17eb54e0726f/copy-manifests/0.log" Jul 23 15:27:19.303762 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:19.303733 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-777bc59866-lgl4h_fc43f416-946a-46c5-a52c-17eb54e0726f/manager/0.log" Jul 23 15:27:22.310088 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:22.310003 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-95ghc_3f1d0963-c74d-45b5-b38a-597c0d57d4ac/limitador/0.log" Jul 23 15:27:23.082705 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:23.082678 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77f87dcdfb-fvq7k_56215053-b59c-4b46-8cd7-1899cf20ea56/kube-auth-proxy/0.log" Jul 23 15:27:29.781311 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:29.781088 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:29.859355 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:29.859327 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" limit=1024 Jul 23 15:27:32.931470 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:32.931431 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-b7wx7_fb607685-50d2-4fd7-b238-865b7726e7fa/global-pull-secret-syncer/0.log" Jul 23 15:27:33.083613 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:33.083582 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4c6h4_e0b34ed2-b27e-4b52-8f86-584ef89bd71e/konnectivity-agent/0.log" Jul 23 15:27:33.173178 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:33.173146 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-213.ec2.internal_3b0cee6e3f6ab4006080287e7a9b3351/haproxy/0.log" Jul 23 15:27:35.561534 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:35.561507 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pgrx7_fe195eea-0d32-4761-a885-e953d4460bcc/ovn-acl-logging/0.log" Jul 23 15:27:35.562042 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:35.561620 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pgrx7_fe195eea-0d32-4761-a885-e953d4460bcc/ovn-acl-logging/0.log" Jul 23 15:27:38.545667 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:38.545586 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-95ghc_3f1d0963-c74d-45b5-b38a-597c0d57d4ac/limitador/0.log" Jul 23 15:27:40.379025 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:40.378999 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_66a1db0e-42ca-46fe-8b90-4f4c2e77b423/alertmanager/0.log" Jul 23 15:27:40.411649 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:40.411619 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_66a1db0e-42ca-46fe-8b90-4f4c2e77b423/config-reloader/0.log" Jul 23 15:27:40.436216 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:40.436191 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_66a1db0e-42ca-46fe-8b90-4f4c2e77b423/kube-rbac-proxy-web/0.log" Jul 23 15:27:40.461232 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:40.461201 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_66a1db0e-42ca-46fe-8b90-4f4c2e77b423/kube-rbac-proxy/0.log" Jul 23 15:27:40.489136 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:40.489112 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_66a1db0e-42ca-46fe-8b90-4f4c2e77b423/kube-rbac-proxy-metric/0.log" Jul 23 15:27:40.514068 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:40.514037 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_66a1db0e-42ca-46fe-8b90-4f4c2e77b423/prom-label-proxy/0.log" Jul 23 15:27:40.536793 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:40.536765 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_66a1db0e-42ca-46fe-8b90-4f4c2e77b423/init-config-reloader/0.log" Jul 23 15:27:40.614713 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:40.614671 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-7ws6n_d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13/kube-state-metrics/0.log" Jul 23 15:27:40.637312 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:40.637241 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-7ws6n_d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13/kube-rbac-proxy-main/0.log" Jul 23 15:27:40.659334 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:40.659307 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56c5594674-7ws6n_d2594bd3-d7f0-461f-b52d-e3b0a8fb7d13/kube-rbac-proxy-self/0.log" Jul 23 15:27:40.687554 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:40.687526 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7b9ccbf7d9-st2h7_b958251b-b880-46c3-9bc1-182d6c58d657/metrics-server/0.log" Jul 23 15:27:40.723275 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:40.723249 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-7b7b7bc8bf-cjplf_a9ba3dc9-d3f2-4317-bc69-e6f739918b88/monitoring-plugin/0.log" Jul 23 15:27:40.759214 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:40.759186 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-97bcd_62cde94a-2739-470e-8ea7-649461330501/node-exporter/0.log" Jul 23 15:27:40.781374 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:40.781351 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-97bcd_62cde94a-2739-470e-8ea7-649461330501/kube-rbac-proxy/0.log" Jul 23 15:27:40.804318 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:40.804294 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-97bcd_62cde94a-2739-470e-8ea7-649461330501/init-textfile/0.log" Jul 23 15:27:40.996484 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:40.996400 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-wgqp5_b7586e00-ef48-474b-8da7-e44494f13452/kube-rbac-proxy-main/0.log" Jul 23 15:27:41.019445 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:41.019418 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-wgqp5_b7586e00-ef48-474b-8da7-e44494f13452/kube-rbac-proxy-self/0.log" Jul 23 15:27:41.041957 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:41.041930 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-wgqp5_b7586e00-ef48-474b-8da7-e44494f13452/openshift-state-metrics/0.log" Jul 23 15:27:41.081474 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:41.081445 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7df3a72f-63aa-4104-ae73-8eb46f3059ff/prometheus/0.log" Jul 23 15:27:41.104007 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:41.103982 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7df3a72f-63aa-4104-ae73-8eb46f3059ff/config-reloader/0.log" Jul 23 15:27:41.130534 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:41.130506 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7df3a72f-63aa-4104-ae73-8eb46f3059ff/thanos-sidecar/0.log" Jul 23 15:27:41.152322 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:41.152290 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7df3a72f-63aa-4104-ae73-8eb46f3059ff/kube-rbac-proxy-web/0.log" Jul 23 15:27:41.175071 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:41.175043 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7df3a72f-63aa-4104-ae73-8eb46f3059ff/kube-rbac-proxy/0.log" Jul 23 15:27:41.213174 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:41.213147 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7df3a72f-63aa-4104-ae73-8eb46f3059ff/kube-rbac-proxy-thanos/0.log" Jul 23 15:27:41.265311 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:41.265231 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7df3a72f-63aa-4104-ae73-8eb46f3059ff/init-config-reloader/0.log" Jul 23 15:27:41.423231 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:41.423197 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-9788ff9cb-6x6q2_5c6656a1-6fd3-484a-a0df-a126b11e0f33/telemeter-client/0.log" Jul 23 15:27:41.450660 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:41.450630 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-9788ff9cb-6x6q2_5c6656a1-6fd3-484a-a0df-a126b11e0f33/reload/0.log" Jul 23 15:27:41.476190 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:41.476140 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-9788ff9cb-6x6q2_5c6656a1-6fd3-484a-a0df-a126b11e0f33/kube-rbac-proxy/0.log" Jul 23 15:27:41.507265 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:41.507238 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d7bf74d9c-l8rqs_2ff224b3-acbe-4a2f-a441-5ff187b38662/thanos-query/0.log" Jul 23 15:27:41.528921 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:41.528827 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d7bf74d9c-l8rqs_2ff224b3-acbe-4a2f-a441-5ff187b38662/kube-rbac-proxy-web/0.log" Jul 23 15:27:41.554731 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:41.554704 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d7bf74d9c-l8rqs_2ff224b3-acbe-4a2f-a441-5ff187b38662/kube-rbac-proxy/0.log" Jul 23 15:27:41.579614 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:41.579585 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d7bf74d9c-l8rqs_2ff224b3-acbe-4a2f-a441-5ff187b38662/prom-label-proxy/0.log" Jul 23 15:27:41.604111 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:41.604085 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d7bf74d9c-l8rqs_2ff224b3-acbe-4a2f-a441-5ff187b38662/kube-rbac-proxy-rules/0.log" Jul 23 15:27:41.630589 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:41.630562 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d7bf74d9c-l8rqs_2ff224b3-acbe-4a2f-a441-5ff187b38662/kube-rbac-proxy-metrics/0.log" Jul 23 15:27:43.246265 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:43.246229 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9x4vs/perf-node-gather-daemonset-hj6x6"] Jul 23 15:27:43.252014 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:43.251976 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9x4vs/perf-node-gather-daemonset-hj6x6" Jul 23 15:27:43.255473 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:43.255448 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9x4vs\"/\"default-dockercfg-wrzgr\"" Jul 23 15:27:43.256254 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:43.256230 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9x4vs\"/\"kube-root-ca.crt\"" Jul 23 15:27:43.256254 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:43.256252 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9x4vs\"/\"openshift-service-ca.crt\"" Jul 23 15:27:43.264099 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:43.264074 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9x4vs/perf-node-gather-daemonset-hj6x6"] Jul 23 15:27:43.320300 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:43.320256 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29fnb\" (UniqueName: \"kubernetes.io/projected/ef5c2fa5-78e5-4d03-9f14-6427ce5c4773-kube-api-access-29fnb\") pod \"perf-node-gather-daemonset-hj6x6\" (UID: \"ef5c2fa5-78e5-4d03-9f14-6427ce5c4773\") " pod="openshift-must-gather-9x4vs/perf-node-gather-daemonset-hj6x6" Jul 23 15:27:43.320519 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:43.320328 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ef5c2fa5-78e5-4d03-9f14-6427ce5c4773-proc\") pod \"perf-node-gather-daemonset-hj6x6\" (UID: \"ef5c2fa5-78e5-4d03-9f14-6427ce5c4773\") " pod="openshift-must-gather-9x4vs/perf-node-gather-daemonset-hj6x6" Jul 23 15:27:43.320519 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:43.320446 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef5c2fa5-78e5-4d03-9f14-6427ce5c4773-sys\") pod \"perf-node-gather-daemonset-hj6x6\" (UID: \"ef5c2fa5-78e5-4d03-9f14-6427ce5c4773\") " pod="openshift-must-gather-9x4vs/perf-node-gather-daemonset-hj6x6" Jul 23 15:27:43.320519 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:43.320508 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ef5c2fa5-78e5-4d03-9f14-6427ce5c4773-podres\") pod \"perf-node-gather-daemonset-hj6x6\" (UID: \"ef5c2fa5-78e5-4d03-9f14-6427ce5c4773\") " pod="openshift-must-gather-9x4vs/perf-node-gather-daemonset-hj6x6" Jul 23 15:27:43.320641 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:43.320537 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef5c2fa5-78e5-4d03-9f14-6427ce5c4773-lib-modules\") pod \"perf-node-gather-daemonset-hj6x6\" (UID: \"ef5c2fa5-78e5-4d03-9f14-6427ce5c4773\") " pod="openshift-must-gather-9x4vs/perf-node-gather-daemonset-hj6x6" Jul 23 15:27:43.421902 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:43.421840 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ef5c2fa5-78e5-4d03-9f14-6427ce5c4773-proc\") pod \"perf-node-gather-daemonset-hj6x6\" (UID: \"ef5c2fa5-78e5-4d03-9f14-6427ce5c4773\") " pod="openshift-must-gather-9x4vs/perf-node-gather-daemonset-hj6x6" Jul 23 15:27:43.422086 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:43.421930 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef5c2fa5-78e5-4d03-9f14-6427ce5c4773-sys\") pod \"perf-node-gather-daemonset-hj6x6\" (UID: \"ef5c2fa5-78e5-4d03-9f14-6427ce5c4773\") " pod="openshift-must-gather-9x4vs/perf-node-gather-daemonset-hj6x6" Jul 23 15:27:43.422086 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:43.421966 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ef5c2fa5-78e5-4d03-9f14-6427ce5c4773-podres\") pod \"perf-node-gather-daemonset-hj6x6\" (UID: \"ef5c2fa5-78e5-4d03-9f14-6427ce5c4773\") " pod="openshift-must-gather-9x4vs/perf-node-gather-daemonset-hj6x6" Jul 23 15:27:43.422086 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:43.421972 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ef5c2fa5-78e5-4d03-9f14-6427ce5c4773-proc\") pod \"perf-node-gather-daemonset-hj6x6\" (UID: \"ef5c2fa5-78e5-4d03-9f14-6427ce5c4773\") " pod="openshift-must-gather-9x4vs/perf-node-gather-daemonset-hj6x6" Jul 23 15:27:43.422086 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:43.421985 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef5c2fa5-78e5-4d03-9f14-6427ce5c4773-lib-modules\") pod \"perf-node-gather-daemonset-hj6x6\" (UID: \"ef5c2fa5-78e5-4d03-9f14-6427ce5c4773\") " pod="openshift-must-gather-9x4vs/perf-node-gather-daemonset-hj6x6" Jul 23 15:27:43.422086 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:43.422061 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29fnb\" (UniqueName: \"kubernetes.io/projected/ef5c2fa5-78e5-4d03-9f14-6427ce5c4773-kube-api-access-29fnb\") pod \"perf-node-gather-daemonset-hj6x6\" (UID: \"ef5c2fa5-78e5-4d03-9f14-6427ce5c4773\") " pod="openshift-must-gather-9x4vs/perf-node-gather-daemonset-hj6x6" Jul 23 15:27:43.422331 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:43.422092 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ef5c2fa5-78e5-4d03-9f14-6427ce5c4773-lib-modules\") pod \"perf-node-gather-daemonset-hj6x6\" (UID: \"ef5c2fa5-78e5-4d03-9f14-6427ce5c4773\") " pod="openshift-must-gather-9x4vs/perf-node-gather-daemonset-hj6x6" Jul 23 15:27:43.422331 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:43.422098 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ef5c2fa5-78e5-4d03-9f14-6427ce5c4773-podres\") pod \"perf-node-gather-daemonset-hj6x6\" (UID: \"ef5c2fa5-78e5-4d03-9f14-6427ce5c4773\") " pod="openshift-must-gather-9x4vs/perf-node-gather-daemonset-hj6x6" Jul 23 15:27:43.422331 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:43.422058 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef5c2fa5-78e5-4d03-9f14-6427ce5c4773-sys\") pod \"perf-node-gather-daemonset-hj6x6\" (UID: \"ef5c2fa5-78e5-4d03-9f14-6427ce5c4773\") " pod="openshift-must-gather-9x4vs/perf-node-gather-daemonset-hj6x6" Jul 23 15:27:43.441490 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:43.441415 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29fnb\" (UniqueName: \"kubernetes.io/projected/ef5c2fa5-78e5-4d03-9f14-6427ce5c4773-kube-api-access-29fnb\") pod \"perf-node-gather-daemonset-hj6x6\" (UID: \"ef5c2fa5-78e5-4d03-9f14-6427ce5c4773\") " pod="openshift-must-gather-9x4vs/perf-node-gather-daemonset-hj6x6" Jul 23 15:27:43.565133 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:43.565095 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9x4vs/perf-node-gather-daemonset-hj6x6" Jul 23 15:27:43.698398 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:43.698370 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9x4vs/perf-node-gather-daemonset-hj6x6"] Jul 23 15:27:43.700377 ip-10-0-128-213 kubenswrapper[2582]: W0723 15:27:43.700350 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podef5c2fa5_78e5_4d03_9f14_6427ce5c4773.slice/crio-99d17a01c13b47b99838bafef96327a9d52c1315228b00c52c01292c3bd2d6b4 WatchSource:0}: Error finding container 99d17a01c13b47b99838bafef96327a9d52c1315228b00c52c01292c3bd2d6b4: Status 404 returned error can't find the container with id 99d17a01c13b47b99838bafef96327a9d52c1315228b00c52c01292c3bd2d6b4 Jul 23 15:27:43.777074 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:43.777041 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9x4vs/perf-node-gather-daemonset-hj6x6" event={"ID":"ef5c2fa5-78e5-4d03-9f14-6427ce5c4773","Type":"ContainerStarted","Data":"99d17a01c13b47b99838bafef96327a9d52c1315228b00c52c01292c3bd2d6b4"} Jul 23 15:27:44.029816 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:44.029742 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-685684fbcb-vxvb7_ddf326f6-6a25-4d86-b8b9-633c8ecb6031/console/0.log" Jul 23 15:27:44.782826 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:44.782789 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9x4vs/perf-node-gather-daemonset-hj6x6" event={"ID":"ef5c2fa5-78e5-4d03-9f14-6427ce5c4773","Type":"ContainerStarted","Data":"5a967b6a25320edc34c592aa7b8a85331632fdd5eef70009652917f6469c1c6d"} Jul 23 15:27:44.783247 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:44.782904 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9x4vs/perf-node-gather-daemonset-hj6x6" Jul 23 15:27:44.825009 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:44.824952 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9x4vs/perf-node-gather-daemonset-hj6x6" podStartSLOduration=1.8249314349999999 podStartE2EDuration="1.824931435s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 15:27:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 15:27:44.821660744 +0000 UTC m=+909.803961577" watchObservedRunningTime="2026-07-23 15:27:44.824931435 +0000 UTC m=+909.807232317" Jul 23 15:27:45.772534 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:45.772509 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hth64_bd638ec4-5039-4f53-99f6-5774f533aa7a/dns/0.log" Jul 23 15:27:45.799635 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:45.799608 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hth64_bd638ec4-5039-4f53-99f6-5774f533aa7a/kube-rbac-proxy/0.log" Jul 23 15:27:45.970277 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:45.970250 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5wkgs_3555cdac-b6d6-446c-8dbc-73850e135995/dns-node-resolver/0.log" Jul 23 15:27:46.681743 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:46.681716 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8qhdh_45cd984a-be03-413a-9229-c3b195e80e25/node-ca/0.log" Jul 23 15:27:48.190404 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:48.190374 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77f87dcdfb-fvq7k_56215053-b59c-4b46-8cd7-1899cf20ea56/kube-auth-proxy/0.log" Jul 23 15:27:49.166589 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:49.166562 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-j4mcc_4bbea83b-d4d2-4103-9f4d-b67e865dfea1/serve-healthcheck-canary/0.log" Jul 23 15:27:49.827704 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:49.827677 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jqrpq_0d05d01d-68f8-48eb-8789-285d901fe7ab/kube-rbac-proxy/0.log" Jul 23 15:27:49.862347 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:49.862314 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jqrpq_0d05d01d-68f8-48eb-8789-285d901fe7ab/exporter/0.log" Jul 23 15:27:49.898514 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:49.898482 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jqrpq_0d05d01d-68f8-48eb-8789-285d901fe7ab/extractor/0.log" Jul 23 15:27:50.797941 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:50.797915 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9x4vs/perf-node-gather-daemonset-hj6x6" Jul 23 15:27:52.330333 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:52.330303 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-m4vn9_53c3a9a1-9954-4d87-8ea6-f1604c461564/manager/0.log" Jul 23 15:27:52.469507 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:52.469479 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-777bc59866-lgl4h_fc43f416-946a-46c5-a52c-17eb54e0726f/manager/0.log" Jul 23 15:27:52.493566 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:52.493542 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-777bc59866-lgl4h_fc43f416-946a-46c5-a52c-17eb54e0726f/copy-manifests/0.log" Jul 23 15:27:53.103922 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:53.103893 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77f87dcdfb-fvq7k_56215053-b59c-4b46-8cd7-1899cf20ea56/kube-auth-proxy/0.log" Jul 23 15:27:54.125971 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:54.125943 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-67dd799c75-tfscg_4113a90f-177b-4d36-a026-5aae9bd0b3d2/manager/0.log" Jul 23 15:27:54.158187 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:54.158161 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-bzm9m_f6c6bf79-547e-451a-bc58-fd45f71acdef/openshift-lws-operator/0.log" Jul 23 15:27:54.501433 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:27:54.501405 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-77f87dcdfb-fvq7k_56215053-b59c-4b46-8cd7-1899cf20ea56/kube-auth-proxy/0.log" Jul 23 15:28:01.209083 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:28:01.209053 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nfdrv_d7627ebf-1afb-4d04-8218-f1242fb9a742/kube-multus-additional-cni-plugins/0.log" Jul 23 15:28:01.234385 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:28:01.234351 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nfdrv_d7627ebf-1afb-4d04-8218-f1242fb9a742/egress-router-binary-copy/0.log" Jul 23 15:28:01.257237 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:28:01.257212 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nfdrv_d7627ebf-1afb-4d04-8218-f1242fb9a742/cni-plugins/0.log" Jul 23 15:28:01.279483 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:28:01.279459 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nfdrv_d7627ebf-1afb-4d04-8218-f1242fb9a742/bond-cni-plugin/0.log" Jul 23 15:28:01.302125 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:28:01.302096 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nfdrv_d7627ebf-1afb-4d04-8218-f1242fb9a742/routeoverride-cni/0.log" Jul 23 15:28:01.327238 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:28:01.327210 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nfdrv_d7627ebf-1afb-4d04-8218-f1242fb9a742/whereabouts-cni-bincopy/0.log" Jul 23 15:28:01.349688 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:28:01.349661 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-nfdrv_d7627ebf-1afb-4d04-8218-f1242fb9a742/whereabouts-cni/0.log" Jul 23 15:28:01.382420 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:28:01.382388 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-d2249_7fbc52f2-0509-44c3-91b2-428cc69d99eb/kube-multus/0.log" Jul 23 15:28:01.564916 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:28:01.564825 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xsdtd_ffacaf02-b6c9-4245-bee8-eb863a7b117c/network-metrics-daemon/0.log" Jul 23 15:28:01.590691 ip-10-0-128-213 kubenswrapper[2582]: I0723 15:28:01.590665 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-xsdtd_ffacaf02-b6c9-4245-bee8-eb863a7b117c/kube-rbac-proxy/0.log"