Jul 10 03:30:32.280083 ip-10-0-129-177 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 10 03:30:32.280097 ip-10-0-129-177 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 10 03:30:32.280106 ip-10-0-129-177 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 10 03:30:32.280446 ip-10-0-129-177 systemd[1]: Failed to start Kubernetes Kubelet. Jul 10 03:30:42.324752 ip-10-0-129-177 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 10 03:30:42.324773 ip-10-0-129-177 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 13c492c9c17a4496b81f834a278a7221 -- Jul 10 03:32:20.230193 ip-10-0-129-177 systemd[1]: Starting Kubernetes Kubelet... Jul 10 03:32:20.698448 ip-10-0-129-177 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 03:32:20.698448 ip-10-0-129-177 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 10 03:32:20.698448 ip-10-0-129-177 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 03:32:20.698448 ip-10-0-129-177 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 10 03:32:20.698448 ip-10-0-129-177 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 03:32:20.698448 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.635901 2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 10 03:32:20.698448 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640562 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 03:32:20.698448 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640573 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 03:32:20.698448 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640577 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 03:32:20.698448 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640581 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 03:32:20.698448 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640584 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 03:32:20.698448 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640594 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 03:32:20.698448 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640597 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 03:32:20.698448 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640600 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 03:32:20.719245 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640603 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 03:32:20.719245 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640605 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 03:32:20.719245 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640608 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 03:32:20.719245 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640611 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 03:32:20.719245 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640613 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 03:32:20.719245 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640616 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 03:32:20.719245 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640619 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 03:32:20.719245 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640623 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 03:32:20.719245 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640625 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 03:32:20.719245 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640628 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 03:32:20.719245 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640631 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 03:32:20.719245 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640634 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 03:32:20.719245 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640636 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 03:32:20.719245 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640639 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 03:32:20.719245 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640642 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 03:32:20.719245 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640644 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 03:32:20.719245 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640647 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 03:32:20.719245 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640649 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 03:32:20.719245 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640652 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 03:32:20.719245 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640654 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 03:32:20.709615 ip-10-0-129-177 systemd[1]: Started Kubernetes Kubelet. Jul 10 03:32:20.933688 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640658 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 03:32:20.933688 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640660 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 03:32:20.933688 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640663 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 03:32:20.933688 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640665 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 03:32:20.933688 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640668 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 03:32:20.933688 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640671 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 03:32:20.933688 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640673 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 03:32:20.933688 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640676 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 03:32:20.933688 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640678 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 03:32:20.933688 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640681 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 03:32:20.933688 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640685 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 03:32:20.933688 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640687 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 03:32:20.933688 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640692 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 03:32:20.933688 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640695 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 03:32:20.933688 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640699 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 03:32:20.933688 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640702 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 03:32:20.933688 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640705 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 03:32:20.933688 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640708 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 03:32:20.933688 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640711 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 03:32:20.933688 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640714 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 03:32:20.942693 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640718 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 03:32:20.942693 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640721 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 03:32:20.942693 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640723 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 03:32:20.942693 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640726 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 03:32:20.942693 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640729 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 03:32:20.942693 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640731 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 03:32:20.942693 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640734 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 03:32:20.942693 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640736 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 10 03:32:20.942693 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640739 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 03:32:20.942693 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640741 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 03:32:20.942693 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640744 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 03:32:20.942693 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640746 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 03:32:20.942693 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640749 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 03:32:20.942693 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640751 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 03:32:20.942693 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640756 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 03:32:20.942693 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640759 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 03:32:20.942693 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640762 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 03:32:20.942693 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640764 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 03:32:20.942693 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640767 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 03:32:20.942693 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640770 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 03:32:20.943493 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640772 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 03:32:20.943493 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640775 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 03:32:20.943493 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640779 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 03:32:20.943493 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640784 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 03:32:20.943493 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640787 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 03:32:20.943493 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640790 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 03:32:20.943493 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640793 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 03:32:20.943493 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640795 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 03:32:20.943493 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640798 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 03:32:20.943493 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640801 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 03:32:20.943493 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640803 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 03:32:20.943493 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640806 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 03:32:20.943493 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640809 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 03:32:20.943493 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640811 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 03:32:20.943493 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640814 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 03:32:20.943493 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640816 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 03:32:20.943493 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640820 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 03:32:20.943493 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640823 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 03:32:20.943493 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640827 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 03:32:20.944266 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640830 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 03:32:20.944266 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640833 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 03:32:20.944266 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640836 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 03:32:20.944266 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640839 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 03:32:20.944266 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640842 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 03:32:20.944266 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640845 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 03:32:20.944266 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640848 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 03:32:20.944266 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640851 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 03:32:20.944266 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640855 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 03:32:20.944266 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640858 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 03:32:20.944266 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640861 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 03:32:20.944266 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.640864 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 03:32:20.944266 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644252 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 03:32:20.944266 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644264 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 03:32:20.944266 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644267 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 03:32:20.944266 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644270 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 03:32:20.944266 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644273 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 03:32:20.944266 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644276 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 03:32:20.944266 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644279 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 03:32:20.944878 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644282 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 03:32:20.944878 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644284 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 03:32:20.944878 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644288 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 03:32:20.944878 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644291 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 03:32:20.944878 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644294 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 03:32:20.944878 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644297 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 03:32:20.944878 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644299 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 03:32:20.944878 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644302 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 03:32:20.944878 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644304 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 03:32:20.944878 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644307 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 03:32:20.944878 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644309 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 10 03:32:20.944878 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644312 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 03:32:20.944878 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644314 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 03:32:20.944878 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644317 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 03:32:20.944878 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644319 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 03:32:20.944878 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644322 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 03:32:20.944878 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644324 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 03:32:20.944878 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644327 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 03:32:20.944878 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644330 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 03:32:20.944878 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644333 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 03:32:20.945715 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644336 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 03:32:20.945715 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644338 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 03:32:20.945715 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644341 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 03:32:20.945715 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644343 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 03:32:20.945715 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644347 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 03:32:20.945715 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644349 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 03:32:20.945715 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644352 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 03:32:20.945715 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644355 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 03:32:20.945715 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644359 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 03:32:20.945715 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644363 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 03:32:20.945715 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644367 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 03:32:20.945715 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644371 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 03:32:20.945715 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644374 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 03:32:20.945715 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644377 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 03:32:20.945715 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644381 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 03:32:20.945715 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644384 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 03:32:20.945715 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644386 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 03:32:20.945715 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644389 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 03:32:20.945715 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644392 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 03:32:20.946532 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644397 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 03:32:20.946532 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644401 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 03:32:20.946532 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644403 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 03:32:20.946532 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644406 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 03:32:20.946532 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644411 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 03:32:20.946532 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644413 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 03:32:20.946532 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644416 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 03:32:20.946532 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644419 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 03:32:20.946532 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644421 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 03:32:20.946532 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644424 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 03:32:20.946532 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644426 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 03:32:20.946532 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644429 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 03:32:20.946532 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644432 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 03:32:20.946532 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644434 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 03:32:20.946532 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644437 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 03:32:20.946532 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644439 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 03:32:20.946532 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644442 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 03:32:20.946532 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644444 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 03:32:20.946532 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644447 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 03:32:20.947331 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644449 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 03:32:20.947331 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644452 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 03:32:20.947331 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644454 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 03:32:20.947331 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644457 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 03:32:20.947331 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644459 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 03:32:20.947331 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644462 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 03:32:20.947331 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644464 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 03:32:20.947331 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644468 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 03:32:20.947331 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644470 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 03:32:20.947331 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644473 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 03:32:20.947331 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644476 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 03:32:20.947331 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644478 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 03:32:20.947331 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644481 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 03:32:20.947331 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644483 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 03:32:20.947331 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644486 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 03:32:20.947331 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644489 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 03:32:20.947331 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644491 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 03:32:20.947331 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644494 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 03:32:20.947331 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644498 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 03:32:20.947331 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644500 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 03:32:20.947948 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644503 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 03:32:20.947948 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644506 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 03:32:20.947948 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644509 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 03:32:20.947948 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644511 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 03:32:20.947948 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644514 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 03:32:20.947948 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644517 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 03:32:20.947948 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644519 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 03:32:20.947948 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644522 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 03:32:20.947948 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644527 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 03:32:20.947948 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644530 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 03:32:20.947948 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644533 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 03:32:20.947948 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644536 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 03:32:20.947948 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644539 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 03:32:20.947948 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644541 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 03:32:20.947948 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644899 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 03:32:20.947948 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644904 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 03:32:20.947948 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644924 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 03:32:20.947948 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644927 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 03:32:20.947948 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644930 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 03:32:20.947948 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644932 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 03:32:20.948572 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644936 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 03:32:20.948572 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644938 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 03:32:20.948572 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644941 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 03:32:20.948572 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644943 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 03:32:20.948572 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644946 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 03:32:20.948572 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644948 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 03:32:20.948572 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644951 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 03:32:20.948572 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644953 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 03:32:20.948572 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644956 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 03:32:20.948572 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644959 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 03:32:20.948572 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644963 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 03:32:20.948572 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644966 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 03:32:20.948572 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644969 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 03:32:20.948572 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644972 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 03:32:20.948572 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644974 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 03:32:20.948572 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644976 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 03:32:20.948572 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644979 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 03:32:20.948572 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644982 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 03:32:20.948572 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644984 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 03:32:20.949132 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644987 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 03:32:20.949132 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644991 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 03:32:20.949132 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644995 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 03:32:20.949132 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.644997 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 03:32:20.949132 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645000 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 03:32:20.949132 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645002 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 03:32:20.949132 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645005 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 03:32:20.949132 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645007 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 03:32:20.949132 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645010 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 03:32:20.949132 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645012 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 03:32:20.949132 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645015 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 10 03:32:20.949132 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645017 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 03:32:20.949132 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645020 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 03:32:20.949132 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645022 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 03:32:20.949132 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645025 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 03:32:20.949132 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645027 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 03:32:20.949132 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645029 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 03:32:20.949132 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645032 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 03:32:20.949132 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645034 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 03:32:20.949132 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645037 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 03:32:20.949729 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645040 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 03:32:20.949729 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645042 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 03:32:20.949729 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645045 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 03:32:20.949729 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645048 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 03:32:20.949729 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645051 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 03:32:20.949729 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645054 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 03:32:20.949729 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645057 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 03:32:20.949729 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645059 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 03:32:20.949729 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645062 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 03:32:20.949729 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645064 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 03:32:20.949729 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645067 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 03:32:20.949729 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645071 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 03:32:20.949729 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645074 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 03:32:20.949729 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645078 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 03:32:20.949729 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645081 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 03:32:20.949729 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645083 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 03:32:20.949729 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645086 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 03:32:20.949729 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645088 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 03:32:20.949729 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645091 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 03:32:20.950288 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645094 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 03:32:20.950288 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645096 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 03:32:20.950288 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645099 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 03:32:20.950288 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645103 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 03:32:20.950288 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645106 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 03:32:20.950288 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645109 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 03:32:20.950288 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645113 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 03:32:20.950288 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645115 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 03:32:20.950288 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645119 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 03:32:20.950288 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645122 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 03:32:20.950288 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645125 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 03:32:20.950288 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645128 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 03:32:20.950288 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645130 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 03:32:20.950288 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645133 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 03:32:20.950288 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645136 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 03:32:20.950288 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645138 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 03:32:20.950288 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645142 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 03:32:20.950288 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645144 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 03:32:20.950288 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645147 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 03:32:20.950288 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645150 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 03:32:20.950849 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645152 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 03:32:20.950849 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645154 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 03:32:20.950849 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645157 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 03:32:20.950849 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645161 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 03:32:20.950849 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645164 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 03:32:20.950849 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645167 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 03:32:20.950849 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645171 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 03:32:20.950849 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645173 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 03:32:20.950849 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645176 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 03:32:20.950849 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645179 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 03:32:20.950849 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645182 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 03:32:20.950849 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645185 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 03:32:20.950849 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645187 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 03:32:20.950849 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645190 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 03:32:20.950849 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645192 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 03:32:20.950849 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645266 2582 flags.go:64] FLAG: --address="0.0.0.0" Jul 10 03:32:20.950849 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645279 2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 10 03:32:20.950849 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645285 2582 flags.go:64] FLAG: --anonymous-auth="true" Jul 10 03:32:20.950849 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645289 2582 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 10 03:32:20.950849 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645293 2582 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 10 03:32:20.951389 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645296 2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 10 03:32:20.951389 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645300 2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 10 03:32:20.951389 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645304 2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 10 03:32:20.951389 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645307 2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 10 03:32:20.951389 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645310 2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 10 03:32:20.951389 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645313 2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 10 03:32:20.951389 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645316 2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 10 03:32:20.951389 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645319 2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 10 03:32:20.951389 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645323 2582 flags.go:64] FLAG: --cgroup-root="" Jul 10 03:32:20.951389 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645326 2582 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 10 03:32:20.951389 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645329 2582 flags.go:64] FLAG: --client-ca-file="" Jul 10 03:32:20.951389 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645333 2582 flags.go:64] FLAG: --cloud-provider="external" Jul 10 03:32:20.951389 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645336 2582 flags.go:64] FLAG: --cluster-dns="[]" Jul 10 03:32:20.951389 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645340 2582 flags.go:64] FLAG: --cluster-domain="" Jul 10 03:32:20.951389 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645342 2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 10 03:32:20.951389 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645345 2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 10 03:32:20.951389 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645348 2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 10 03:32:20.951389 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645351 2582 flags.go:64] FLAG: --container-log-max-files="5" Jul 10 03:32:20.951389 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645356 2582 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 10 03:32:20.951389 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645359 2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 10 03:32:20.951389 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645362 2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 10 03:32:20.951389 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645365 2582 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 10 03:32:20.951389 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645368 2582 flags.go:64] FLAG: --contention-profiling="false" Jul 10 03:32:20.951389 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645371 2582 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 10 03:32:20.952091 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645374 2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 10 03:32:20.952091 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645377 2582 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 10 03:32:20.952091 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645380 2582 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 10 03:32:20.952091 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645383 2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 10 03:32:20.952091 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645387 2582 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 10 03:32:20.952091 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645389 2582 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 10 03:32:20.952091 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645392 2582 flags.go:64] FLAG: --enable-load-reader="false" Jul 10 03:32:20.952091 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645395 2582 flags.go:64] FLAG: --enable-server="true" Jul 10 03:32:20.952091 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645398 2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 10 03:32:20.952091 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645403 2582 flags.go:64] FLAG: --event-burst="100" Jul 10 03:32:20.952091 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645406 2582 flags.go:64] FLAG: --event-qps="50" Jul 10 03:32:20.952091 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645408 2582 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 10 03:32:20.952091 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645411 2582 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 10 03:32:20.952091 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645414 2582 flags.go:64] FLAG: --eviction-hard="" Jul 10 03:32:20.952091 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645417 2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 10 03:32:20.952091 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645420 2582 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 10 03:32:20.952091 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645424 2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 10 03:32:20.952091 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645427 2582 flags.go:64] FLAG: --eviction-soft="" Jul 10 03:32:20.952091 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645430 2582 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 10 03:32:20.952091 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645433 2582 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 10 03:32:20.952091 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645436 2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 10 03:32:20.952091 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645439 2582 flags.go:64] FLAG: --experimental-mounter-path="" Jul 10 03:32:20.952091 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645442 2582 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 10 03:32:20.952091 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645445 2582 flags.go:64] FLAG: --fail-swap-on="true" Jul 10 03:32:20.952091 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645447 2582 flags.go:64] FLAG: --feature-gates="" Jul 10 03:32:20.952872 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645451 2582 flags.go:64] FLAG: --file-check-frequency="20s" Jul 10 03:32:20.952872 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645455 2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 10 03:32:20.952872 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645458 2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 10 03:32:20.952872 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645461 2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 10 03:32:20.952872 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645464 2582 flags.go:64] FLAG: --healthz-port="10248" Jul 10 03:32:20.952872 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645467 2582 flags.go:64] FLAG: --help="false" Jul 10 03:32:20.952872 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645470 2582 flags.go:64] FLAG: --hostname-override="ip-10-0-129-177.ec2.internal" Jul 10 03:32:20.952872 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645473 2582 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 10 03:32:20.952872 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645476 2582 flags.go:64] FLAG: --http-check-frequency="20s" Jul 10 03:32:20.952872 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645478 2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 10 03:32:20.952872 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645483 2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 10 03:32:20.952872 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645486 2582 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 10 03:32:20.952872 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645489 2582 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 10 03:32:20.952872 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645492 2582 flags.go:64] FLAG: --image-service-endpoint="" Jul 10 03:32:20.952872 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645494 2582 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 10 03:32:20.952872 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645497 2582 flags.go:64] FLAG: --kube-api-burst="100" Jul 10 03:32:20.952872 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645500 2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 10 03:32:20.952872 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645503 2582 flags.go:64] FLAG: --kube-api-qps="50" Jul 10 03:32:20.952872 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645506 2582 flags.go:64] FLAG: --kube-reserved="" Jul 10 03:32:20.952872 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645509 2582 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 10 03:32:20.952872 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645512 2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 10 03:32:20.952872 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645515 2582 flags.go:64] FLAG: --kubelet-cgroups="" Jul 10 03:32:20.952872 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645517 2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 10 03:32:20.952872 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645521 2582 flags.go:64] FLAG: --lock-file="" Jul 10 03:32:20.953566 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645525 2582 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 10 03:32:20.953566 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645528 2582 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 10 03:32:20.953566 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645530 2582 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 10 03:32:20.953566 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645535 2582 flags.go:64] FLAG: --log-json-split-stream="false" Jul 10 03:32:20.953566 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645538 2582 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 10 03:32:20.953566 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645541 2582 flags.go:64] FLAG: --log-text-split-stream="false" Jul 10 03:32:20.953566 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645544 2582 flags.go:64] FLAG: --logging-format="text" Jul 10 03:32:20.953566 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645547 2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 10 03:32:20.953566 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645550 2582 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 10 03:32:20.953566 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645554 2582 flags.go:64] FLAG: --manifest-url="" Jul 10 03:32:20.953566 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645556 2582 flags.go:64] FLAG: --manifest-url-header="" Jul 10 03:32:20.953566 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645560 2582 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 10 03:32:20.953566 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645564 2582 flags.go:64] FLAG: --max-open-files="1000000" Jul 10 03:32:20.953566 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645567 2582 flags.go:64] FLAG: --max-pods="110" Jul 10 03:32:20.953566 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645570 2582 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 10 03:32:20.953566 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645573 2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 10 03:32:20.953566 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645576 2582 flags.go:64] FLAG: --memory-manager-policy="None" Jul 10 03:32:20.953566 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645579 2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 10 03:32:20.953566 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645582 2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 10 03:32:20.953566 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645585 2582 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 10 03:32:20.953566 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645588 2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 10 03:32:20.953566 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645595 2582 flags.go:64] FLAG: --node-status-max-images="50" Jul 10 03:32:20.953566 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645598 2582 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 10 03:32:20.953566 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645601 2582 flags.go:64] FLAG: --oom-score-adj="-999" Jul 10 03:32:20.953566 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645604 2582 flags.go:64] FLAG: --pod-cidr="" Jul 10 03:32:20.954281 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645607 2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 10 03:32:20.954281 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645612 2582 flags.go:64] FLAG: --pod-manifest-path="" Jul 10 03:32:20.954281 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645614 2582 flags.go:64] FLAG: --pod-max-pids="-1" Jul 10 03:32:20.954281 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645617 2582 flags.go:64] FLAG: --pods-per-core="0" Jul 10 03:32:20.954281 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645620 2582 flags.go:64] FLAG: --port="10250" Jul 10 03:32:20.954281 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645623 2582 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 10 03:32:20.954281 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645627 2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0189b8b695f4189c9" Jul 10 03:32:20.954281 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645631 2582 flags.go:64] FLAG: --qos-reserved="" Jul 10 03:32:20.954281 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645633 2582 flags.go:64] FLAG: --read-only-port="10255" Jul 10 03:32:20.954281 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645636 2582 flags.go:64] FLAG: --register-node="true" Jul 10 03:32:20.954281 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645639 2582 flags.go:64] FLAG: --register-with-taints="" Jul 10 03:32:20.954281 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645642 2582 flags.go:64] FLAG: --registry-burst="10" Jul 10 03:32:20.954281 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645646 2582 flags.go:64] FLAG: --registry-qps="5" Jul 10 03:32:20.954281 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645649 2582 flags.go:64] FLAG: --reserved-cpus="" Jul 10 03:32:20.954281 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645651 2582 flags.go:64] FLAG: --reserved-memory="" Jul 10 03:32:20.954281 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645655 2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 10 03:32:20.954281 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645658 2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 10 03:32:20.954281 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645662 2582 flags.go:64] FLAG: --rotate-certificates="false" Jul 10 03:32:20.954281 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645665 2582 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 10 03:32:20.954281 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645668 2582 flags.go:64] FLAG: --runonce="false" Jul 10 03:32:20.954281 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645671 2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 10 03:32:20.954281 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645674 2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 10 03:32:20.954281 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645677 2582 flags.go:64] FLAG: --seccomp-default="false" Jul 10 03:32:20.954281 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645680 2582 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 10 03:32:20.954281 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645682 2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 10 03:32:20.954983 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645685 2582 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 10 03:32:20.954983 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645688 2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 10 03:32:20.954983 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645696 2582 flags.go:64] FLAG: --storage-driver-password="root" Jul 10 03:32:20.954983 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645699 2582 flags.go:64] FLAG: --storage-driver-secure="false" Jul 10 03:32:20.954983 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645701 2582 flags.go:64] FLAG: --storage-driver-table="stats" Jul 10 03:32:20.954983 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645704 2582 flags.go:64] FLAG: --storage-driver-user="root" Jul 10 03:32:20.954983 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645707 2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 10 03:32:20.954983 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645710 2582 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 10 03:32:20.954983 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645713 2582 flags.go:64] FLAG: --system-cgroups="" Jul 10 03:32:20.954983 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645715 2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 10 03:32:20.954983 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645721 2582 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 10 03:32:20.954983 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645724 2582 flags.go:64] FLAG: --tls-cert-file="" Jul 10 03:32:20.954983 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645726 2582 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 10 03:32:20.954983 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645732 2582 flags.go:64] FLAG: --tls-min-version="" Jul 10 03:32:20.954983 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645734 2582 flags.go:64] FLAG: --tls-private-key-file="" Jul 10 03:32:20.954983 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645737 2582 flags.go:64] FLAG: --topology-manager-policy="none" Jul 10 03:32:20.954983 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645740 2582 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 10 03:32:20.954983 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645743 2582 flags.go:64] FLAG: --topology-manager-scope="container" Jul 10 03:32:20.954983 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645746 2582 flags.go:64] FLAG: --v="2" Jul 10 03:32:20.954983 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645754 2582 flags.go:64] FLAG: --version="false" Jul 10 03:32:20.954983 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645758 2582 flags.go:64] FLAG: --vmodule="" Jul 10 03:32:20.954983 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645762 2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 10 03:32:20.954983 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.645765 2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 10 03:32:20.954983 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645901 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 03:32:20.954983 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645924 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 03:32:20.955928 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645929 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 03:32:20.955928 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645934 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 03:32:20.955928 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645938 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 03:32:20.955928 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645940 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 03:32:20.955928 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645943 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 03:32:20.955928 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645947 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 03:32:20.955928 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645951 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 03:32:20.955928 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645953 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 03:32:20.955928 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645956 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 03:32:20.955928 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645959 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 03:32:20.955928 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645962 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 03:32:20.955928 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645964 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 03:32:20.955928 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645967 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 03:32:20.955928 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645970 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 03:32:20.955928 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645972 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 03:32:20.955928 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645975 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 03:32:20.955928 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645977 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 03:32:20.955928 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645979 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 03:32:20.955928 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645982 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 03:32:20.956495 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645984 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 03:32:20.956495 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645989 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 03:32:20.956495 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645992 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 03:32:20.956495 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645994 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 03:32:20.956495 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645997 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 03:32:20.956495 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.645999 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 03:32:20.956495 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646002 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 03:32:20.956495 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646004 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 03:32:20.956495 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646007 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 03:32:20.956495 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646010 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 03:32:20.956495 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646013 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 03:32:20.956495 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646016 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 03:32:20.956495 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646020 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 03:32:20.956495 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646022 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 03:32:20.956495 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646025 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 03:32:20.956495 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646027 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 03:32:20.956495 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646030 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 10 03:32:20.956495 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646032 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 03:32:20.956495 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646035 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 03:32:20.956495 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646038 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 03:32:21.167956 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646040 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 03:32:21.167956 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646043 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 03:32:21.167956 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646046 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 03:32:21.167956 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646048 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 03:32:21.167956 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646050 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 03:32:21.167956 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646053 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 03:32:21.167956 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646055 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 03:32:21.167956 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646058 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 03:32:21.167956 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646060 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 03:32:21.167956 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646063 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 03:32:21.167956 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646065 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 03:32:21.167956 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646070 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 03:32:21.167956 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646073 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 03:32:21.167956 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646078 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 03:32:21.167956 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646081 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 03:32:21.167956 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646084 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 03:32:21.167956 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646086 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 03:32:21.167956 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646089 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 03:32:21.167956 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646092 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 03:32:21.168881 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646094 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 03:32:21.168881 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646098 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 03:32:21.168881 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646101 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 03:32:21.168881 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646105 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 03:32:21.168881 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646108 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 03:32:21.168881 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646112 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 03:32:21.168881 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646114 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 03:32:21.168881 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646117 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 03:32:21.168881 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646119 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 03:32:21.168881 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646122 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 03:32:21.168881 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646124 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 03:32:21.168881 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646127 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 03:32:21.168881 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646129 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 03:32:21.168881 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646132 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 03:32:21.168881 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646135 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 03:32:21.168881 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646137 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 03:32:21.168881 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646139 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 03:32:21.168881 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646142 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 03:32:21.168881 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646144 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 03:32:21.169482 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646147 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 03:32:21.169482 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646149 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 03:32:21.169482 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646152 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 03:32:21.169482 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646155 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 03:32:21.169482 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646158 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 03:32:21.169482 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646160 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 03:32:21.169482 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646162 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 03:32:21.169482 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646166 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 03:32:21.169482 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646169 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 03:32:21.169482 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646171 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 03:32:21.169482 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646174 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 03:32:21.169482 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646176 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 03:32:21.169482 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646179 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 03:32:21.169482 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646181 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 03:32:21.169482 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646184 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 03:32:21.169482 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646186 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 03:32:21.169482 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646189 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 03:32:21.169482 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646192 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 03:32:21.169482 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646196 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 03:32:21.169482 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.646198 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 03:32:21.170063 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.646851 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 03:32:21.170063 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.653771 2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 10 03:32:21.170063 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.653786 2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 10 03:32:21.170063 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.654618 2582 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 10 03:32:21.170063 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.654626 2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 10 03:32:21.170063 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654685 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 03:32:21.170063 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654690 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 03:32:21.170063 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654694 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 03:32:21.170063 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654697 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 03:32:21.170063 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654700 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 03:32:21.170063 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654703 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 03:32:21.170063 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654706 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 03:32:21.170063 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654710 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 03:32:21.170063 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654714 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 03:32:21.170455 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654717 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 03:32:21.170455 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654720 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 03:32:21.170455 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654723 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 03:32:21.170455 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654726 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 03:32:21.170455 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654729 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 03:32:21.170455 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654731 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 03:32:21.170455 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654734 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 03:32:21.170455 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654737 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 03:32:21.170455 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654739 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 03:32:21.170455 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654742 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 03:32:21.170455 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654745 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 03:32:21.170455 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654748 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 03:32:21.170455 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654752 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 03:32:21.170455 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654755 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 03:32:21.170455 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654758 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 03:32:21.170455 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654761 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 03:32:21.170455 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654764 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 03:32:21.170455 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654767 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 03:32:21.170455 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654769 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 03:32:21.170455 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654772 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 03:32:21.171028 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654775 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 03:32:21.171028 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654777 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 03:32:21.171028 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654780 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 03:32:21.171028 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654782 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 03:32:21.171028 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654785 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 03:32:21.171028 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654788 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 03:32:21.171028 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654790 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 03:32:21.171028 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654793 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 03:32:21.171028 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654795 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 03:32:21.171028 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654798 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 03:32:21.171028 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654803 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 03:32:21.171028 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654806 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 03:32:21.171028 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654810 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 03:32:21.171028 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654813 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 03:32:21.171028 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654815 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 03:32:21.171028 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654818 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 03:32:21.171028 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654821 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 03:32:21.171028 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654824 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 03:32:21.171028 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654827 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 03:32:21.171540 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654830 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 03:32:21.171540 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654833 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 03:32:21.171540 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654835 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 03:32:21.171540 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654838 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 03:32:21.171540 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654841 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 03:32:21.171540 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654844 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 03:32:21.171540 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654847 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 03:32:21.171540 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654850 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 03:32:21.171540 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654852 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 03:32:21.171540 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654855 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 03:32:21.171540 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654858 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 03:32:21.171540 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654860 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 03:32:21.171540 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654863 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 03:32:21.171540 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654865 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 03:32:21.171540 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654868 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 03:32:21.171540 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654870 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 03:32:21.171540 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654873 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 03:32:21.171540 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654875 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 03:32:21.171540 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654878 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 03:32:21.172094 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654881 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 03:32:21.172094 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654883 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 03:32:21.172094 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654887 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 03:32:21.172094 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654890 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 03:32:21.172094 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654892 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 03:32:21.172094 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654895 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 03:32:21.172094 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654897 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 03:32:21.172094 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654900 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 03:32:21.172094 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654902 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 10 03:32:21.172094 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654921 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 03:32:21.172094 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654927 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 03:32:21.172094 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654930 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 03:32:21.172094 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654933 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 03:32:21.172094 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654936 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 03:32:21.172094 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654938 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 03:32:21.172094 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654941 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 03:32:21.172094 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654943 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 03:32:21.172094 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654946 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 03:32:21.172094 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654952 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 03:32:21.172592 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654954 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 03:32:21.172592 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654957 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 03:32:21.172592 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654960 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 03:32:21.172592 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654962 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 03:32:21.172592 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654966 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 03:32:21.172592 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654968 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 03:32:21.172592 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654971 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 03:32:21.172592 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654974 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 03:32:21.172592 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654976 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 03:32:21.172592 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654979 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 03:32:21.172592 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654981 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 03:32:21.172592 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654984 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 03:32:21.172592 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.654986 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 03:32:21.172592 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.654992 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 03:32:21.172592 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655102 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 03:32:21.173052 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655107 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 03:32:21.173052 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655110 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 03:32:21.173052 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655113 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 03:32:21.173052 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655116 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 03:32:21.173052 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655119 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 03:32:21.173052 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655121 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 03:32:21.173052 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655124 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 03:32:21.173052 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655127 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 03:32:21.173052 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655129 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 03:32:21.173052 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655131 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 03:32:21.173052 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655134 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 03:32:21.173052 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655137 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 03:32:21.173052 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655139 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 03:32:21.173052 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655142 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 03:32:21.173052 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655145 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 03:32:21.173052 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655147 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 03:32:21.173052 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655150 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 03:32:21.173052 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655154 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 03:32:21.173052 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655157 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 03:32:21.173052 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655159 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 03:32:21.173568 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655162 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 03:32:21.173568 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655164 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 03:32:21.173568 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655167 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 03:32:21.173568 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655170 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 03:32:21.173568 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655173 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 03:32:21.173568 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655175 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 03:32:21.173568 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655178 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 03:32:21.173568 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655180 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 03:32:21.173568 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655183 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 03:32:21.173568 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655186 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 03:32:21.173568 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655188 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 03:32:21.173568 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655191 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 03:32:21.173568 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655194 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 03:32:21.173568 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655197 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 03:32:21.173568 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655200 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 03:32:21.173568 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655202 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 03:32:21.173568 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655205 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 03:32:21.173568 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655209 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 03:32:21.173568 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655212 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 03:32:21.174108 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655215 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 03:32:21.174108 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655218 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 03:32:21.174108 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655221 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 03:32:21.174108 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655224 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 03:32:21.174108 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655227 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 03:32:21.174108 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655229 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 03:32:21.174108 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655232 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 03:32:21.174108 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655234 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 03:32:21.174108 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655237 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 03:32:21.174108 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655240 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 03:32:21.174108 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655244 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 03:32:21.174108 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655247 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 03:32:21.174108 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655250 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 03:32:21.174108 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655252 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 03:32:21.174108 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655255 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 03:32:21.174108 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655258 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 03:32:21.174108 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655264 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 03:32:21.174108 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655267 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 03:32:21.174108 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655269 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 03:32:21.174108 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655272 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 03:32:21.174631 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655274 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 03:32:21.174631 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655277 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 03:32:21.174631 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655279 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 03:32:21.174631 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655282 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 03:32:21.174631 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655285 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 03:32:21.174631 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655289 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 03:32:21.174631 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655291 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 03:32:21.174631 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655294 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 03:32:21.174631 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655296 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 03:32:21.174631 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655299 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 03:32:21.174631 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655301 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 03:32:21.174631 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655304 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 03:32:21.174631 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655306 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 03:32:21.174631 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655309 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 03:32:21.174631 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655311 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 03:32:21.174631 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655314 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 10 03:32:21.174631 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655316 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 03:32:21.174631 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655319 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 03:32:21.174631 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655321 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 03:32:21.175206 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655324 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 03:32:21.175206 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655326 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 03:32:21.175206 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655329 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 03:32:21.175206 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655332 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 03:32:21.175206 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655335 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 03:32:21.175206 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655338 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 03:32:21.175206 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655340 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 03:32:21.175206 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655343 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 03:32:21.175206 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655345 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 03:32:21.175206 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655348 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 03:32:21.175206 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655351 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 03:32:21.175206 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655353 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 03:32:21.175206 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655356 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 03:32:21.175206 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655359 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 03:32:21.175206 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655361 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 03:32:21.175206 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655364 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 03:32:21.175206 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655366 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 03:32:21.175206 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655370 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 03:32:21.175206 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655374 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 03:32:21.175692 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:20.655378 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 03:32:21.175692 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.655383 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 03:32:21.175692 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.655472 2582 server.go:962] "Client rotation is on, will bootstrap in background" Jul 10 03:32:21.175692 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.658227 2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 10 03:32:21.175692 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.660474 2582 server.go:1019] "Starting client certificate rotation" Jul 10 03:32:21.175692 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.660571 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 03:32:21.175692 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.660602 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 03:32:21.175692 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.662832 2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 03:32:21.175692 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.667422 2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 03:32:21.175692 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.677581 2582 log.go:25] "Validated CRI v1 runtime API" Jul 10 03:32:21.175692 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.679830 2582 log.go:25] "Validated CRI v1 image API" Jul 10 03:32:21.175692 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.681893 2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 10 03:32:21.176110 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.684132 2582 fs.go:135] Filesystem UUIDs: map[4810c6fb-f9a6-493b-b867-212c751d33d1:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 f37f8344-f703-408a-9ad1-3786f4d26c22:/dev/nvme0n1p3] Jul 10 03:32:21.176110 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.684147 2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 10 03:32:21.176110 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.689085 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 03:32:21.343622 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.690188 2582 manager.go:216] Machine: {Timestamp:2026-07-10 03:32:20.688795289 +0000 UTC m=+0.340606932 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100295 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ad14cea985be0f8a47fba1cabc67d SystemUUID:ec2ad14c-ea98-5be0-f8a4-7fba1cabc67d BootID:13c492c9-c17a-4496-b81f-834a278a7221 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:75:65:24:f0:db Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:75:65:24:f0:db Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:e1:cd:8c:77:63 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 10 03:32:21.343622 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.690288 2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 10 03:32:21.343622 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.690358 2582 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 10 03:32:21.343622 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.693614 2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 10 03:32:21.343622 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.693638 2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-177.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 10 03:32:21.343622 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.694811 2582 topology_manager.go:138] "Creating topology manager with none policy" Jul 10 03:32:21.343622 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.694822 2582 container_manager_linux.go:309] "Creating device plugin manager" Jul 10 03:32:21.343622 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.694830 2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 03:32:21.343622 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.695507 2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 03:32:21.343622 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.696673 2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 10 03:32:21.343622 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.700074 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 10 03:32:21.343622 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.700177 2582 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 10 03:32:21.343622 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.700205 2582 kubelet.go:486] "Attempting to sync node with API server" Jul 10 03:32:21.343622 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.700214 2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 10 03:32:21.343622 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.700228 2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 10 03:32:21.343622 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.700236 2582 kubelet.go:398] "Adding apiserver pod source" Jul 10 03:32:21.343622 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.700245 2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 10 03:32:21.343622 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.700559 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.700574 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.702225 2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.704004 2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.704034 2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.704798 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.704811 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.704817 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.704823 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.704831 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.704836 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.704844 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.704849 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.704855 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.704860 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.704869 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.704874 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.705638 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.705646 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.706612 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gzg8m" Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.708525 2582 server.go:1268] "Started kubelet" Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.708619 2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.708634 2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.708677 2582 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.711982 2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.713303 2582 server.go:310] "Adding debug handlers to kubelet server" Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.714006 2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-177.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:20.714030 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:20.714035 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-177.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:20.714298 2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.714706 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gzg8m" Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:20.715654 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-177.ec2.internal.18c0d02c340389ce default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-177.ec2.internal,UID:ip-10-0-129-177.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-177.ec2.internal,},FirstTimestamp:2026-07-10 03:32:20.708501966 +0000 UTC m=+0.360313606,LastTimestamp:2026-07-10 03:32:20.708501966 +0000 UTC m=+0.360313606,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-177.ec2.internal,}" Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.719719 2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.720005 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:20.720758 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-177.ec2.internal\" not found" Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.721346 2582 factory.go:55] Registering systemd factory Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.721360 2582 factory.go:223] Registration of the systemd container factory successfully Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.721605 2582 factory.go:153] Registering CRI-O factory Jul 10 03:32:21.345359 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.721618 2582 factory.go:223] Registration of the crio container factory successfully Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.721658 2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.721679 2582 factory.go:103] Registering Raw factory Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.721688 2582 manager.go:1196] Started watching for new ooms in manager Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.722252 2582 manager.go:349] Starting recovery of all containers Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.722396 2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.722399 2582 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.722437 2582 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.722515 2582 reconstruct.go:97] "Volume reconstruction finished" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.722525 2582 reconciler.go:29] "Reconciler: start to sync state" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.726268 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:20.729189 2582 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-177.ec2.internal\" not found" node="ip-10-0-129-177.ec2.internal" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.731714 2582 manager.go:354] Recovery completed Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.735632 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.737611 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasSufficientMemory" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.737639 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.737776 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasSufficientPID" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.742029 2582 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.742038 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.742041 2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.742057 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.743286 2582 policy_none.go:49] "None policy: Start" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.743300 2582 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.743313 2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.743612 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasSufficientMemory" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.743642 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.743656 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasSufficientPID" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.744525 2582 policy_none.go:47] "Start" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.788440 2582 manager.go:337] "Starting Device Plugin manager" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:20.788474 2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.788483 2582 server.go:87] "Starting device plugin registration server" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.788693 2582 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.788706 2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.788786 2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.788879 2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.788887 2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:20.789330 2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:20.789367 2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-177.ec2.internal\" not found" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.876774 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.878044 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.878082 2582 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.878102 2582 kubelet.go:2448] "Starting kubelet main sync loop" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:20.878135 2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.880721 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.889747 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.890474 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasSufficientMemory" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.890505 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.890522 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasSufficientPID" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.890545 2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-177.ec2.internal" Jul 10 03:32:21.346430 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.898473 2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-177.ec2.internal" Jul 10 03:32:21.349823 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:20.898490 2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-177.ec2.internal\": node \"ip-10-0-129-177.ec2.internal\" not found" Jul 10 03:32:21.349823 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:20.916759 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-177.ec2.internal\" not found" Jul 10 03:32:21.349823 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.978615 2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-177.ec2.internal"] Jul 10 03:32:21.349823 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.978673 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 03:32:21.349823 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.980318 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasSufficientMemory" Jul 10 03:32:21.349823 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.980347 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 03:32:21.349823 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.980362 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasSufficientPID" Jul 10 03:32:21.349823 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.981571 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 03:32:21.349823 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.981681 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal" Jul 10 03:32:21.349823 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.981721 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 03:32:21.349823 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.982217 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasSufficientMemory" Jul 10 03:32:21.349823 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.982238 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 03:32:21.349823 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.982246 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasSufficientPID" Jul 10 03:32:21.349823 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.982269 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasSufficientMemory" Jul 10 03:32:21.349823 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.982285 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 03:32:21.349823 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.982293 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasSufficientPID" Jul 10 03:32:21.349823 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.983349 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-177.ec2.internal" Jul 10 03:32:21.349823 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.983368 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 03:32:21.349823 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.983983 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasSufficientMemory" Jul 10 03:32:21.349823 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.984009 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 03:32:21.349823 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:20.984021 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeHasSufficientPID" Jul 10 03:32:21.349823 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:21.016460 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-177.ec2.internal\" not found" node="ip-10-0-129-177.ec2.internal" Jul 10 03:32:21.349823 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:21.017072 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-177.ec2.internal\" not found" Jul 10 03:32:21.349823 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:21.020635 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-177.ec2.internal\" not found" node="ip-10-0-129-177.ec2.internal" Jul 10 03:32:21.349823 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:21.024130 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb15e62f3258279013b97e71154b6a99-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal\" (UID: \"fb15e62f3258279013b97e71154b6a99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal" Jul 10 03:32:21.349823 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:21.024148 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b3bbcd29caffd89ad8909fd7d2acd9c9-config\") pod \"kube-apiserver-proxy-ip-10-0-129-177.ec2.internal\" (UID: \"b3bbcd29caffd89ad8909fd7d2acd9c9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-177.ec2.internal" Jul 10 03:32:21.349823 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:21.024165 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fb15e62f3258279013b97e71154b6a99-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal\" (UID: \"fb15e62f3258279013b97e71154b6a99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal" Jul 10 03:32:21.349823 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:21.118082 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-177.ec2.internal\" not found" Jul 10 03:32:21.349823 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:21.124452 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fb15e62f3258279013b97e71154b6a99-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal\" (UID: \"fb15e62f3258279013b97e71154b6a99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal" Jul 10 03:32:21.349823 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:21.124500 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/fb15e62f3258279013b97e71154b6a99-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal\" (UID: \"fb15e62f3258279013b97e71154b6a99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal" Jul 10 03:32:21.350856 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:21.124535 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb15e62f3258279013b97e71154b6a99-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal\" (UID: \"fb15e62f3258279013b97e71154b6a99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal" Jul 10 03:32:21.350856 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:21.124559 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b3bbcd29caffd89ad8909fd7d2acd9c9-config\") pod \"kube-apiserver-proxy-ip-10-0-129-177.ec2.internal\" (UID: \"b3bbcd29caffd89ad8909fd7d2acd9c9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-177.ec2.internal" Jul 10 03:32:21.350856 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:21.124594 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b3bbcd29caffd89ad8909fd7d2acd9c9-config\") pod \"kube-apiserver-proxy-ip-10-0-129-177.ec2.internal\" (UID: \"b3bbcd29caffd89ad8909fd7d2acd9c9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-177.ec2.internal" Jul 10 03:32:21.350856 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:21.124618 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb15e62f3258279013b97e71154b6a99-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal\" (UID: \"fb15e62f3258279013b97e71154b6a99\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal" Jul 10 03:32:21.350856 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:21.218821 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-177.ec2.internal\" not found" Jul 10 03:32:21.350856 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:21.319343 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-177.ec2.internal\" not found" Jul 10 03:32:21.350856 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:21.320442 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal" Jul 10 03:32:21.350856 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:21.324669 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-177.ec2.internal" Jul 10 03:32:21.525656 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:21.420593 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-177.ec2.internal\" not found" Jul 10 03:32:21.525656 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:21.521728 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-177.ec2.internal\" not found" Jul 10 03:32:21.709830 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:21.622227 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-177.ec2.internal\" not found" Jul 10 03:32:21.709830 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:21.658582 2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 10 03:32:21.709830 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:21.658704 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 10 03:32:21.709830 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:21.658728 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 10 03:32:21.844040 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:21.720470 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 03:27:21 +0000 UTC" deadline="2028-04-14 08:50:07.01235891 +0000 UTC" Jul 10 03:32:21.844040 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:21.720501 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15461h17m45.291861848s" Jul 10 03:32:21.844040 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:21.722645 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-177.ec2.internal\" not found" Jul 10 03:32:21.844040 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:21.823092 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-177.ec2.internal\" not found" Jul 10 03:32:22.024313 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:21.914666 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb15e62f3258279013b97e71154b6a99.slice/crio-9b8d140ce4896921f0f735970bcdeeb9b4ec25db5cab0e5538ab2431eb771cab WatchSource:0}: Error finding container 9b8d140ce4896921f0f735970bcdeeb9b4ec25db5cab0e5538ab2431eb771cab: Status 404 returned error can't find the container with id 9b8d140ce4896921f0f735970bcdeeb9b4ec25db5cab0e5538ab2431eb771cab Jul 10 03:32:22.024313 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:21.920144 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 03:32:22.024313 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:21.924039 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-177.ec2.internal\" not found" Jul 10 03:32:22.024313 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:21.940130 2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 03:32:22.025283 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:22.025039 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-177.ec2.internal\" not found" Jul 10 03:32:22.229659 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:22.125246 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-177.ec2.internal\" not found" Jul 10 03:32:22.229659 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:22.226009 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-177.ec2.internal\" not found" Jul 10 03:32:22.384299 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.318286 2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 03:32:22.384299 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.321137 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-177.ec2.internal" Jul 10 03:32:22.384299 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.330863 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 03:32:22.384299 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.331720 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal" Jul 10 03:32:22.384299 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.341569 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 03:32:22.695500 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.670559 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 03:32:22.774390 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.701297 2582 apiserver.go:52] "Watching apiserver" Jul 10 03:32:22.774390 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.715121 2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 10 03:32:22.774390 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.715551 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-5c85h","openshift-network-operator/iptables-alerter-b7b6g","openshift-ovn-kubernetes/ovnkube-node-pjnbc","kube-system/global-pull-secret-syncer-jznf5","kube-system/konnectivity-agent-7g6b4","kube-system/kube-apiserver-proxy-ip-10-0-129-177.ec2.internal","openshift-cluster-node-tuning-operator/tuned-cdwtj","openshift-image-registry/node-ca-7glzx","openshift-multus/multus-p7v8n","openshift-multus/network-metrics-daemon-ddntq","openshift-network-diagnostics/network-check-target-bv6dh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fspx","openshift-dns/node-resolver-n7lff","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal"] Jul 10 03:32:22.774390 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.717117 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.774390 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.719602 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 10 03:32:22.774390 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.719877 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gqct6\"" Jul 10 03:32:22.774390 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.720082 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 10 03:32:22.774390 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.720230 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.774390 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.719793 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n7lff" Jul 10 03:32:22.774390 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.721659 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 10 03:32:22.774390 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.721724 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:32:22.774390 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:22.721790 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jznf5" podUID="8ed54eed-0e8e-490d-acc6-56615ee5340b" Jul 10 03:32:22.774390 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.722664 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 10 03:32:22.774390 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.723013 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 10 03:32:22.774390 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.723065 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 10 03:32:22.774390 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.723318 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 10 03:32:22.774390 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.723354 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 10 03:32:22.774390 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.723442 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7g6b4" Jul 10 03:32:22.774390 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.723458 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 10 03:32:22.774390 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.723561 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2x47q\"" Jul 10 03:32:22.774390 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.723843 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 10 03:32:22.774390 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.724252 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ldt9j\"" Jul 10 03:32:22.774390 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.724348 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 10 03:32:22.774390 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.725267 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7glzx" Jul 10 03:32:22.774390 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.725806 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 10 03:32:22.774390 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.726399 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 10 03:32:22.774390 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.726607 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qnp25\"" Jul 10 03:32:22.774390 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.726729 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.774390 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.727393 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 10 03:32:22.774390 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.727744 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 10 03:32:22.774390 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.727752 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cbf46\"" Jul 10 03:32:22.774390 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.728074 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 10 03:32:22.774390 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.728320 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5c85h" Jul 10 03:32:22.774390 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.728959 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 10 03:32:22.778871 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.729110 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 10 03:32:22.778871 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.729171 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 10 03:32:22.778871 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.729304 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 10 03:32:22.778871 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.730014 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-v4f6v\"" Jul 10 03:32:22.778871 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.730213 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b7b6g" Jul 10 03:32:22.778871 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.730686 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 10 03:32:22.778871 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.730736 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qnc2d\"" Jul 10 03:32:22.778871 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.731086 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 10 03:32:22.778871 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.731939 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp6dt\" (UniqueName: \"kubernetes.io/projected/4a14a14c-8129-478b-a6b4-4e0f933ae323-kube-api-access-sp6dt\") pod \"node-resolver-n7lff\" (UID: \"4a14a14c-8129-478b-a6b4-4e0f933ae323\") " pod="openshift-dns/node-resolver-n7lff" Jul 10 03:32:22.778871 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.731976 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-var-lib-openvswitch\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.778871 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.732121 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-host-run-ovn-kubernetes\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.778871 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.732156 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d290639-b1dd-4145-a8bf-697a36a54819-agent-certs\") pod \"konnectivity-agent-7g6b4\" (UID: \"7d290639-b1dd-4145-a8bf-697a36a54819\") " pod="kube-system/konnectivity-agent-7g6b4" Jul 10 03:32:22.778871 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.732186 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-lib-modules\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.778871 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.732230 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-var-lib-kubelet\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.778871 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.732261 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4a14a14c-8129-478b-a6b4-4e0f933ae323-hosts-file\") pod \"node-resolver-n7lff\" (UID: \"4a14a14c-8129-478b-a6b4-4e0f933ae323\") " pod="openshift-dns/node-resolver-n7lff" Jul 10 03:32:22.778871 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.732290 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-host-kubelet\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.778871 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.732294 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:32:22.778871 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.732334 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-run-ovn\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.778871 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:22.732363 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddntq" podUID="b78bc3c1-3658-4cdd-ba93-30d686b78aa5" Jul 10 03:32:22.778871 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.732366 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.778871 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.732414 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ce3c8300-f70f-4ddc-9820-9d3234ab414c-ovn-node-metrics-cert\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.780014 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.732443 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8ed54eed-0e8e-490d-acc6-56615ee5340b-dbus\") pod \"global-pull-secret-syncer-jznf5\" (UID: \"8ed54eed-0e8e-490d-acc6-56615ee5340b\") " pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:32:22.780014 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.732472 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-etc-sysctl-d\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.780014 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.732494 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-run\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.780014 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.732549 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-host\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.780014 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.732605 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-tmp\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.780014 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.732639 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8ed54eed-0e8e-490d-acc6-56615ee5340b-kubelet-config\") pod \"global-pull-secret-syncer-jznf5\" (UID: \"8ed54eed-0e8e-490d-acc6-56615ee5340b\") " pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:32:22.780014 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.732676 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-etc-modprobe-d\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.780014 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.732704 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-sys\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.780014 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.732755 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-run-systemd\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.780014 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.732771 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 10 03:32:22.780014 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.732785 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-log-socket\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.780014 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.732771 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-z6qcx\"" Jul 10 03:32:22.780014 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.732825 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-host-cni-bin\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.780014 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.732846 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-etc-openvswitch\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.780014 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.732864 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-etc-sysconfig\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.780014 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.732881 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-systemd-units\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.780014 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.732917 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-host-slash\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.780014 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.732972 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-host-run-netns\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.782949 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.733011 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-host-cni-netd\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.782949 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.733039 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ce3c8300-f70f-4ddc-9820-9d3234ab414c-env-overrides\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.782949 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.733061 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46qsm\" (UniqueName: \"kubernetes.io/projected/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-kube-api-access-46qsm\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.782949 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.733068 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 10 03:32:22.782949 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.733096 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ed54eed-0e8e-490d-acc6-56615ee5340b-original-pull-secret\") pod \"global-pull-secret-syncer-jznf5\" (UID: \"8ed54eed-0e8e-490d-acc6-56615ee5340b\") " pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:32:22.782949 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.733128 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d290639-b1dd-4145-a8bf-697a36a54819-konnectivity-ca\") pod \"konnectivity-agent-7g6b4\" (UID: \"7d290639-b1dd-4145-a8bf-697a36a54819\") " pod="kube-system/konnectivity-agent-7g6b4" Jul 10 03:32:22.782949 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.733151 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-etc-kubernetes\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.782949 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.733063 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 10 03:32:22.782949 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.733176 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a14a14c-8129-478b-a6b4-4e0f933ae323-tmp-dir\") pod \"node-resolver-n7lff\" (UID: \"4a14a14c-8129-478b-a6b4-4e0f933ae323\") " pod="openshift-dns/node-resolver-n7lff" Jul 10 03:32:22.782949 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.733201 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ce3c8300-f70f-4ddc-9820-9d3234ab414c-ovnkube-script-lib\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.782949 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.733228 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-etc-sysctl-conf\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.782949 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.733252 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-run-openvswitch\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.782949 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.733272 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-node-log\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.782949 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.733291 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ce3c8300-f70f-4ddc-9820-9d3234ab414c-ovnkube-config\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.782949 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.733314 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmt2f\" (UniqueName: \"kubernetes.io/projected/ce3c8300-f70f-4ddc-9820-9d3234ab414c-kube-api-access-lmt2f\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.782949 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.733351 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-etc-systemd\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.782949 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.733378 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-etc-tuned\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.782949 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.733941 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv6dh" Jul 10 03:32:22.783996 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:22.734430 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv6dh" podUID="5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c" Jul 10 03:32:22.783996 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.735035 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 03:32:22.783996 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.736686 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fspx" Jul 10 03:32:22.783996 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.738804 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 10 03:32:22.783996 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.739294 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 10 03:32:22.783996 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.739809 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 10 03:32:22.783996 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.739811 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8t6g8\"" Jul 10 03:32:22.783996 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.759747 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-qsclm" Jul 10 03:32:22.783996 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.767500 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-qsclm" Jul 10 03:32:22.883787 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.823638 2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 10 03:32:22.883787 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.833883 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a14a14c-8129-478b-a6b4-4e0f933ae323-tmp-dir\") pod \"node-resolver-n7lff\" (UID: \"4a14a14c-8129-478b-a6b4-4e0f933ae323\") " pod="openshift-dns/node-resolver-n7lff" Jul 10 03:32:22.883787 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.833931 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ddb8999f-5597-4cd9-81a7-401da2a185a5-cni-binary-copy\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.883787 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.833958 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2rg4\" (UniqueName: \"kubernetes.io/projected/969ca3a0-f390-4321-a3d2-ff0622041a8b-kube-api-access-p2rg4\") pod \"iptables-alerter-b7b6g\" (UID: \"969ca3a0-f390-4321-a3d2-ff0622041a8b\") " pod="openshift-network-operator/iptables-alerter-b7b6g" Jul 10 03:32:22.883787 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834040 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-etc-sysctl-conf\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.883787 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834119 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-run-openvswitch\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.883787 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834166 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3319a8e8-89db-485a-b37c-f3e6b9d07eae-device-dir\") pod \"aws-ebs-csi-driver-node-7fspx\" (UID: \"3319a8e8-89db-485a-b37c-f3e6b9d07eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fspx" Jul 10 03:32:22.883787 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834184 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-etc-sysctl-conf\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.883787 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834214 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-run-openvswitch\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.883787 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834258 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4a14a14c-8129-478b-a6b4-4e0f933ae323-tmp-dir\") pod \"node-resolver-n7lff\" (UID: \"4a14a14c-8129-478b-a6b4-4e0f933ae323\") " pod="openshift-dns/node-resolver-n7lff" Jul 10 03:32:22.883787 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834264 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-etc-systemd\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.883787 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834310 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-var-lib-openvswitch\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.883787 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834319 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-etc-systemd\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.883787 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834347 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-host-run-ovn-kubernetes\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.883787 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834352 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-var-lib-openvswitch\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.883787 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834374 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d290639-b1dd-4145-a8bf-697a36a54819-agent-certs\") pod \"konnectivity-agent-7g6b4\" (UID: \"7d290639-b1dd-4145-a8bf-697a36a54819\") " pod="kube-system/konnectivity-agent-7g6b4" Jul 10 03:32:22.883787 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834410 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-host-run-ovn-kubernetes\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.883787 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834411 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-host-run-netns\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.885387 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834446 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ddb8999f-5597-4cd9-81a7-401da2a185a5-multus-daemon-config\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.885387 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834466 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3319a8e8-89db-485a-b37c-f3e6b9d07eae-socket-dir\") pod \"aws-ebs-csi-driver-node-7fspx\" (UID: \"3319a8e8-89db-485a-b37c-f3e6b9d07eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fspx" Jul 10 03:32:22.885387 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834486 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3319a8e8-89db-485a-b37c-f3e6b9d07eae-registration-dir\") pod \"aws-ebs-csi-driver-node-7fspx\" (UID: \"3319a8e8-89db-485a-b37c-f3e6b9d07eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fspx" Jul 10 03:32:22.885387 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834526 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-host-var-lib-cni-multus\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.885387 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834559 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-var-lib-kubelet\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.885387 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834585 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-run-ovn\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.885387 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834608 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8ed54eed-0e8e-490d-acc6-56615ee5340b-dbus\") pod \"global-pull-secret-syncer-jznf5\" (UID: \"8ed54eed-0e8e-490d-acc6-56615ee5340b\") " pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:32:22.885387 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834620 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-var-lib-kubelet\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.885387 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834636 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-run-ovn\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.885387 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834627 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lldqh\" (UniqueName: \"kubernetes.io/projected/3319a8e8-89db-485a-b37c-f3e6b9d07eae-kube-api-access-lldqh\") pod \"aws-ebs-csi-driver-node-7fspx\" (UID: \"3319a8e8-89db-485a-b37c-f3e6b9d07eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fspx" Jul 10 03:32:22.885387 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834690 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-etc-sysctl-d\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.885387 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834712 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-run\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.885387 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834758 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-host-var-lib-cni-bin\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.885387 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834757 2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 10 03:32:22.885387 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834787 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-sys\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.885387 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834799 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8ed54eed-0e8e-490d-acc6-56615ee5340b-dbus\") pod \"global-pull-secret-syncer-jznf5\" (UID: \"8ed54eed-0e8e-490d-acc6-56615ee5340b\") " pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:32:22.885387 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834817 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-log-socket\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.888057 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834834 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-etc-sysctl-d\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.888057 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834847 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-host-cni-bin\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.888057 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834861 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-run\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.888057 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834887 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-sys\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.888057 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834899 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e7780df5-f03a-4222-bb0c-38ed1c71ae2d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5c85h\" (UID: \"e7780df5-f03a-4222-bb0c-38ed1c71ae2d\") " pod="openshift-multus/multus-additional-cni-plugins-5c85h" Jul 10 03:32:22.888057 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834907 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-log-socket\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.888057 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834944 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-host-cni-bin\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.888057 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834957 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hctl\" (UniqueName: \"kubernetes.io/projected/27c224f5-8cb1-4c4a-b9bf-27eaf5cf4dec-kube-api-access-5hctl\") pod \"node-ca-7glzx\" (UID: \"27c224f5-8cb1-4c4a-b9bf-27eaf5cf4dec\") " pod="openshift-image-registry/node-ca-7glzx" Jul 10 03:32:22.888057 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.834993 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-etc-openvswitch\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.888057 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.835026 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-etc-sysconfig\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.888057 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.835077 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-etc-openvswitch\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.888057 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.835082 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-systemd-units\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.888057 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.835116 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-host-slash\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.888057 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.835127 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-etc-sysconfig\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.888057 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.835145 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ce3c8300-f70f-4ddc-9820-9d3234ab414c-env-overrides\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.888057 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.835169 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-cnibin\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.888057 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.835179 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-systemd-units\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.889446 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.835197 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/969ca3a0-f390-4321-a3d2-ff0622041a8b-host-slash\") pod \"iptables-alerter-b7b6g\" (UID: \"969ca3a0-f390-4321-a3d2-ff0622041a8b\") " pod="openshift-network-operator/iptables-alerter-b7b6g" Jul 10 03:32:22.889446 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.835200 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-host-slash\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.889446 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.835301 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqfb4\" (UniqueName: \"kubernetes.io/projected/5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c-kube-api-access-rqfb4\") pod \"network-check-target-bv6dh\" (UID: \"5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c\") " pod="openshift-network-diagnostics/network-check-target-bv6dh" Jul 10 03:32:22.889446 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.835333 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46qsm\" (UniqueName: \"kubernetes.io/projected/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-kube-api-access-46qsm\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.889446 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.835368 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ed54eed-0e8e-490d-acc6-56615ee5340b-original-pull-secret\") pod \"global-pull-secret-syncer-jznf5\" (UID: \"8ed54eed-0e8e-490d-acc6-56615ee5340b\") " pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:32:22.889446 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.835403 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-os-release\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.889446 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.835431 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-host-run-multus-certs\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.889446 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.835456 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3319a8e8-89db-485a-b37c-f3e6b9d07eae-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7fspx\" (UID: \"3319a8e8-89db-485a-b37c-f3e6b9d07eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fspx" Jul 10 03:32:22.889446 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.835493 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-etc-kubernetes\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.889446 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.835544 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ce3c8300-f70f-4ddc-9820-9d3234ab414c-ovnkube-script-lib\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.889446 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.835577 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-system-cni-dir\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.889446 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.835620 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ce3c8300-f70f-4ddc-9820-9d3234ab414c-env-overrides\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.889446 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.835607 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-multus-cni-dir\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.889446 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.835686 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-multus-socket-dir-parent\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.889446 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.835703 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-hostroot\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.889446 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:22.835709 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 03:32:22.889446 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.835721 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcnht\" (UniqueName: \"kubernetes.io/projected/ddb8999f-5597-4cd9-81a7-401da2a185a5-kube-api-access-kcnht\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.890315 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.835738 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7780df5-f03a-4222-bb0c-38ed1c71ae2d-system-cni-dir\") pod \"multus-additional-cni-plugins-5c85h\" (UID: \"e7780df5-f03a-4222-bb0c-38ed1c71ae2d\") " pod="openshift-multus/multus-additional-cni-plugins-5c85h" Jul 10 03:32:22.890315 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.835756 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-node-log\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.890315 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.835784 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-node-log\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.890315 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:22.835786 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ed54eed-0e8e-490d-acc6-56615ee5340b-original-pull-secret podName:8ed54eed-0e8e-490d-acc6-56615ee5340b nodeName:}" failed. No retries permitted until 2026-07-10 03:32:23.335764162 +0000 UTC m=+2.987575813 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8ed54eed-0e8e-490d-acc6-56615ee5340b-original-pull-secret") pod "global-pull-secret-syncer-jznf5" (UID: "8ed54eed-0e8e-490d-acc6-56615ee5340b") : object "kube-system"/"original-pull-secret" not registered Jul 10 03:32:22.890315 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.835809 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ce3c8300-f70f-4ddc-9820-9d3234ab414c-ovnkube-config\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.890315 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.835835 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmt2f\" (UniqueName: \"kubernetes.io/projected/ce3c8300-f70f-4ddc-9820-9d3234ab414c-kube-api-access-lmt2f\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.890315 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.835865 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e7780df5-f03a-4222-bb0c-38ed1c71ae2d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5c85h\" (UID: \"e7780df5-f03a-4222-bb0c-38ed1c71ae2d\") " pod="openshift-multus/multus-additional-cni-plugins-5c85h" Jul 10 03:32:22.890315 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.835895 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/27c224f5-8cb1-4c4a-b9bf-27eaf5cf4dec-host\") pod \"node-ca-7glzx\" (UID: \"27c224f5-8cb1-4c4a-b9bf-27eaf5cf4dec\") " pod="openshift-image-registry/node-ca-7glzx" Jul 10 03:32:22.890315 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.835919 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/969ca3a0-f390-4321-a3d2-ff0622041a8b-iptables-alerter-script\") pod \"iptables-alerter-b7b6g\" (UID: \"969ca3a0-f390-4321-a3d2-ff0622041a8b\") " pod="openshift-network-operator/iptables-alerter-b7b6g" Jul 10 03:32:22.890315 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.835945 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-metrics-certs\") pod \"network-metrics-daemon-ddntq\" (UID: \"b78bc3c1-3658-4cdd-ba93-30d686b78aa5\") " pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:32:22.890315 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.835989 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpzwr\" (UniqueName: \"kubernetes.io/projected/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-kube-api-access-lpzwr\") pod \"network-metrics-daemon-ddntq\" (UID: \"b78bc3c1-3658-4cdd-ba93-30d686b78aa5\") " pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:32:22.890315 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836016 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-etc-tuned\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.890315 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836016 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-etc-kubernetes\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.890315 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836055 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp6dt\" (UniqueName: \"kubernetes.io/projected/4a14a14c-8129-478b-a6b4-4e0f933ae323-kube-api-access-sp6dt\") pod \"node-resolver-n7lff\" (UID: \"4a14a14c-8129-478b-a6b4-4e0f933ae323\") " pod="openshift-dns/node-resolver-n7lff" Jul 10 03:32:22.890315 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836086 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-host-var-lib-kubelet\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.890315 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836113 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-etc-kubernetes\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.891171 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836173 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-lib-modules\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.891171 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836277 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4a14a14c-8129-478b-a6b4-4e0f933ae323-hosts-file\") pod \"node-resolver-n7lff\" (UID: \"4a14a14c-8129-478b-a6b4-4e0f933ae323\") " pod="openshift-dns/node-resolver-n7lff" Jul 10 03:32:22.891171 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836287 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ce3c8300-f70f-4ddc-9820-9d3234ab414c-ovnkube-script-lib\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.891171 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836333 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-host-kubelet\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.891171 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836366 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.891171 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836409 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ce3c8300-f70f-4ddc-9820-9d3234ab414c-ovn-node-metrics-cert\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.891171 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836442 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4a14a14c-8129-478b-a6b4-4e0f933ae323-hosts-file\") pod \"node-resolver-n7lff\" (UID: \"4a14a14c-8129-478b-a6b4-4e0f933ae323\") " pod="openshift-dns/node-resolver-n7lff" Jul 10 03:32:22.891171 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836444 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-host-kubelet\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.891171 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836439 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-multus-conf-dir\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.891171 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836495 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3319a8e8-89db-485a-b37c-f3e6b9d07eae-etc-selinux\") pod \"aws-ebs-csi-driver-node-7fspx\" (UID: \"3319a8e8-89db-485a-b37c-f3e6b9d07eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fspx" Jul 10 03:32:22.891171 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836505 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.891171 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836528 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3319a8e8-89db-485a-b37c-f3e6b9d07eae-sys-fs\") pod \"aws-ebs-csi-driver-node-7fspx\" (UID: \"3319a8e8-89db-485a-b37c-f3e6b9d07eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fspx" Jul 10 03:32:22.891171 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836554 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-lib-modules\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.891171 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836555 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-host\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.891171 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836599 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-tmp\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.891171 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836603 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-host\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.891171 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836569 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ce3c8300-f70f-4ddc-9820-9d3234ab414c-ovnkube-config\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.892139 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836625 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8ed54eed-0e8e-490d-acc6-56615ee5340b-kubelet-config\") pod \"global-pull-secret-syncer-jznf5\" (UID: \"8ed54eed-0e8e-490d-acc6-56615ee5340b\") " pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:32:22.892139 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836657 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e7780df5-f03a-4222-bb0c-38ed1c71ae2d-os-release\") pod \"multus-additional-cni-plugins-5c85h\" (UID: \"e7780df5-f03a-4222-bb0c-38ed1c71ae2d\") " pod="openshift-multus/multus-additional-cni-plugins-5c85h" Jul 10 03:32:22.892139 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836685 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7780df5-f03a-4222-bb0c-38ed1c71ae2d-cni-binary-copy\") pod \"multus-additional-cni-plugins-5c85h\" (UID: \"e7780df5-f03a-4222-bb0c-38ed1c71ae2d\") " pod="openshift-multus/multus-additional-cni-plugins-5c85h" Jul 10 03:32:22.892139 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836689 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8ed54eed-0e8e-490d-acc6-56615ee5340b-kubelet-config\") pod \"global-pull-secret-syncer-jznf5\" (UID: \"8ed54eed-0e8e-490d-acc6-56615ee5340b\") " pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:32:22.892139 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836710 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/27c224f5-8cb1-4c4a-b9bf-27eaf5cf4dec-serviceca\") pod \"node-ca-7glzx\" (UID: \"27c224f5-8cb1-4c4a-b9bf-27eaf5cf4dec\") " pod="openshift-image-registry/node-ca-7glzx" Jul 10 03:32:22.892139 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836736 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-etc-modprobe-d\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.892139 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836760 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-run-systemd\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.892139 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836784 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7780df5-f03a-4222-bb0c-38ed1c71ae2d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5c85h\" (UID: \"e7780df5-f03a-4222-bb0c-38ed1c71ae2d\") " pod="openshift-multus/multus-additional-cni-plugins-5c85h" Jul 10 03:32:22.892139 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836810 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-host-run-netns\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.892139 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836827 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-run-systemd\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.892139 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836835 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-host-cni-netd\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.892139 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836866 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-etc-modprobe-d\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.892139 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836882 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-host-cni-netd\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.892139 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836871 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7780df5-f03a-4222-bb0c-38ed1c71ae2d-cnibin\") pod \"multus-additional-cni-plugins-5c85h\" (UID: \"e7780df5-f03a-4222-bb0c-38ed1c71ae2d\") " pod="openshift-multus/multus-additional-cni-plugins-5c85h" Jul 10 03:32:22.892139 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836938 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ce3c8300-f70f-4ddc-9820-9d3234ab414c-host-run-netns\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.892139 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.836934 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrvkp\" (UniqueName: \"kubernetes.io/projected/e7780df5-f03a-4222-bb0c-38ed1c71ae2d-kube-api-access-qrvkp\") pod \"multus-additional-cni-plugins-5c85h\" (UID: \"e7780df5-f03a-4222-bb0c-38ed1c71ae2d\") " pod="openshift-multus/multus-additional-cni-plugins-5c85h" Jul 10 03:32:22.892139 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.837064 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d290639-b1dd-4145-a8bf-697a36a54819-konnectivity-ca\") pod \"konnectivity-agent-7g6b4\" (UID: \"7d290639-b1dd-4145-a8bf-697a36a54819\") " pod="kube-system/konnectivity-agent-7g6b4" Jul 10 03:32:22.893243 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.837129 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-host-run-k8s-cni-cncf-io\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.893243 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.838509 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d290639-b1dd-4145-a8bf-697a36a54819-konnectivity-ca\") pod \"konnectivity-agent-7g6b4\" (UID: \"7d290639-b1dd-4145-a8bf-697a36a54819\") " pod="kube-system/konnectivity-agent-7g6b4" Jul 10 03:32:22.893243 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.840798 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-etc-tuned\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.893243 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.840956 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ce3c8300-f70f-4ddc-9820-9d3234ab414c-ovn-node-metrics-cert\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.893243 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.841145 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d290639-b1dd-4145-a8bf-697a36a54819-agent-certs\") pod \"konnectivity-agent-7g6b4\" (UID: \"7d290639-b1dd-4145-a8bf-697a36a54819\") " pod="kube-system/konnectivity-agent-7g6b4" Jul 10 03:32:22.893243 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.843357 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-tmp\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.893243 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.847295 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46qsm\" (UniqueName: \"kubernetes.io/projected/7580eddd-ae92-4bf1-b9d1-ace260e6a20f-kube-api-access-46qsm\") pod \"tuned-cdwtj\" (UID: \"7580eddd-ae92-4bf1-b9d1-ace260e6a20f\") " pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:22.893243 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.850968 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp6dt\" (UniqueName: \"kubernetes.io/projected/4a14a14c-8129-478b-a6b4-4e0f933ae323-kube-api-access-sp6dt\") pod \"node-resolver-n7lff\" (UID: \"4a14a14c-8129-478b-a6b4-4e0f933ae323\") " pod="openshift-dns/node-resolver-n7lff" Jul 10 03:32:22.893243 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.854246 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmt2f\" (UniqueName: \"kubernetes.io/projected/ce3c8300-f70f-4ddc-9820-9d3234ab414c-kube-api-access-lmt2f\") pod \"ovnkube-node-pjnbc\" (UID: \"ce3c8300-f70f-4ddc-9820-9d3234ab414c\") " pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:22.893243 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.892870 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-177.ec2.internal" event={"ID":"b3bbcd29caffd89ad8909fd7d2acd9c9","Type":"ContainerStarted","Data":"03bc21b2c8f89ab912d34f0697527d3d0659c6b15a96f662525adf431ee156a5"} Jul 10 03:32:22.894872 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.894696 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal" event={"ID":"fb15e62f3258279013b97e71154b6a99","Type":"ContainerStarted","Data":"9b8d140ce4896921f0f735970bcdeeb9b4ec25db5cab0e5538ab2431eb771cab"} Jul 10 03:32:22.937991 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.937959 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrvkp\" (UniqueName: \"kubernetes.io/projected/e7780df5-f03a-4222-bb0c-38ed1c71ae2d-kube-api-access-qrvkp\") pod \"multus-additional-cni-plugins-5c85h\" (UID: \"e7780df5-f03a-4222-bb0c-38ed1c71ae2d\") " pod="openshift-multus/multus-additional-cni-plugins-5c85h" Jul 10 03:32:22.938129 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.938007 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-host-run-k8s-cni-cncf-io\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.938129 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.938039 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ddb8999f-5597-4cd9-81a7-401da2a185a5-cni-binary-copy\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.938129 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.938067 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2rg4\" (UniqueName: \"kubernetes.io/projected/969ca3a0-f390-4321-a3d2-ff0622041a8b-kube-api-access-p2rg4\") pod \"iptables-alerter-b7b6g\" (UID: \"969ca3a0-f390-4321-a3d2-ff0622041a8b\") " pod="openshift-network-operator/iptables-alerter-b7b6g" Jul 10 03:32:22.938129 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.938098 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3319a8e8-89db-485a-b37c-f3e6b9d07eae-device-dir\") pod \"aws-ebs-csi-driver-node-7fspx\" (UID: \"3319a8e8-89db-485a-b37c-f3e6b9d07eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fspx" Jul 10 03:32:22.938346 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.938130 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-host-run-netns\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.938346 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.938160 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ddb8999f-5597-4cd9-81a7-401da2a185a5-multus-daemon-config\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.938346 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.938187 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3319a8e8-89db-485a-b37c-f3e6b9d07eae-socket-dir\") pod \"aws-ebs-csi-driver-node-7fspx\" (UID: \"3319a8e8-89db-485a-b37c-f3e6b9d07eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fspx" Jul 10 03:32:22.938346 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.938213 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3319a8e8-89db-485a-b37c-f3e6b9d07eae-registration-dir\") pod \"aws-ebs-csi-driver-node-7fspx\" (UID: \"3319a8e8-89db-485a-b37c-f3e6b9d07eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fspx" Jul 10 03:32:22.938346 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.938240 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-host-var-lib-cni-multus\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.938346 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.938269 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lldqh\" (UniqueName: \"kubernetes.io/projected/3319a8e8-89db-485a-b37c-f3e6b9d07eae-kube-api-access-lldqh\") pod \"aws-ebs-csi-driver-node-7fspx\" (UID: \"3319a8e8-89db-485a-b37c-f3e6b9d07eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fspx" Jul 10 03:32:22.938346 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.938295 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-host-var-lib-cni-bin\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.938346 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.938316 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3319a8e8-89db-485a-b37c-f3e6b9d07eae-device-dir\") pod \"aws-ebs-csi-driver-node-7fspx\" (UID: \"3319a8e8-89db-485a-b37c-f3e6b9d07eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fspx" Jul 10 03:32:22.938346 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.938322 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e7780df5-f03a-4222-bb0c-38ed1c71ae2d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5c85h\" (UID: \"e7780df5-f03a-4222-bb0c-38ed1c71ae2d\") " pod="openshift-multus/multus-additional-cni-plugins-5c85h" Jul 10 03:32:22.938777 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.938390 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-host-run-k8s-cni-cncf-io\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.938839 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.938778 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3319a8e8-89db-485a-b37c-f3e6b9d07eae-registration-dir\") pod \"aws-ebs-csi-driver-node-7fspx\" (UID: \"3319a8e8-89db-485a-b37c-f3e6b9d07eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fspx" Jul 10 03:32:22.938899 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.938838 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-host-run-netns\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.939255 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939001 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ddb8999f-5597-4cd9-81a7-401da2a185a5-cni-binary-copy\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.939255 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939012 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e7780df5-f03a-4222-bb0c-38ed1c71ae2d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5c85h\" (UID: \"e7780df5-f03a-4222-bb0c-38ed1c71ae2d\") " pod="openshift-multus/multus-additional-cni-plugins-5c85h" Jul 10 03:32:22.939255 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939036 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-host-var-lib-cni-multus\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.939255 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939057 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-host-var-lib-cni-bin\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.939255 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939077 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hctl\" (UniqueName: \"kubernetes.io/projected/27c224f5-8cb1-4c4a-b9bf-27eaf5cf4dec-kube-api-access-5hctl\") pod \"node-ca-7glzx\" (UID: \"27c224f5-8cb1-4c4a-b9bf-27eaf5cf4dec\") " pod="openshift-image-registry/node-ca-7glzx" Jul 10 03:32:22.939255 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939138 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-cnibin\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.939255 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939158 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3319a8e8-89db-485a-b37c-f3e6b9d07eae-socket-dir\") pod \"aws-ebs-csi-driver-node-7fspx\" (UID: \"3319a8e8-89db-485a-b37c-f3e6b9d07eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fspx" Jul 10 03:32:22.939255 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939168 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/969ca3a0-f390-4321-a3d2-ff0622041a8b-host-slash\") pod \"iptables-alerter-b7b6g\" (UID: \"969ca3a0-f390-4321-a3d2-ff0622041a8b\") " pod="openshift-network-operator/iptables-alerter-b7b6g" Jul 10 03:32:22.939255 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939199 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqfb4\" (UniqueName: \"kubernetes.io/projected/5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c-kube-api-access-rqfb4\") pod \"network-check-target-bv6dh\" (UID: \"5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c\") " pod="openshift-network-diagnostics/network-check-target-bv6dh" Jul 10 03:32:22.939255 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939219 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-cnibin\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.939255 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939241 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-os-release\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.939255 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939245 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/969ca3a0-f390-4321-a3d2-ff0622041a8b-host-slash\") pod \"iptables-alerter-b7b6g\" (UID: \"969ca3a0-f390-4321-a3d2-ff0622041a8b\") " pod="openshift-network-operator/iptables-alerter-b7b6g" Jul 10 03:32:22.939909 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939340 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ddb8999f-5597-4cd9-81a7-401da2a185a5-multus-daemon-config\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.939909 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939341 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-os-release\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.939909 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939370 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-host-run-multus-certs\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.939909 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939432 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3319a8e8-89db-485a-b37c-f3e6b9d07eae-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7fspx\" (UID: \"3319a8e8-89db-485a-b37c-f3e6b9d07eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fspx" Jul 10 03:32:22.939909 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939462 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-system-cni-dir\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.939909 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939492 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-multus-cni-dir\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.939909 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939519 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-multus-socket-dir-parent\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.939909 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939542 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-hostroot\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.939909 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939566 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcnht\" (UniqueName: \"kubernetes.io/projected/ddb8999f-5597-4cd9-81a7-401da2a185a5-kube-api-access-kcnht\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.939909 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939593 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7780df5-f03a-4222-bb0c-38ed1c71ae2d-system-cni-dir\") pod \"multus-additional-cni-plugins-5c85h\" (UID: \"e7780df5-f03a-4222-bb0c-38ed1c71ae2d\") " pod="openshift-multus/multus-additional-cni-plugins-5c85h" Jul 10 03:32:22.939909 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939623 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e7780df5-f03a-4222-bb0c-38ed1c71ae2d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5c85h\" (UID: \"e7780df5-f03a-4222-bb0c-38ed1c71ae2d\") " pod="openshift-multus/multus-additional-cni-plugins-5c85h" Jul 10 03:32:22.939909 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939648 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/27c224f5-8cb1-4c4a-b9bf-27eaf5cf4dec-host\") pod \"node-ca-7glzx\" (UID: \"27c224f5-8cb1-4c4a-b9bf-27eaf5cf4dec\") " pod="openshift-image-registry/node-ca-7glzx" Jul 10 03:32:22.939909 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939672 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/969ca3a0-f390-4321-a3d2-ff0622041a8b-iptables-alerter-script\") pod \"iptables-alerter-b7b6g\" (UID: \"969ca3a0-f390-4321-a3d2-ff0622041a8b\") " pod="openshift-network-operator/iptables-alerter-b7b6g" Jul 10 03:32:22.939909 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939697 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-metrics-certs\") pod \"network-metrics-daemon-ddntq\" (UID: \"b78bc3c1-3658-4cdd-ba93-30d686b78aa5\") " pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:32:22.939909 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939722 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpzwr\" (UniqueName: \"kubernetes.io/projected/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-kube-api-access-lpzwr\") pod \"network-metrics-daemon-ddntq\" (UID: \"b78bc3c1-3658-4cdd-ba93-30d686b78aa5\") " pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:32:22.939909 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939748 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-host-var-lib-kubelet\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.939909 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939772 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-etc-kubernetes\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.940765 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939803 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-multus-conf-dir\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.940765 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939830 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3319a8e8-89db-485a-b37c-f3e6b9d07eae-etc-selinux\") pod \"aws-ebs-csi-driver-node-7fspx\" (UID: \"3319a8e8-89db-485a-b37c-f3e6b9d07eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fspx" Jul 10 03:32:22.940765 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939855 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3319a8e8-89db-485a-b37c-f3e6b9d07eae-sys-fs\") pod \"aws-ebs-csi-driver-node-7fspx\" (UID: \"3319a8e8-89db-485a-b37c-f3e6b9d07eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fspx" Jul 10 03:32:22.940765 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939884 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e7780df5-f03a-4222-bb0c-38ed1c71ae2d-os-release\") pod \"multus-additional-cni-plugins-5c85h\" (UID: \"e7780df5-f03a-4222-bb0c-38ed1c71ae2d\") " pod="openshift-multus/multus-additional-cni-plugins-5c85h" Jul 10 03:32:22.940765 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939910 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7780df5-f03a-4222-bb0c-38ed1c71ae2d-cni-binary-copy\") pod \"multus-additional-cni-plugins-5c85h\" (UID: \"e7780df5-f03a-4222-bb0c-38ed1c71ae2d\") " pod="openshift-multus/multus-additional-cni-plugins-5c85h" Jul 10 03:32:22.940765 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939935 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/27c224f5-8cb1-4c4a-b9bf-27eaf5cf4dec-serviceca\") pod \"node-ca-7glzx\" (UID: \"27c224f5-8cb1-4c4a-b9bf-27eaf5cf4dec\") " pod="openshift-image-registry/node-ca-7glzx" Jul 10 03:32:22.940765 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.939980 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7780df5-f03a-4222-bb0c-38ed1c71ae2d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5c85h\" (UID: \"e7780df5-f03a-4222-bb0c-38ed1c71ae2d\") " pod="openshift-multus/multus-additional-cni-plugins-5c85h" Jul 10 03:32:22.940765 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.940017 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7780df5-f03a-4222-bb0c-38ed1c71ae2d-cnibin\") pod \"multus-additional-cni-plugins-5c85h\" (UID: \"e7780df5-f03a-4222-bb0c-38ed1c71ae2d\") " pod="openshift-multus/multus-additional-cni-plugins-5c85h" Jul 10 03:32:22.940765 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.940096 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e7780df5-f03a-4222-bb0c-38ed1c71ae2d-cnibin\") pod \"multus-additional-cni-plugins-5c85h\" (UID: \"e7780df5-f03a-4222-bb0c-38ed1c71ae2d\") " pod="openshift-multus/multus-additional-cni-plugins-5c85h" Jul 10 03:32:22.940765 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.940137 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-host-run-multus-certs\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.940765 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.940181 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3319a8e8-89db-485a-b37c-f3e6b9d07eae-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7fspx\" (UID: \"3319a8e8-89db-485a-b37c-f3e6b9d07eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fspx" Jul 10 03:32:22.940765 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.940227 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-system-cni-dir\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.940765 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.940295 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-multus-cni-dir\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.940765 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.940355 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-multus-socket-dir-parent\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.940765 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.940375 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-host-var-lib-kubelet\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.940765 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.940406 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-etc-kubernetes\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.940765 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.940431 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-hostroot\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.940765 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.940461 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ddb8999f-5597-4cd9-81a7-401da2a185a5-multus-conf-dir\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.941650 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.940507 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/27c224f5-8cb1-4c4a-b9bf-27eaf5cf4dec-host\") pod \"node-ca-7glzx\" (UID: \"27c224f5-8cb1-4c4a-b9bf-27eaf5cf4dec\") " pod="openshift-image-registry/node-ca-7glzx" Jul 10 03:32:22.941650 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:22.940550 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 03:32:22.941650 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.940555 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3319a8e8-89db-485a-b37c-f3e6b9d07eae-etc-selinux\") pod \"aws-ebs-csi-driver-node-7fspx\" (UID: \"3319a8e8-89db-485a-b37c-f3e6b9d07eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fspx" Jul 10 03:32:22.941650 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:22.940618 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-metrics-certs podName:b78bc3c1-3658-4cdd-ba93-30d686b78aa5 nodeName:}" failed. No retries permitted until 2026-07-10 03:32:23.440599191 +0000 UTC m=+3.092410840 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-metrics-certs") pod "network-metrics-daemon-ddntq" (UID: "b78bc3c1-3658-4cdd-ba93-30d686b78aa5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 03:32:22.941650 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.940726 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e7780df5-f03a-4222-bb0c-38ed1c71ae2d-system-cni-dir\") pod \"multus-additional-cni-plugins-5c85h\" (UID: \"e7780df5-f03a-4222-bb0c-38ed1c71ae2d\") " pod="openshift-multus/multus-additional-cni-plugins-5c85h" Jul 10 03:32:22.941650 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.941239 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/969ca3a0-f390-4321-a3d2-ff0622041a8b-iptables-alerter-script\") pod \"iptables-alerter-b7b6g\" (UID: \"969ca3a0-f390-4321-a3d2-ff0622041a8b\") " pod="openshift-network-operator/iptables-alerter-b7b6g" Jul 10 03:32:22.941650 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.941357 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e7780df5-f03a-4222-bb0c-38ed1c71ae2d-cni-binary-copy\") pod \"multus-additional-cni-plugins-5c85h\" (UID: \"e7780df5-f03a-4222-bb0c-38ed1c71ae2d\") " pod="openshift-multus/multus-additional-cni-plugins-5c85h" Jul 10 03:32:22.941650 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.941389 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e7780df5-f03a-4222-bb0c-38ed1c71ae2d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5c85h\" (UID: \"e7780df5-f03a-4222-bb0c-38ed1c71ae2d\") " pod="openshift-multus/multus-additional-cni-plugins-5c85h" Jul 10 03:32:22.941650 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.941437 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3319a8e8-89db-485a-b37c-f3e6b9d07eae-sys-fs\") pod \"aws-ebs-csi-driver-node-7fspx\" (UID: \"3319a8e8-89db-485a-b37c-f3e6b9d07eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fspx" Jul 10 03:32:22.941650 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.941505 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e7780df5-f03a-4222-bb0c-38ed1c71ae2d-os-release\") pod \"multus-additional-cni-plugins-5c85h\" (UID: \"e7780df5-f03a-4222-bb0c-38ed1c71ae2d\") " pod="openshift-multus/multus-additional-cni-plugins-5c85h" Jul 10 03:32:22.941650 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.941593 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/27c224f5-8cb1-4c4a-b9bf-27eaf5cf4dec-serviceca\") pod \"node-ca-7glzx\" (UID: \"27c224f5-8cb1-4c4a-b9bf-27eaf5cf4dec\") " pod="openshift-image-registry/node-ca-7glzx" Jul 10 03:32:22.941650 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.941652 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e7780df5-f03a-4222-bb0c-38ed1c71ae2d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5c85h\" (UID: \"e7780df5-f03a-4222-bb0c-38ed1c71ae2d\") " pod="openshift-multus/multus-additional-cni-plugins-5c85h" Jul 10 03:32:22.946433 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:22.946379 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 03:32:22.946433 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:22.946405 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 03:32:22.946433 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:22.946419 2582 projected.go:196] Error preparing data for projected volume kube-api-access-rqfb4 for pod openshift-network-diagnostics/network-check-target-bv6dh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 03:32:22.946628 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:22.946487 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c-kube-api-access-rqfb4 podName:5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c nodeName:}" failed. No retries permitted until 2026-07-10 03:32:23.446469615 +0000 UTC m=+3.098281244 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rqfb4" (UniqueName: "kubernetes.io/projected/5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c-kube-api-access-rqfb4") pod "network-check-target-bv6dh" (UID: "5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 03:32:22.949282 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.949232 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hctl\" (UniqueName: \"kubernetes.io/projected/27c224f5-8cb1-4c4a-b9bf-27eaf5cf4dec-kube-api-access-5hctl\") pod \"node-ca-7glzx\" (UID: \"27c224f5-8cb1-4c4a-b9bf-27eaf5cf4dec\") " pod="openshift-image-registry/node-ca-7glzx" Jul 10 03:32:22.954624 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.954580 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpzwr\" (UniqueName: \"kubernetes.io/projected/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-kube-api-access-lpzwr\") pod \"network-metrics-daemon-ddntq\" (UID: \"b78bc3c1-3658-4cdd-ba93-30d686b78aa5\") " pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:32:22.960091 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.960051 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrvkp\" (UniqueName: \"kubernetes.io/projected/e7780df5-f03a-4222-bb0c-38ed1c71ae2d-kube-api-access-qrvkp\") pod \"multus-additional-cni-plugins-5c85h\" (UID: \"e7780df5-f03a-4222-bb0c-38ed1c71ae2d\") " pod="openshift-multus/multus-additional-cni-plugins-5c85h" Jul 10 03:32:22.960165 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.960135 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2rg4\" (UniqueName: \"kubernetes.io/projected/969ca3a0-f390-4321-a3d2-ff0622041a8b-kube-api-access-p2rg4\") pod \"iptables-alerter-b7b6g\" (UID: \"969ca3a0-f390-4321-a3d2-ff0622041a8b\") " pod="openshift-network-operator/iptables-alerter-b7b6g" Jul 10 03:32:22.960165 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.960149 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcnht\" (UniqueName: \"kubernetes.io/projected/ddb8999f-5597-4cd9-81a7-401da2a185a5-kube-api-access-kcnht\") pod \"multus-p7v8n\" (UID: \"ddb8999f-5597-4cd9-81a7-401da2a185a5\") " pod="openshift-multus/multus-p7v8n" Jul 10 03:32:22.961763 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:22.961727 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lldqh\" (UniqueName: \"kubernetes.io/projected/3319a8e8-89db-485a-b37c-f3e6b9d07eae-kube-api-access-lldqh\") pod \"aws-ebs-csi-driver-node-7fspx\" (UID: \"3319a8e8-89db-485a-b37c-f3e6b9d07eae\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fspx" Jul 10 03:32:23.030921 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:23.030874 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" Jul 10 03:32:23.042992 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:23.042798 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:23.052206 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:23.052183 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n7lff" Jul 10 03:32:23.060037 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:23.060017 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7g6b4" Jul 10 03:32:23.065980 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:23.065949 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7glzx" Jul 10 03:32:23.076661 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:23.076638 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p7v8n" Jul 10 03:32:23.079858 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:23.079840 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 03:32:23.082662 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:23.082646 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5c85h" Jul 10 03:32:23.093424 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:23.093400 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-b7b6g" Jul 10 03:32:23.098697 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:23.098680 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fspx" Jul 10 03:32:23.343552 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:23.343481 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ed54eed-0e8e-490d-acc6-56615ee5340b-original-pull-secret\") pod \"global-pull-secret-syncer-jznf5\" (UID: \"8ed54eed-0e8e-490d-acc6-56615ee5340b\") " pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:32:23.343696 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:23.343642 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 03:32:23.343738 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:23.343706 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ed54eed-0e8e-490d-acc6-56615ee5340b-original-pull-secret podName:8ed54eed-0e8e-490d-acc6-56615ee5340b nodeName:}" failed. No retries permitted until 2026-07-10 03:32:24.343691547 +0000 UTC m=+3.995503175 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8ed54eed-0e8e-490d-acc6-56615ee5340b-original-pull-secret") pod "global-pull-secret-syncer-jznf5" (UID: "8ed54eed-0e8e-490d-acc6-56615ee5340b") : object "kube-system"/"original-pull-secret" not registered Jul 10 03:32:23.444074 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:23.444036 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-metrics-certs\") pod \"network-metrics-daemon-ddntq\" (UID: \"b78bc3c1-3658-4cdd-ba93-30d686b78aa5\") " pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:32:23.444249 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:23.444194 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 03:32:23.444297 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:23.444271 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-metrics-certs podName:b78bc3c1-3658-4cdd-ba93-30d686b78aa5 nodeName:}" failed. No retries permitted until 2026-07-10 03:32:24.444253751 +0000 UTC m=+4.096065384 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-metrics-certs") pod "network-metrics-daemon-ddntq" (UID: "b78bc3c1-3658-4cdd-ba93-30d686b78aa5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 03:32:23.544635 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:23.544602 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqfb4\" (UniqueName: \"kubernetes.io/projected/5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c-kube-api-access-rqfb4\") pod \"network-check-target-bv6dh\" (UID: \"5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c\") " pod="openshift-network-diagnostics/network-check-target-bv6dh" Jul 10 03:32:23.544807 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:23.544774 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 03:32:23.544807 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:23.544799 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 03:32:23.544896 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:23.544814 2582 projected.go:196] Error preparing data for projected volume kube-api-access-rqfb4 for pod openshift-network-diagnostics/network-check-target-bv6dh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 03:32:23.544896 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:23.544888 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c-kube-api-access-rqfb4 podName:5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c nodeName:}" failed. No retries permitted until 2026-07-10 03:32:24.5448661 +0000 UTC m=+4.196677744 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rqfb4" (UniqueName: "kubernetes.io/projected/5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c-kube-api-access-rqfb4") pod "network-check-target-bv6dh" (UID: "5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 03:32:23.770549 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:23.770458 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 03:27:23 +0000 UTC" deadline="2028-04-10 16:55:11.512931844 +0000 UTC" Jul 10 03:32:23.770549 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:23.770492 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15373h22m47.74244405s" Jul 10 03:32:23.878775 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:23.878733 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv6dh" Jul 10 03:32:23.879209 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:23.878854 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv6dh" podUID="5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c" Jul 10 03:32:24.085133 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:24.085035 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod969ca3a0_f390_4321_a3d2_ff0622041a8b.slice/crio-befdab1d1f903f4125cf0e1a9fc07022869fbdaf7cc113f49ef52dbb134f4500 WatchSource:0}: Error finding container befdab1d1f903f4125cf0e1a9fc07022869fbdaf7cc113f49ef52dbb134f4500: Status 404 returned error can't find the container with id befdab1d1f903f4125cf0e1a9fc07022869fbdaf7cc113f49ef52dbb134f4500 Jul 10 03:32:24.086131 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:24.086107 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7780df5_f03a_4222_bb0c_38ed1c71ae2d.slice/crio-9f743816e1f65b2a596c7a61da4e6ef80bb46f30366143f70d7f9a436a5da848 WatchSource:0}: Error finding container 9f743816e1f65b2a596c7a61da4e6ef80bb46f30366143f70d7f9a436a5da848: Status 404 returned error can't find the container with id 9f743816e1f65b2a596c7a61da4e6ef80bb46f30366143f70d7f9a436a5da848 Jul 10 03:32:24.086914 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:24.086793 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d290639_b1dd_4145_a8bf_697a36a54819.slice/crio-0c80a319f21d64ef9c4a84c08641220804991fc79a63a6a4f7ade208205c8ad7 WatchSource:0}: Error finding container 0c80a319f21d64ef9c4a84c08641220804991fc79a63a6a4f7ade208205c8ad7: Status 404 returned error can't find the container with id 0c80a319f21d64ef9c4a84c08641220804991fc79a63a6a4f7ade208205c8ad7 Jul 10 03:32:24.091271 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:24.091030 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7580eddd_ae92_4bf1_b9d1_ace260e6a20f.slice/crio-2fde85d34b247bbf646fc5814b471134bd1834c1c4dcf4360ad5fbe1d188f188 WatchSource:0}: Error finding container 2fde85d34b247bbf646fc5814b471134bd1834c1c4dcf4360ad5fbe1d188f188: Status 404 returned error can't find the container with id 2fde85d34b247bbf646fc5814b471134bd1834c1c4dcf4360ad5fbe1d188f188 Jul 10 03:32:24.351489 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:24.351295 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ed54eed-0e8e-490d-acc6-56615ee5340b-original-pull-secret\") pod \"global-pull-secret-syncer-jznf5\" (UID: \"8ed54eed-0e8e-490d-acc6-56615ee5340b\") " pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:32:24.351600 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:24.351491 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 03:32:24.351600 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:24.351546 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ed54eed-0e8e-490d-acc6-56615ee5340b-original-pull-secret podName:8ed54eed-0e8e-490d-acc6-56615ee5340b nodeName:}" failed. No retries permitted until 2026-07-10 03:32:26.351530228 +0000 UTC m=+6.003341856 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8ed54eed-0e8e-490d-acc6-56615ee5340b-original-pull-secret") pod "global-pull-secret-syncer-jznf5" (UID: "8ed54eed-0e8e-490d-acc6-56615ee5340b") : object "kube-system"/"original-pull-secret" not registered Jul 10 03:32:24.452740 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:24.452267 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-metrics-certs\") pod \"network-metrics-daemon-ddntq\" (UID: \"b78bc3c1-3658-4cdd-ba93-30d686b78aa5\") " pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:32:24.452740 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:24.452445 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 03:32:24.452740 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:24.452506 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-metrics-certs podName:b78bc3c1-3658-4cdd-ba93-30d686b78aa5 nodeName:}" failed. No retries permitted until 2026-07-10 03:32:26.45248634 +0000 UTC m=+6.104297984 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-metrics-certs") pod "network-metrics-daemon-ddntq" (UID: "b78bc3c1-3658-4cdd-ba93-30d686b78aa5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 03:32:24.553251 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:24.553130 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqfb4\" (UniqueName: \"kubernetes.io/projected/5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c-kube-api-access-rqfb4\") pod \"network-check-target-bv6dh\" (UID: \"5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c\") " pod="openshift-network-diagnostics/network-check-target-bv6dh" Jul 10 03:32:24.553437 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:24.553336 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 03:32:24.553437 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:24.553368 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 03:32:24.553437 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:24.553382 2582 projected.go:196] Error preparing data for projected volume kube-api-access-rqfb4 for pod openshift-network-diagnostics/network-check-target-bv6dh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 03:32:24.553610 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:24.553453 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c-kube-api-access-rqfb4 podName:5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c nodeName:}" failed. No retries permitted until 2026-07-10 03:32:26.553431347 +0000 UTC m=+6.205242977 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rqfb4" (UniqueName: "kubernetes.io/projected/5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c-kube-api-access-rqfb4") pod "network-check-target-bv6dh" (UID: "5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 03:32:24.771821 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:24.771674 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 03:27:23 +0000 UTC" deadline="2028-03-13 10:40:38.468845225 +0000 UTC" Jul 10 03:32:24.771821 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:24.771737 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14695h8m13.697112627s" Jul 10 03:32:24.881813 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:24.881054 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:32:24.881813 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:24.881202 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddntq" podUID="b78bc3c1-3658-4cdd-ba93-30d686b78aa5" Jul 10 03:32:24.881813 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:24.881651 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:32:24.881813 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:24.881754 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jznf5" podUID="8ed54eed-0e8e-490d-acc6-56615ee5340b" Jul 10 03:32:24.913027 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:24.912924 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" event={"ID":"7580eddd-ae92-4bf1-b9d1-ace260e6a20f","Type":"ContainerStarted","Data":"2fde85d34b247bbf646fc5814b471134bd1834c1c4dcf4360ad5fbe1d188f188"} Jul 10 03:32:24.931868 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:24.930667 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7g6b4" event={"ID":"7d290639-b1dd-4145-a8bf-697a36a54819","Type":"ContainerStarted","Data":"0c80a319f21d64ef9c4a84c08641220804991fc79a63a6a4f7ade208205c8ad7"} Jul 10 03:32:24.932054 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:24.932011 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b7b6g" event={"ID":"969ca3a0-f390-4321-a3d2-ff0622041a8b","Type":"ContainerStarted","Data":"befdab1d1f903f4125cf0e1a9fc07022869fbdaf7cc113f49ef52dbb134f4500"} Jul 10 03:32:24.940577 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:24.940547 2582 generic.go:356] "Generic (PLEG): container finished" podID="fb15e62f3258279013b97e71154b6a99" containerID="cff8e2a5b038142e336e21c0a553e1587d2412c19c42e04dd2f19d7ac81f1a72" exitCode=0 Jul 10 03:32:24.940711 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:24.940631 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal" event={"ID":"fb15e62f3258279013b97e71154b6a99","Type":"ContainerDied","Data":"cff8e2a5b038142e336e21c0a553e1587d2412c19c42e04dd2f19d7ac81f1a72"} Jul 10 03:32:24.971603 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:24.971575 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p7v8n" event={"ID":"ddb8999f-5597-4cd9-81a7-401da2a185a5","Type":"ContainerStarted","Data":"4c1a5ac7f79d62ae53581d92c494a2974ad86006cbfb902ff41eea3f457534cd"} Jul 10 03:32:24.982904 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:24.982854 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n7lff" event={"ID":"4a14a14c-8129-478b-a6b4-4e0f933ae323","Type":"ContainerStarted","Data":"1d6aab259fa914e72d8c733acd09b60305e9512c07b7496896eef322017201d0"} Jul 10 03:32:24.986085 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:24.986010 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5c85h" event={"ID":"e7780df5-f03a-4222-bb0c-38ed1c71ae2d","Type":"ContainerStarted","Data":"9f743816e1f65b2a596c7a61da4e6ef80bb46f30366143f70d7f9a436a5da848"} Jul 10 03:32:24.997078 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:24.997051 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-177.ec2.internal" event={"ID":"b3bbcd29caffd89ad8909fd7d2acd9c9","Type":"ContainerStarted","Data":"eedf35b89213e21b7bb6a2961097a67946498c8e84ddbd132d983276188d2b9d"} Jul 10 03:32:24.999904 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:24.999876 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7glzx" event={"ID":"27c224f5-8cb1-4c4a-b9bf-27eaf5cf4dec","Type":"ContainerStarted","Data":"59ce152e43ac9f21d24e9bc251487e87742b7243311441eb8fd513a3389e6fa4"} Jul 10 03:32:25.005413 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:25.005385 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fspx" event={"ID":"3319a8e8-89db-485a-b37c-f3e6b9d07eae","Type":"ContainerStarted","Data":"76c355c9d93da72606d60167e4ac0125029b7c753e5632763943da830a86afb2"} Jul 10 03:32:25.011781 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:25.011686 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" event={"ID":"ce3c8300-f70f-4ddc-9820-9d3234ab414c","Type":"ContainerStarted","Data":"67001a7e67a5b52cd6e9529e59779ea100dfb2b9ce1e5ccefafadffdaf6c9114"} Jul 10 03:32:25.878798 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:25.878295 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv6dh" Jul 10 03:32:25.878798 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:25.878427 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv6dh" podUID="5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c" Jul 10 03:32:26.046030 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:26.045400 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal" event={"ID":"fb15e62f3258279013b97e71154b6a99","Type":"ContainerStarted","Data":"a41cc0eea276214f93310799806c6a7c61ce75dcc173bc693d671a757fd6f625"} Jul 10 03:32:26.061206 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:26.061150 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-177.ec2.internal" podStartSLOduration=4.061127947 podStartE2EDuration="4.061127947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 03:32:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:32:25.011575941 +0000 UTC m=+4.663387595" watchObservedRunningTime="2026-07-10 03:32:26.061127947 +0000 UTC m=+5.712939601" Jul 10 03:32:26.370608 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:26.370522 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ed54eed-0e8e-490d-acc6-56615ee5340b-original-pull-secret\") pod \"global-pull-secret-syncer-jznf5\" (UID: \"8ed54eed-0e8e-490d-acc6-56615ee5340b\") " pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:32:26.370782 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:26.370712 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 03:32:26.370782 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:26.370765 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ed54eed-0e8e-490d-acc6-56615ee5340b-original-pull-secret podName:8ed54eed-0e8e-490d-acc6-56615ee5340b nodeName:}" failed. No retries permitted until 2026-07-10 03:32:30.370748177 +0000 UTC m=+10.022559806 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8ed54eed-0e8e-490d-acc6-56615ee5340b-original-pull-secret") pod "global-pull-secret-syncer-jznf5" (UID: "8ed54eed-0e8e-490d-acc6-56615ee5340b") : object "kube-system"/"original-pull-secret" not registered Jul 10 03:32:26.471421 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:26.471384 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-metrics-certs\") pod \"network-metrics-daemon-ddntq\" (UID: \"b78bc3c1-3658-4cdd-ba93-30d686b78aa5\") " pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:32:26.471612 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:26.471586 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 03:32:26.471701 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:26.471654 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-metrics-certs podName:b78bc3c1-3658-4cdd-ba93-30d686b78aa5 nodeName:}" failed. No retries permitted until 2026-07-10 03:32:30.47163443 +0000 UTC m=+10.123446061 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-metrics-certs") pod "network-metrics-daemon-ddntq" (UID: "b78bc3c1-3658-4cdd-ba93-30d686b78aa5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 03:32:26.572735 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:26.572697 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqfb4\" (UniqueName: \"kubernetes.io/projected/5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c-kube-api-access-rqfb4\") pod \"network-check-target-bv6dh\" (UID: \"5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c\") " pod="openshift-network-diagnostics/network-check-target-bv6dh" Jul 10 03:32:26.573012 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:26.572973 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 03:32:26.573012 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:26.573007 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 03:32:26.573168 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:26.573022 2582 projected.go:196] Error preparing data for projected volume kube-api-access-rqfb4 for pod openshift-network-diagnostics/network-check-target-bv6dh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 03:32:26.573168 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:26.573082 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c-kube-api-access-rqfb4 podName:5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c nodeName:}" failed. No retries permitted until 2026-07-10 03:32:30.573062829 +0000 UTC m=+10.224874481 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rqfb4" (UniqueName: "kubernetes.io/projected/5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c-kube-api-access-rqfb4") pod "network-check-target-bv6dh" (UID: "5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 03:32:26.879665 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:26.879001 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:32:26.879665 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:26.879131 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jznf5" podUID="8ed54eed-0e8e-490d-acc6-56615ee5340b" Jul 10 03:32:26.880176 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:26.879977 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:32:26.880176 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:26.880086 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddntq" podUID="b78bc3c1-3658-4cdd-ba93-30d686b78aa5" Jul 10 03:32:27.878401 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:27.878352 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv6dh" Jul 10 03:32:27.878854 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:27.878444 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv6dh" podUID="5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c" Jul 10 03:32:28.881680 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:28.881046 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:32:28.881680 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:28.881167 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jznf5" podUID="8ed54eed-0e8e-490d-acc6-56615ee5340b" Jul 10 03:32:28.881680 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:28.881536 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:32:28.881680 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:28.881629 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddntq" podUID="b78bc3c1-3658-4cdd-ba93-30d686b78aa5" Jul 10 03:32:29.879325 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:29.879253 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv6dh" Jul 10 03:32:29.879475 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:29.879387 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv6dh" podUID="5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c" Jul 10 03:32:30.404195 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:30.404129 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ed54eed-0e8e-490d-acc6-56615ee5340b-original-pull-secret\") pod \"global-pull-secret-syncer-jznf5\" (UID: \"8ed54eed-0e8e-490d-acc6-56615ee5340b\") " pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:32:30.404688 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:30.404304 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 03:32:30.404688 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:30.404369 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ed54eed-0e8e-490d-acc6-56615ee5340b-original-pull-secret podName:8ed54eed-0e8e-490d-acc6-56615ee5340b nodeName:}" failed. No retries permitted until 2026-07-10 03:32:38.404349662 +0000 UTC m=+18.056161307 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8ed54eed-0e8e-490d-acc6-56615ee5340b-original-pull-secret") pod "global-pull-secret-syncer-jznf5" (UID: "8ed54eed-0e8e-490d-acc6-56615ee5340b") : object "kube-system"/"original-pull-secret" not registered Jul 10 03:32:30.505054 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:30.504887 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-metrics-certs\") pod \"network-metrics-daemon-ddntq\" (UID: \"b78bc3c1-3658-4cdd-ba93-30d686b78aa5\") " pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:32:30.505054 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:30.505050 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 03:32:30.505282 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:30.505121 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-metrics-certs podName:b78bc3c1-3658-4cdd-ba93-30d686b78aa5 nodeName:}" failed. No retries permitted until 2026-07-10 03:32:38.505102333 +0000 UTC m=+18.156913978 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-metrics-certs") pod "network-metrics-daemon-ddntq" (UID: "b78bc3c1-3658-4cdd-ba93-30d686b78aa5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 03:32:30.605428 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:30.605325 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqfb4\" (UniqueName: \"kubernetes.io/projected/5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c-kube-api-access-rqfb4\") pod \"network-check-target-bv6dh\" (UID: \"5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c\") " pod="openshift-network-diagnostics/network-check-target-bv6dh" Jul 10 03:32:30.605614 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:30.605522 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 03:32:30.605614 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:30.605548 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 03:32:30.605614 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:30.605562 2582 projected.go:196] Error preparing data for projected volume kube-api-access-rqfb4 for pod openshift-network-diagnostics/network-check-target-bv6dh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 03:32:30.605767 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:30.605626 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c-kube-api-access-rqfb4 podName:5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c nodeName:}" failed. No retries permitted until 2026-07-10 03:32:38.605607731 +0000 UTC m=+18.257419375 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rqfb4" (UniqueName: "kubernetes.io/projected/5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c-kube-api-access-rqfb4") pod "network-check-target-bv6dh" (UID: "5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 03:32:30.880358 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:30.879705 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:32:30.880358 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:30.879831 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddntq" podUID="b78bc3c1-3658-4cdd-ba93-30d686b78aa5" Jul 10 03:32:30.880358 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:30.880184 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:32:30.880358 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:30.880274 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jznf5" podUID="8ed54eed-0e8e-490d-acc6-56615ee5340b" Jul 10 03:32:31.879465 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:31.879173 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv6dh" Jul 10 03:32:31.879465 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:31.879317 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv6dh" podUID="5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c" Jul 10 03:32:32.879179 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:32.879145 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:32:32.879345 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:32.879269 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jznf5" podUID="8ed54eed-0e8e-490d-acc6-56615ee5340b" Jul 10 03:32:32.879869 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:32.879722 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:32:32.879869 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:32.879829 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddntq" podUID="b78bc3c1-3658-4cdd-ba93-30d686b78aa5" Jul 10 03:32:33.878759 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:33.878716 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv6dh" Jul 10 03:32:33.878946 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:33.878852 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv6dh" podUID="5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c" Jul 10 03:32:34.878896 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:34.878864 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:32:34.879278 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:34.879024 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddntq" podUID="b78bc3c1-3658-4cdd-ba93-30d686b78aa5" Jul 10 03:32:34.879278 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:34.879070 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:32:34.879278 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:34.879171 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jznf5" podUID="8ed54eed-0e8e-490d-acc6-56615ee5340b" Jul 10 03:32:35.878965 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:35.878916 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv6dh" Jul 10 03:32:35.879379 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:35.879040 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv6dh" podUID="5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c" Jul 10 03:32:36.879246 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:36.879204 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:32:36.879696 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:36.879253 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:32:36.879696 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:36.879335 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddntq" podUID="b78bc3c1-3658-4cdd-ba93-30d686b78aa5" Jul 10 03:32:36.879696 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:36.879488 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jznf5" podUID="8ed54eed-0e8e-490d-acc6-56615ee5340b" Jul 10 03:32:37.878860 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:37.878827 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv6dh" Jul 10 03:32:37.879059 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:37.878952 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv6dh" podUID="5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c" Jul 10 03:32:38.471307 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:38.471278 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ed54eed-0e8e-490d-acc6-56615ee5340b-original-pull-secret\") pod \"global-pull-secret-syncer-jznf5\" (UID: \"8ed54eed-0e8e-490d-acc6-56615ee5340b\") " pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:32:38.471653 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:38.471393 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 03:32:38.471653 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:38.471439 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ed54eed-0e8e-490d-acc6-56615ee5340b-original-pull-secret podName:8ed54eed-0e8e-490d-acc6-56615ee5340b nodeName:}" failed. No retries permitted until 2026-07-10 03:32:54.471426234 +0000 UTC m=+34.123237861 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8ed54eed-0e8e-490d-acc6-56615ee5340b-original-pull-secret") pod "global-pull-secret-syncer-jznf5" (UID: "8ed54eed-0e8e-490d-acc6-56615ee5340b") : object "kube-system"/"original-pull-secret" not registered Jul 10 03:32:38.572557 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:38.572530 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-metrics-certs\") pod \"network-metrics-daemon-ddntq\" (UID: \"b78bc3c1-3658-4cdd-ba93-30d686b78aa5\") " pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:32:38.572689 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:38.572639 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 03:32:38.572689 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:38.572684 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-metrics-certs podName:b78bc3c1-3658-4cdd-ba93-30d686b78aa5 nodeName:}" failed. No retries permitted until 2026-07-10 03:32:54.572671149 +0000 UTC m=+34.224482779 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-metrics-certs") pod "network-metrics-daemon-ddntq" (UID: "b78bc3c1-3658-4cdd-ba93-30d686b78aa5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 03:32:38.673649 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:38.673622 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqfb4\" (UniqueName: \"kubernetes.io/projected/5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c-kube-api-access-rqfb4\") pod \"network-check-target-bv6dh\" (UID: \"5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c\") " pod="openshift-network-diagnostics/network-check-target-bv6dh" Jul 10 03:32:38.673771 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:38.673756 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 03:32:38.673771 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:38.673769 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 03:32:38.673829 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:38.673777 2582 projected.go:196] Error preparing data for projected volume kube-api-access-rqfb4 for pod openshift-network-diagnostics/network-check-target-bv6dh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 03:32:38.673829 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:38.673818 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c-kube-api-access-rqfb4 podName:5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c nodeName:}" failed. No retries permitted until 2026-07-10 03:32:54.673805941 +0000 UTC m=+34.325617568 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rqfb4" (UniqueName: "kubernetes.io/projected/5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c-kube-api-access-rqfb4") pod "network-check-target-bv6dh" (UID: "5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 03:32:38.878329 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:38.878255 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:32:38.878489 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:38.878368 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddntq" podUID="b78bc3c1-3658-4cdd-ba93-30d686b78aa5" Jul 10 03:32:38.878489 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:38.878457 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:32:38.878593 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:38.878552 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jznf5" podUID="8ed54eed-0e8e-490d-acc6-56615ee5340b" Jul 10 03:32:39.879164 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:39.879132 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv6dh" Jul 10 03:32:39.879569 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:39.879255 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv6dh" podUID="5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c" Jul 10 03:32:40.879836 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:40.879711 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:32:40.879836 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:40.879807 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jznf5" podUID="8ed54eed-0e8e-490d-acc6-56615ee5340b" Jul 10 03:32:40.880333 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:40.879865 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:32:40.880333 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:40.879980 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddntq" podUID="b78bc3c1-3658-4cdd-ba93-30d686b78aa5" Jul 10 03:32:41.878569 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:41.878528 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv6dh" Jul 10 03:32:41.878730 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:41.878669 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv6dh" podUID="5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c" Jul 10 03:32:42.881420 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:42.881216 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:32:42.881800 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:42.881527 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jznf5" podUID="8ed54eed-0e8e-490d-acc6-56615ee5340b" Jul 10 03:32:42.881800 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:42.881265 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:32:42.881800 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:42.881686 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddntq" podUID="b78bc3c1-3658-4cdd-ba93-30d686b78aa5" Jul 10 03:32:43.096637 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:43.096389 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7glzx" event={"ID":"27c224f5-8cb1-4c4a-b9bf-27eaf5cf4dec","Type":"ContainerStarted","Data":"234c76ed30c754f3eb29cb2653edacd25599ebe77f4b8e9811893c87ed862ee4"} Jul 10 03:32:43.097858 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:43.097836 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fspx" event={"ID":"3319a8e8-89db-485a-b37c-f3e6b9d07eae","Type":"ContainerStarted","Data":"9bc5246ab6d00bb2a0238e82d38c04fe3b965bfd11195015db821c54080bdf60"} Jul 10 03:32:43.100068 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:43.100042 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" event={"ID":"ce3c8300-f70f-4ddc-9820-9d3234ab414c","Type":"ContainerStarted","Data":"77e12480be292dea2f564f9e5ea50220ae4ef52a3de25ca8d711e6a0da392df1"} Jul 10 03:32:43.100164 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:43.100112 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" event={"ID":"ce3c8300-f70f-4ddc-9820-9d3234ab414c","Type":"ContainerStarted","Data":"8c7598c01d68fa6d54af33172947c0c001ebad092df440fc14817635a2ee9e51"} Jul 10 03:32:43.101527 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:43.101499 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" event={"ID":"7580eddd-ae92-4bf1-b9d1-ace260e6a20f","Type":"ContainerStarted","Data":"23820e30df3bd1712ab1ac42b7eec08323ce2935b2da641fc77caba0221c9df1"} Jul 10 03:32:43.102935 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:43.102894 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7g6b4" event={"ID":"7d290639-b1dd-4145-a8bf-697a36a54819","Type":"ContainerStarted","Data":"be30a1888a9e651ff3e8aefb82bdcd38ab8109943e333c4220d2a21457b2ef30"} Jul 10 03:32:43.104360 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:43.104337 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p7v8n" event={"ID":"ddb8999f-5597-4cd9-81a7-401da2a185a5","Type":"ContainerStarted","Data":"ab182a53fb32ca36c0b69b2bca9d42cf2e1e806062008b3949db7578a2d7f64c"} Jul 10 03:32:43.106047 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:43.106019 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n7lff" event={"ID":"4a14a14c-8129-478b-a6b4-4e0f933ae323","Type":"ContainerStarted","Data":"984bbf08d115535ad5a1c1958b1b8f7a1f441b6514e73b948757cf0dd1be9121"} Jul 10 03:32:43.107516 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:43.107489 2582 generic.go:356] "Generic (PLEG): container finished" podID="e7780df5-f03a-4222-bb0c-38ed1c71ae2d" containerID="f416e66f1d1ba50e39804bb8e16b7627b5cd41e5c2586e3ac43163461f318c43" exitCode=0 Jul 10 03:32:43.107604 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:43.107553 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5c85h" event={"ID":"e7780df5-f03a-4222-bb0c-38ed1c71ae2d","Type":"ContainerDied","Data":"f416e66f1d1ba50e39804bb8e16b7627b5cd41e5c2586e3ac43163461f318c43"} Jul 10 03:32:43.111158 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:43.111124 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-177.ec2.internal" podStartSLOduration=21.111095211 podStartE2EDuration="21.111095211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 03:32:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:32:26.061966953 +0000 UTC m=+5.713778608" watchObservedRunningTime="2026-07-10 03:32:43.111095211 +0000 UTC m=+22.762906854" Jul 10 03:32:43.112253 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:43.112223 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7glzx" podStartSLOduration=3.382109621 podStartE2EDuration="22.112210073s" totalImagesPullingTime="18.730100452s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 03:32:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:32:43.111385868 +0000 UTC m=+22.763197519" watchObservedRunningTime="2026-07-10 03:32:43.112210073 +0000 UTC m=+22.764021722" Jul 10 03:32:43.140835 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:43.140799 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-p7v8n" podStartSLOduration=3.374381759 podStartE2EDuration="22.140787258s" totalImagesPullingTime="18.766405499s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 03:32:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:32:43.140654121 +0000 UTC m=+22.792465769" watchObservedRunningTime="2026-07-10 03:32:43.140787258 +0000 UTC m=+22.792598907" Jul 10 03:32:43.141031 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:43.141012 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-n7lff" podStartSLOduration=3.418333535 podStartE2EDuration="22.14100563s" totalImagesPullingTime="18.722672095s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 03:32:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:32:43.124541206 +0000 UTC m=+22.776352854" watchObservedRunningTime="2026-07-10 03:32:43.14100563 +0000 UTC m=+22.792817279" Jul 10 03:32:43.193378 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:43.193324 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cdwtj" podStartSLOduration=3.455008644 podStartE2EDuration="22.193305003s" totalImagesPullingTime="18.738296359s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 03:32:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:32:43.17595828 +0000 UTC m=+22.827769931" watchObservedRunningTime="2026-07-10 03:32:43.193305003 +0000 UTC m=+22.845116653" Jul 10 03:32:43.195673 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:43.194518 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7g6b4" podStartSLOduration=11.488150753 podStartE2EDuration="22.19450189s" totalImagesPullingTime="10.706351137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:32:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:32:43.193166547 +0000 UTC m=+22.844978196" watchObservedRunningTime="2026-07-10 03:32:43.19450189 +0000 UTC m=+22.846313539" Jul 10 03:32:43.879148 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:43.879121 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv6dh" Jul 10 03:32:43.879313 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:43.879218 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv6dh" podUID="5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c" Jul 10 03:32:44.112149 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:44.112074 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" event={"ID":"ce3c8300-f70f-4ddc-9820-9d3234ab414c","Type":"ContainerStarted","Data":"ff1f2685b1fdd818d204a95e14a871b4c55283bd0d53ac8e1de222a503523d72"} Jul 10 03:32:44.113332 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:44.112165 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" event={"ID":"ce3c8300-f70f-4ddc-9820-9d3234ab414c","Type":"ContainerStarted","Data":"5ff7ed43a144061f1954161639e4a3b814d93b69d679e3d53b6ec6f9ec253453"} Jul 10 03:32:44.113332 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:44.112210 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" event={"ID":"ce3c8300-f70f-4ddc-9820-9d3234ab414c","Type":"ContainerStarted","Data":"ba65dd893d5560339249f98cdb515ac402bade2310e7f8e1c48084c8c77d55ab"} Jul 10 03:32:44.113332 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:44.112259 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" event={"ID":"ce3c8300-f70f-4ddc-9820-9d3234ab414c","Type":"ContainerStarted","Data":"052ff4368266c22fbe243e7a35c90c84c458b133ec72775011ee53f2beaba9dd"} Jul 10 03:32:44.301845 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:44.301811 2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 10 03:32:44.801876 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:44.801776 2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T03:32:44.301832759Z","UUID":"68e8bc63-a4d6-49f0-9eb2-be34381c5fdd","Handler":null,"Name":"","Endpoint":""} Jul 10 03:32:44.804046 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:44.803796 2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 10 03:32:44.804184 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:44.804072 2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 10 03:32:44.878614 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:44.878587 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:32:44.878768 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:44.878715 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddntq" podUID="b78bc3c1-3658-4cdd-ba93-30d686b78aa5" Jul 10 03:32:44.878768 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:44.878761 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:32:44.878879 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:44.878842 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jznf5" podUID="8ed54eed-0e8e-490d-acc6-56615ee5340b" Jul 10 03:32:45.117279 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:45.117189 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fspx" event={"ID":"3319a8e8-89db-485a-b37c-f3e6b9d07eae","Type":"ContainerStarted","Data":"d6c121aec9b7c1219ca8f1e6217c7988625b68e75fee16a5495845981f0ae239"} Jul 10 03:32:45.119065 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:45.119031 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-b7b6g" event={"ID":"969ca3a0-f390-4321-a3d2-ff0622041a8b","Type":"ContainerStarted","Data":"ca541acdcd4b63ebf79155ce491e1643b8e6e0197088ee7f8b00b3cf93b3da0a"} Jul 10 03:32:45.132856 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:45.132816 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-b7b6g" podStartSLOduration=5.391827188 podStartE2EDuration="24.132797761s" totalImagesPullingTime="18.740970573s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 03:32:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:32:45.132327935 +0000 UTC m=+24.784139596" watchObservedRunningTime="2026-07-10 03:32:45.132797761 +0000 UTC m=+24.784609447" Jul 10 03:32:45.457084 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:45.457049 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7g6b4" Jul 10 03:32:45.457830 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:45.457810 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7g6b4" Jul 10 03:32:45.878637 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:45.878601 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv6dh" Jul 10 03:32:45.878788 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:45.878719 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv6dh" podUID="5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c" Jul 10 03:32:46.123856 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:46.123765 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fspx" event={"ID":"3319a8e8-89db-485a-b37c-f3e6b9d07eae","Type":"ContainerStarted","Data":"2b8a6b4cffe2db77b10a1e128d50b98aad56f2d31f42bd791d7ba2703b1c75e5"} Jul 10 03:32:46.127263 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:46.127212 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" event={"ID":"ce3c8300-f70f-4ddc-9820-9d3234ab414c","Type":"ContainerStarted","Data":"018e94aa8365a93d1c2f6c58d447be368c4592dc8b98679f821b2be3feddd482"} Jul 10 03:32:46.127586 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:46.127549 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7g6b4" Jul 10 03:32:46.128134 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:46.128116 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7g6b4" Jul 10 03:32:46.141515 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:46.141480 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7fspx" podStartSLOduration=4.187824063 podStartE2EDuration="25.141467648s" totalImagesPullingTime="20.953643585s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 03:32:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:32:46.140969456 +0000 UTC m=+25.792781104" watchObservedRunningTime="2026-07-10 03:32:46.141467648 +0000 UTC m=+25.793279308" Jul 10 03:32:46.878422 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:46.878385 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:32:46.878422 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:46.878399 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:32:46.878595 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:46.878505 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddntq" podUID="b78bc3c1-3658-4cdd-ba93-30d686b78aa5" Jul 10 03:32:46.878658 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:46.878636 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jznf5" podUID="8ed54eed-0e8e-490d-acc6-56615ee5340b" Jul 10 03:32:47.878517 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:47.878479 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv6dh" Jul 10 03:32:47.879101 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:47.878585 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv6dh" podUID="5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c" Jul 10 03:32:48.878545 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:48.878336 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:32:48.878945 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:48.878396 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:32:48.878945 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:48.878652 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jznf5" podUID="8ed54eed-0e8e-490d-acc6-56615ee5340b" Jul 10 03:32:48.878945 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:48.878734 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddntq" podUID="b78bc3c1-3658-4cdd-ba93-30d686b78aa5" Jul 10 03:32:49.134666 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:49.134575 2582 generic.go:356] "Generic (PLEG): container finished" podID="e7780df5-f03a-4222-bb0c-38ed1c71ae2d" containerID="cf396847c37c01cbc66c17f1167c9c05e4b3a75d4b99e2d1202560bb9237c2a0" exitCode=0 Jul 10 03:32:49.134816 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:49.134688 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5c85h" event={"ID":"e7780df5-f03a-4222-bb0c-38ed1c71ae2d","Type":"ContainerDied","Data":"cf396847c37c01cbc66c17f1167c9c05e4b3a75d4b99e2d1202560bb9237c2a0"} Jul 10 03:32:49.138441 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:49.138421 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" event={"ID":"ce3c8300-f70f-4ddc-9820-9d3234ab414c","Type":"ContainerStarted","Data":"12eab1228930ccee90b29139695d12a7a507b0c2cba29a947b5d625b3ec28d15"} Jul 10 03:32:49.138666 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:49.138637 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:49.138777 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:49.138702 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:49.153683 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:49.153666 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:49.179520 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:49.179480 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" podStartSLOduration=9.363606537 podStartE2EDuration="28.179466926s" totalImagesPullingTime="18.815860389s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 03:32:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:32:49.178660261 +0000 UTC m=+28.830471904" watchObservedRunningTime="2026-07-10 03:32:49.179466926 +0000 UTC m=+28.831278574" Jul 10 03:32:49.878891 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:49.878753 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv6dh" Jul 10 03:32:49.879501 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:49.878890 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv6dh" podUID="5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c" Jul 10 03:32:50.141222 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:50.141146 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:50.154510 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:50.154490 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:32:50.580106 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:50.579899 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jznf5"] Jul 10 03:32:50.580274 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:50.580188 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:32:50.580274 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:50.580265 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jznf5" podUID="8ed54eed-0e8e-490d-acc6-56615ee5340b" Jul 10 03:32:50.583270 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:50.583244 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ddntq"] Jul 10 03:32:50.583380 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:50.583364 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:32:50.583504 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:50.583481 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddntq" podUID="b78bc3c1-3658-4cdd-ba93-30d686b78aa5" Jul 10 03:32:50.583905 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:50.583888 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bv6dh"] Jul 10 03:32:50.583990 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:50.583971 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv6dh" Jul 10 03:32:50.584057 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:50.584042 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv6dh" podUID="5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c" Jul 10 03:32:51.147165 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:51.147132 2582 generic.go:356] "Generic (PLEG): container finished" podID="e7780df5-f03a-4222-bb0c-38ed1c71ae2d" containerID="ecf241a3e5251168932e8c78f5ffc17af7cfbaf5b67e1592e8497c84e969571d" exitCode=0 Jul 10 03:32:51.147604 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:51.147179 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5c85h" event={"ID":"e7780df5-f03a-4222-bb0c-38ed1c71ae2d","Type":"ContainerDied","Data":"ecf241a3e5251168932e8c78f5ffc17af7cfbaf5b67e1592e8497c84e969571d"} Jul 10 03:32:51.878496 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:51.878464 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:32:51.878627 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:51.878464 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv6dh" Jul 10 03:32:51.878627 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:51.878562 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jznf5" podUID="8ed54eed-0e8e-490d-acc6-56615ee5340b" Jul 10 03:32:51.878743 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:51.878724 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv6dh" podUID="5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c" Jul 10 03:32:52.152100 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:52.152070 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5c85h" event={"ID":"e7780df5-f03a-4222-bb0c-38ed1c71ae2d","Type":"ContainerStarted","Data":"83e8bfd0a352056e301252d075427afcb39b7353801ab89a6ccb7681076e9db0"} Jul 10 03:32:52.878994 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:52.878957 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:32:52.879138 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:52.879105 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddntq" podUID="b78bc3c1-3658-4cdd-ba93-30d686b78aa5" Jul 10 03:32:53.156196 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:53.156167 2582 generic.go:356] "Generic (PLEG): container finished" podID="e7780df5-f03a-4222-bb0c-38ed1c71ae2d" containerID="83e8bfd0a352056e301252d075427afcb39b7353801ab89a6ccb7681076e9db0" exitCode=0 Jul 10 03:32:53.156640 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:53.156205 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5c85h" event={"ID":"e7780df5-f03a-4222-bb0c-38ed1c71ae2d","Type":"ContainerDied","Data":"83e8bfd0a352056e301252d075427afcb39b7353801ab89a6ccb7681076e9db0"} Jul 10 03:32:53.879189 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:53.879152 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:32:53.879355 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:53.879294 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jznf5" podUID="8ed54eed-0e8e-490d-acc6-56615ee5340b" Jul 10 03:32:53.879409 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:53.879359 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv6dh" Jul 10 03:32:53.879494 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:53.879471 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bv6dh" podUID="5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c" Jul 10 03:32:54.491645 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:54.491613 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ed54eed-0e8e-490d-acc6-56615ee5340b-original-pull-secret\") pod \"global-pull-secret-syncer-jznf5\" (UID: \"8ed54eed-0e8e-490d-acc6-56615ee5340b\") " pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:32:54.492079 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:54.491768 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 03:32:54.492079 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:54.491835 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ed54eed-0e8e-490d-acc6-56615ee5340b-original-pull-secret podName:8ed54eed-0e8e-490d-acc6-56615ee5340b nodeName:}" failed. No retries permitted until 2026-07-10 03:33:26.491815075 +0000 UTC m=+66.143626712 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8ed54eed-0e8e-490d-acc6-56615ee5340b-original-pull-secret") pod "global-pull-secret-syncer-jznf5" (UID: "8ed54eed-0e8e-490d-acc6-56615ee5340b") : object "kube-system"/"original-pull-secret" not registered Jul 10 03:32:54.592728 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:54.592693 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-metrics-certs\") pod \"network-metrics-daemon-ddntq\" (UID: \"b78bc3c1-3658-4cdd-ba93-30d686b78aa5\") " pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:32:54.592965 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:54.592823 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 03:32:54.592965 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:54.592880 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-metrics-certs podName:b78bc3c1-3658-4cdd-ba93-30d686b78aa5 nodeName:}" failed. No retries permitted until 2026-07-10 03:33:26.592866181 +0000 UTC m=+66.244677808 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-metrics-certs") pod "network-metrics-daemon-ddntq" (UID: "b78bc3c1-3658-4cdd-ba93-30d686b78aa5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 03:32:54.693783 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:54.693748 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqfb4\" (UniqueName: \"kubernetes.io/projected/5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c-kube-api-access-rqfb4\") pod \"network-check-target-bv6dh\" (UID: \"5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c\") " pod="openshift-network-diagnostics/network-check-target-bv6dh" Jul 10 03:32:54.694006 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:54.693932 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 03:32:54.694006 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:54.693954 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 03:32:54.694006 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:54.693967 2582 projected.go:196] Error preparing data for projected volume kube-api-access-rqfb4 for pod openshift-network-diagnostics/network-check-target-bv6dh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 03:32:54.694129 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:54.694026 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c-kube-api-access-rqfb4 podName:5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c nodeName:}" failed. No retries permitted until 2026-07-10 03:33:26.694010929 +0000 UTC m=+66.345822556 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rqfb4" (UniqueName: "kubernetes.io/projected/5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c-kube-api-access-rqfb4") pod "network-check-target-bv6dh" (UID: "5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 03:32:54.878759 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:54.878681 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:32:54.878968 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:54.878818 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ddntq" podUID="b78bc3c1-3658-4cdd-ba93-30d686b78aa5" Jul 10 03:32:55.619464 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.619387 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-177.ec2.internal" event="NodeReady" Jul 10 03:32:55.619868 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.619528 2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 10 03:32:55.659766 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.659736 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-267rs"] Jul 10 03:32:55.662004 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.661966 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-267rs" Jul 10 03:32:55.662142 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.661975 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-njp2r"] Jul 10 03:32:55.664210 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.664003 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-njp2r" Jul 10 03:32:55.664337 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.664183 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 10 03:32:55.664406 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.664352 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dk2pk\"" Jul 10 03:32:55.665029 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.665008 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 10 03:32:55.683848 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.683826 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 10 03:32:55.683990 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.683826 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 10 03:32:55.683990 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.683832 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 10 03:32:55.684166 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.684035 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7txf6\"" Jul 10 03:32:55.685118 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.685103 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-267rs"] Jul 10 03:32:55.686110 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.686087 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-njp2r"] Jul 10 03:32:55.801574 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.801547 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j98nd\" (UniqueName: \"kubernetes.io/projected/d4e07574-8e12-4c22-9f6c-49c0bc88cd5f-kube-api-access-j98nd\") pod \"ingress-canary-njp2r\" (UID: \"d4e07574-8e12-4c22-9f6c-49c0bc88cd5f\") " pod="openshift-ingress-canary/ingress-canary-njp2r" Jul 10 03:32:55.801765 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.801581 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xxg9\" (UniqueName: \"kubernetes.io/projected/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-kube-api-access-9xxg9\") pod \"dns-default-267rs\" (UID: \"99ee7944-11db-4b68-bfe1-4cd910cf2ef2\") " pod="openshift-dns/dns-default-267rs" Jul 10 03:32:55.801765 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.801633 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4e07574-8e12-4c22-9f6c-49c0bc88cd5f-cert\") pod \"ingress-canary-njp2r\" (UID: \"d4e07574-8e12-4c22-9f6c-49c0bc88cd5f\") " pod="openshift-ingress-canary/ingress-canary-njp2r" Jul 10 03:32:55.801765 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.801705 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-metrics-tls\") pod \"dns-default-267rs\" (UID: \"99ee7944-11db-4b68-bfe1-4cd910cf2ef2\") " pod="openshift-dns/dns-default-267rs" Jul 10 03:32:55.801765 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.801757 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-config-volume\") pod \"dns-default-267rs\" (UID: \"99ee7944-11db-4b68-bfe1-4cd910cf2ef2\") " pod="openshift-dns/dns-default-267rs" Jul 10 03:32:55.801955 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.801790 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-tmp-dir\") pod \"dns-default-267rs\" (UID: \"99ee7944-11db-4b68-bfe1-4cd910cf2ef2\") " pod="openshift-dns/dns-default-267rs" Jul 10 03:32:55.878993 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.878883 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:32:55.878993 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.878937 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv6dh" Jul 10 03:32:55.881669 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.881643 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 03:32:55.881782 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.881673 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 03:32:55.881782 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.881694 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c4cxw\"" Jul 10 03:32:55.881782 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.881757 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 03:32:55.902598 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.902576 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j98nd\" (UniqueName: \"kubernetes.io/projected/d4e07574-8e12-4c22-9f6c-49c0bc88cd5f-kube-api-access-j98nd\") pod \"ingress-canary-njp2r\" (UID: \"d4e07574-8e12-4c22-9f6c-49c0bc88cd5f\") " pod="openshift-ingress-canary/ingress-canary-njp2r" Jul 10 03:32:55.902721 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.902608 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xxg9\" (UniqueName: \"kubernetes.io/projected/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-kube-api-access-9xxg9\") pod \"dns-default-267rs\" (UID: \"99ee7944-11db-4b68-bfe1-4cd910cf2ef2\") " pod="openshift-dns/dns-default-267rs" Jul 10 03:32:55.902778 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.902724 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4e07574-8e12-4c22-9f6c-49c0bc88cd5f-cert\") pod \"ingress-canary-njp2r\" (UID: \"d4e07574-8e12-4c22-9f6c-49c0bc88cd5f\") " pod="openshift-ingress-canary/ingress-canary-njp2r" Jul 10 03:32:55.902778 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.902754 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-metrics-tls\") pod \"dns-default-267rs\" (UID: \"99ee7944-11db-4b68-bfe1-4cd910cf2ef2\") " pod="openshift-dns/dns-default-267rs" Jul 10 03:32:55.902885 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.902784 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-config-volume\") pod \"dns-default-267rs\" (UID: \"99ee7944-11db-4b68-bfe1-4cd910cf2ef2\") " pod="openshift-dns/dns-default-267rs" Jul 10 03:32:55.902885 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.902808 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-tmp-dir\") pod \"dns-default-267rs\" (UID: \"99ee7944-11db-4b68-bfe1-4cd910cf2ef2\") " pod="openshift-dns/dns-default-267rs" Jul 10 03:32:55.903010 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:55.902953 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 03:32:55.903058 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:55.903020 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-metrics-tls podName:99ee7944-11db-4b68-bfe1-4cd910cf2ef2 nodeName:}" failed. No retries permitted until 2026-07-10 03:32:56.403001641 +0000 UTC m=+36.054813271 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-metrics-tls") pod "dns-default-267rs" (UID: "99ee7944-11db-4b68-bfe1-4cd910cf2ef2") : secret "dns-default-metrics-tls" not found Jul 10 03:32:55.903141 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.903122 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-tmp-dir\") pod \"dns-default-267rs\" (UID: \"99ee7944-11db-4b68-bfe1-4cd910cf2ef2\") " pod="openshift-dns/dns-default-267rs" Jul 10 03:32:55.903555 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.903527 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-config-volume\") pod \"dns-default-267rs\" (UID: \"99ee7944-11db-4b68-bfe1-4cd910cf2ef2\") " pod="openshift-dns/dns-default-267rs" Jul 10 03:32:55.907521 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.907500 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d4e07574-8e12-4c22-9f6c-49c0bc88cd5f-cert\") pod \"ingress-canary-njp2r\" (UID: \"d4e07574-8e12-4c22-9f6c-49c0bc88cd5f\") " pod="openshift-ingress-canary/ingress-canary-njp2r" Jul 10 03:32:55.911457 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.911438 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xxg9\" (UniqueName: \"kubernetes.io/projected/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-kube-api-access-9xxg9\") pod \"dns-default-267rs\" (UID: \"99ee7944-11db-4b68-bfe1-4cd910cf2ef2\") " pod="openshift-dns/dns-default-267rs" Jul 10 03:32:55.911602 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.911579 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j98nd\" (UniqueName: \"kubernetes.io/projected/d4e07574-8e12-4c22-9f6c-49c0bc88cd5f-kube-api-access-j98nd\") pod \"ingress-canary-njp2r\" (UID: \"d4e07574-8e12-4c22-9f6c-49c0bc88cd5f\") " pod="openshift-ingress-canary/ingress-canary-njp2r" Jul 10 03:32:55.982626 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:55.982595 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-njp2r" Jul 10 03:32:56.405854 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:56.405827 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-metrics-tls\") pod \"dns-default-267rs\" (UID: \"99ee7944-11db-4b68-bfe1-4cd910cf2ef2\") " pod="openshift-dns/dns-default-267rs" Jul 10 03:32:56.406055 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:56.405956 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 03:32:56.406055 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:56.406014 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-metrics-tls podName:99ee7944-11db-4b68-bfe1-4cd910cf2ef2 nodeName:}" failed. No retries permitted until 2026-07-10 03:32:57.405996481 +0000 UTC m=+37.057808115 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-metrics-tls") pod "dns-default-267rs" (UID: "99ee7944-11db-4b68-bfe1-4cd910cf2ef2") : secret "dns-default-metrics-tls" not found Jul 10 03:32:56.878582 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:56.878507 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:32:56.881130 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:56.881106 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 03:32:56.881263 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:56.881163 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sg5lf\"" Jul 10 03:32:57.292271 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:57.292247 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-njp2r"] Jul 10 03:32:57.296153 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:32:57.296124 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4e07574_8e12_4c22_9f6c_49c0bc88cd5f.slice/crio-980c5249f410b2f87e32cd5118818273e4931a5e63dcde7de204132a75139bdf WatchSource:0}: Error finding container 980c5249f410b2f87e32cd5118818273e4931a5e63dcde7de204132a75139bdf: Status 404 returned error can't find the container with id 980c5249f410b2f87e32cd5118818273e4931a5e63dcde7de204132a75139bdf Jul 10 03:32:57.413125 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:57.413101 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-metrics-tls\") pod \"dns-default-267rs\" (UID: \"99ee7944-11db-4b68-bfe1-4cd910cf2ef2\") " pod="openshift-dns/dns-default-267rs" Jul 10 03:32:57.413275 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:57.413256 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 03:32:57.413328 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:57.413319 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-metrics-tls podName:99ee7944-11db-4b68-bfe1-4cd910cf2ef2 nodeName:}" failed. No retries permitted until 2026-07-10 03:32:59.413303889 +0000 UTC m=+39.065115516 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-metrics-tls") pod "dns-default-267rs" (UID: "99ee7944-11db-4b68-bfe1-4cd910cf2ef2") : secret "dns-default-metrics-tls" not found Jul 10 03:32:58.168854 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:58.168817 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-njp2r" event={"ID":"d4e07574-8e12-4c22-9f6c-49c0bc88cd5f","Type":"ContainerStarted","Data":"980c5249f410b2f87e32cd5118818273e4931a5e63dcde7de204132a75139bdf"} Jul 10 03:32:58.171842 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:58.171813 2582 generic.go:356] "Generic (PLEG): container finished" podID="e7780df5-f03a-4222-bb0c-38ed1c71ae2d" containerID="535c3df9b60e3572c3b7ff6fe2bb9fe890571e63bf0178f72420050ac6f859f8" exitCode=0 Jul 10 03:32:58.171995 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:58.171854 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5c85h" event={"ID":"e7780df5-f03a-4222-bb0c-38ed1c71ae2d","Type":"ContainerDied","Data":"535c3df9b60e3572c3b7ff6fe2bb9fe890571e63bf0178f72420050ac6f859f8"} Jul 10 03:32:59.177618 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:59.177583 2582 generic.go:356] "Generic (PLEG): container finished" podID="e7780df5-f03a-4222-bb0c-38ed1c71ae2d" containerID="b4d8b20528af1cf4e858f79936ea756cc3d341260020023c4457878fe3741854" exitCode=0 Jul 10 03:32:59.178072 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:59.177645 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5c85h" event={"ID":"e7780df5-f03a-4222-bb0c-38ed1c71ae2d","Type":"ContainerDied","Data":"b4d8b20528af1cf4e858f79936ea756cc3d341260020023c4457878fe3741854"} Jul 10 03:32:59.428500 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:32:59.428399 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-metrics-tls\") pod \"dns-default-267rs\" (UID: \"99ee7944-11db-4b68-bfe1-4cd910cf2ef2\") " pod="openshift-dns/dns-default-267rs" Jul 10 03:32:59.428659 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:59.428561 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 03:32:59.428659 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:32:59.428636 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-metrics-tls podName:99ee7944-11db-4b68-bfe1-4cd910cf2ef2 nodeName:}" failed. No retries permitted until 2026-07-10 03:33:03.428615312 +0000 UTC m=+43.080426963 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-metrics-tls") pod "dns-default-267rs" (UID: "99ee7944-11db-4b68-bfe1-4cd910cf2ef2") : secret "dns-default-metrics-tls" not found Jul 10 03:33:00.181068 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:00.181040 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-njp2r" event={"ID":"d4e07574-8e12-4c22-9f6c-49c0bc88cd5f","Type":"ContainerStarted","Data":"d3bfa5c4c038c95b771d14b0c416e414ea1dccd52503aad0d8f49b4cad00ce4d"} Jul 10 03:33:00.184326 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:00.184301 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5c85h" event={"ID":"e7780df5-f03a-4222-bb0c-38ed1c71ae2d","Type":"ContainerStarted","Data":"ae8c7698bdd09d1c3412a649fde14dc5334519ce944453f7ef12b39ead868bbe"} Jul 10 03:33:00.195742 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:00.195701 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-njp2r" podStartSLOduration=2.848176838 podStartE2EDuration="5.195686512s" totalImagesPullingTime="2.347509674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:32:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:33:00.194238866 +0000 UTC m=+39.846050514" watchObservedRunningTime="2026-07-10 03:33:00.195686512 +0000 UTC m=+39.847498184" Jul 10 03:33:00.214500 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:00.214447 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5c85h" podStartSLOduration=8.762457066 podStartE2EDuration="39.214432388s" totalImagesPullingTime="30.451975322s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 03:32:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:33:00.213279621 +0000 UTC m=+39.865091274" watchObservedRunningTime="2026-07-10 03:33:00.214432388 +0000 UTC m=+39.866244036" Jul 10 03:33:03.456305 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:03.456266 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-metrics-tls\") pod \"dns-default-267rs\" (UID: \"99ee7944-11db-4b68-bfe1-4cd910cf2ef2\") " pod="openshift-dns/dns-default-267rs" Jul 10 03:33:03.456842 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:33:03.456396 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 03:33:03.456842 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:33:03.456468 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-metrics-tls podName:99ee7944-11db-4b68-bfe1-4cd910cf2ef2 nodeName:}" failed. No retries permitted until 2026-07-10 03:33:11.45644696 +0000 UTC m=+51.108258590 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-metrics-tls") pod "dns-default-267rs" (UID: "99ee7944-11db-4b68-bfe1-4cd910cf2ef2") : secret "dns-default-metrics-tls" not found Jul 10 03:33:11.510435 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:11.510395 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-metrics-tls\") pod \"dns-default-267rs\" (UID: \"99ee7944-11db-4b68-bfe1-4cd910cf2ef2\") " pod="openshift-dns/dns-default-267rs" Jul 10 03:33:11.510882 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:33:11.510512 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 03:33:11.510882 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:33:11.510561 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-metrics-tls podName:99ee7944-11db-4b68-bfe1-4cd910cf2ef2 nodeName:}" failed. No retries permitted until 2026-07-10 03:33:27.510547099 +0000 UTC m=+67.162358725 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-metrics-tls") pod "dns-default-267rs" (UID: "99ee7944-11db-4b68-bfe1-4cd910cf2ef2") : secret "dns-default-metrics-tls" not found Jul 10 03:33:22.171273 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:22.171242 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pjnbc" Jul 10 03:33:26.510609 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:26.510558 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ed54eed-0e8e-490d-acc6-56615ee5340b-original-pull-secret\") pod \"global-pull-secret-syncer-jznf5\" (UID: \"8ed54eed-0e8e-490d-acc6-56615ee5340b\") " pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:33:26.513353 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:26.513336 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 03:33:26.524092 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:26.524071 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ed54eed-0e8e-490d-acc6-56615ee5340b-original-pull-secret\") pod \"global-pull-secret-syncer-jznf5\" (UID: \"8ed54eed-0e8e-490d-acc6-56615ee5340b\") " pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:33:26.611005 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:26.610970 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-metrics-certs\") pod \"network-metrics-daemon-ddntq\" (UID: \"b78bc3c1-3658-4cdd-ba93-30d686b78aa5\") " pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:33:26.613224 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:26.613200 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 03:33:26.621854 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:33:26.621838 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 10 03:33:26.621936 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:33:26.621926 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-metrics-certs podName:b78bc3c1-3658-4cdd-ba93-30d686b78aa5 nodeName:}" failed. No retries permitted until 2026-07-10 03:34:30.621888479 +0000 UTC m=+130.273700106 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-metrics-certs") pod "network-metrics-daemon-ddntq" (UID: "b78bc3c1-3658-4cdd-ba93-30d686b78aa5") : secret "metrics-daemon-secret" not found Jul 10 03:33:26.711727 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:26.711704 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqfb4\" (UniqueName: \"kubernetes.io/projected/5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c-kube-api-access-rqfb4\") pod \"network-check-target-bv6dh\" (UID: \"5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c\") " pod="openshift-network-diagnostics/network-check-target-bv6dh" Jul 10 03:33:26.714090 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:26.714074 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 03:33:26.724596 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:26.724578 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 03:33:26.735437 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:26.735416 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqfb4\" (UniqueName: \"kubernetes.io/projected/5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c-kube-api-access-rqfb4\") pod \"network-check-target-bv6dh\" (UID: \"5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c\") " pod="openshift-network-diagnostics/network-check-target-bv6dh" Jul 10 03:33:26.790339 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:26.790282 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jznf5" Jul 10 03:33:26.797384 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:26.797369 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c4cxw\"" Jul 10 03:33:26.806202 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:26.806184 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bv6dh" Jul 10 03:33:26.929155 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:26.929127 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jznf5"] Jul 10 03:33:26.932984 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:33:26.932956 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ed54eed_0e8e_490d_acc6_56615ee5340b.slice/crio-1514352c4a1885b37f35ccb6d564c7eb7a39a41ad479f0ffa5369fc40d9b6893 WatchSource:0}: Error finding container 1514352c4a1885b37f35ccb6d564c7eb7a39a41ad479f0ffa5369fc40d9b6893: Status 404 returned error can't find the container with id 1514352c4a1885b37f35ccb6d564c7eb7a39a41ad479f0ffa5369fc40d9b6893 Jul 10 03:33:26.954285 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:26.954264 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bv6dh"] Jul 10 03:33:26.957002 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:33:26.956979 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c7494d0_9ec9_40b8_a6bb_4b6e8e69265c.slice/crio-eaa1ffc568a931038d3f588f99731d11d744d140468bb2c593c0ece725fbd2b4 WatchSource:0}: Error finding container eaa1ffc568a931038d3f588f99731d11d744d140468bb2c593c0ece725fbd2b4: Status 404 returned error can't find the container with id eaa1ffc568a931038d3f588f99731d11d744d140468bb2c593c0ece725fbd2b4 Jul 10 03:33:27.243778 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:27.243694 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bv6dh" event={"ID":"5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c","Type":"ContainerStarted","Data":"eaa1ffc568a931038d3f588f99731d11d744d140468bb2c593c0ece725fbd2b4"} Jul 10 03:33:27.244707 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:27.244683 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jznf5" event={"ID":"8ed54eed-0e8e-490d-acc6-56615ee5340b","Type":"ContainerStarted","Data":"1514352c4a1885b37f35ccb6d564c7eb7a39a41ad479f0ffa5369fc40d9b6893"} Jul 10 03:33:27.520177 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:27.520137 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-metrics-tls\") pod \"dns-default-267rs\" (UID: \"99ee7944-11db-4b68-bfe1-4cd910cf2ef2\") " pod="openshift-dns/dns-default-267rs" Jul 10 03:33:27.520583 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:33:27.520296 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 03:33:27.520583 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:33:27.520377 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-metrics-tls podName:99ee7944-11db-4b68-bfe1-4cd910cf2ef2 nodeName:}" failed. No retries permitted until 2026-07-10 03:33:59.520357329 +0000 UTC m=+99.172168960 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-metrics-tls") pod "dns-default-267rs" (UID: "99ee7944-11db-4b68-bfe1-4cd910cf2ef2") : secret "dns-default-metrics-tls" not found Jul 10 03:33:32.263471 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:32.263424 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bv6dh" event={"ID":"5c7494d0-9ec9-40b8-a6bb-4b6e8e69265c","Type":"ContainerStarted","Data":"e31aed624e03bde2a47ec32c733e86644137e4f96d8f2fce9961e82ccc6f3fc0"} Jul 10 03:33:32.263940 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:32.263529 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bv6dh" Jul 10 03:33:32.264862 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:32.264842 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jznf5" event={"ID":"8ed54eed-0e8e-490d-acc6-56615ee5340b","Type":"ContainerStarted","Data":"2ffe4cf059b01482b2f7c955d6332e20d5b2ceb7d453b3c7e9e5d2f95c894ec0"} Jul 10 03:33:32.277842 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:32.277800 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bv6dh" podStartSLOduration=66.602250294 podStartE2EDuration="1m11.277787657s" totalImagesPullingTime="4.675537363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:32:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:33:32.277085512 +0000 UTC m=+71.928897164" watchObservedRunningTime="2026-07-10 03:33:32.277787657 +0000 UTC m=+71.929599304" Jul 10 03:33:32.290195 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:32.290159 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jznf5" podStartSLOduration=66.586905672 podStartE2EDuration="1m11.290147981s" totalImagesPullingTime="4.703242309s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 03:32:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:33:32.289782529 +0000 UTC m=+71.941594178" watchObservedRunningTime="2026-07-10 03:33:32.290147981 +0000 UTC m=+71.941959630" Jul 10 03:33:45.193054 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:45.192938 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8489f94776-8sx76"] Jul 10 03:33:45.195183 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:45.195168 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8489f94776-8sx76" Jul 10 03:33:45.198414 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:45.198391 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 10 03:33:45.198414 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:45.198392 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-8lcql\"" Jul 10 03:33:45.198414 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:45.198393 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 10 03:33:45.198676 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:45.198435 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 10 03:33:45.198676 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:45.198395 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 10 03:33:45.204286 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:45.204267 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8489f94776-8sx76"] Jul 10 03:33:45.226824 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:45.226802 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/02f6e25f-158a-4d8e-af6f-a4f4143f0883-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8489f94776-8sx76\" (UID: \"02f6e25f-158a-4d8e-af6f-a4f4143f0883\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8489f94776-8sx76" Jul 10 03:33:45.226954 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:45.226849 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftlxw\" (UniqueName: \"kubernetes.io/projected/02f6e25f-158a-4d8e-af6f-a4f4143f0883-kube-api-access-ftlxw\") pod \"managed-serviceaccount-addon-agent-8489f94776-8sx76\" (UID: \"02f6e25f-158a-4d8e-af6f-a4f4143f0883\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8489f94776-8sx76" Jul 10 03:33:45.327609 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:45.327579 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/02f6e25f-158a-4d8e-af6f-a4f4143f0883-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8489f94776-8sx76\" (UID: \"02f6e25f-158a-4d8e-af6f-a4f4143f0883\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8489f94776-8sx76" Jul 10 03:33:45.327759 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:45.327620 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftlxw\" (UniqueName: \"kubernetes.io/projected/02f6e25f-158a-4d8e-af6f-a4f4143f0883-kube-api-access-ftlxw\") pod \"managed-serviceaccount-addon-agent-8489f94776-8sx76\" (UID: \"02f6e25f-158a-4d8e-af6f-a4f4143f0883\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8489f94776-8sx76" Jul 10 03:33:45.329951 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:45.329929 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/02f6e25f-158a-4d8e-af6f-a4f4143f0883-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-8489f94776-8sx76\" (UID: \"02f6e25f-158a-4d8e-af6f-a4f4143f0883\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8489f94776-8sx76" Jul 10 03:33:45.334990 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:45.334966 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftlxw\" (UniqueName: \"kubernetes.io/projected/02f6e25f-158a-4d8e-af6f-a4f4143f0883-kube-api-access-ftlxw\") pod \"managed-serviceaccount-addon-agent-8489f94776-8sx76\" (UID: \"02f6e25f-158a-4d8e-af6f-a4f4143f0883\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8489f94776-8sx76" Jul 10 03:33:45.514466 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:45.514434 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8489f94776-8sx76" Jul 10 03:33:45.627105 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:45.627075 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8489f94776-8sx76"] Jul 10 03:33:45.631873 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:33:45.631847 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod02f6e25f_158a_4d8e_af6f_a4f4143f0883.slice/crio-f101b91b0a09c5ee020aee69e40ce64fe46b9e4510def27c57e9f53a5aa760b3 WatchSource:0}: Error finding container f101b91b0a09c5ee020aee69e40ce64fe46b9e4510def27c57e9f53a5aa760b3: Status 404 returned error can't find the container with id f101b91b0a09c5ee020aee69e40ce64fe46b9e4510def27c57e9f53a5aa760b3 Jul 10 03:33:46.298305 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:46.298267 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8489f94776-8sx76" event={"ID":"02f6e25f-158a-4d8e-af6f-a4f4143f0883","Type":"ContainerStarted","Data":"f101b91b0a09c5ee020aee69e40ce64fe46b9e4510def27c57e9f53a5aa760b3"} Jul 10 03:33:48.304852 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:48.304815 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8489f94776-8sx76" event={"ID":"02f6e25f-158a-4d8e-af6f-a4f4143f0883","Type":"ContainerStarted","Data":"5f9233b4b42e494ef4042812c7bc4d4f73b82390ef8493cf6b26979272d394d4"} Jul 10 03:33:48.318178 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:48.318126 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8489f94776-8sx76" podStartSLOduration=0.820027959 podStartE2EDuration="3.318111567s" totalImagesPullingTime="2.498083608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:33:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:33:48.318014834 +0000 UTC m=+87.969826484" watchObservedRunningTime="2026-07-10 03:33:48.318111567 +0000 UTC m=+87.969923215" Jul 10 03:33:59.618234 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:33:59.618194 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-metrics-tls\") pod \"dns-default-267rs\" (UID: \"99ee7944-11db-4b68-bfe1-4cd910cf2ef2\") " pod="openshift-dns/dns-default-267rs" Jul 10 03:33:59.618707 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:33:59.618315 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 03:33:59.618774 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:33:59.618747 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-metrics-tls podName:99ee7944-11db-4b68-bfe1-4cd910cf2ef2 nodeName:}" failed. No retries permitted until 2026-07-10 03:35:03.618374572 +0000 UTC m=+163.270186222 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-metrics-tls") pod "dns-default-267rs" (UID: "99ee7944-11db-4b68-bfe1-4cd910cf2ef2") : secret "dns-default-metrics-tls" not found Jul 10 03:34:03.269948 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:34:03.269920 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bv6dh" Jul 10 03:34:30.622820 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:34:30.622783 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-metrics-certs\") pod \"network-metrics-daemon-ddntq\" (UID: \"b78bc3c1-3658-4cdd-ba93-30d686b78aa5\") " pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:34:30.623300 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:34:30.622899 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 10 03:34:30.623300 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:34:30.622968 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-metrics-certs podName:b78bc3c1-3658-4cdd-ba93-30d686b78aa5 nodeName:}" failed. No retries permitted until 2026-07-10 03:36:32.622953777 +0000 UTC m=+252.274765404 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-metrics-certs") pod "network-metrics-daemon-ddntq" (UID: "b78bc3c1-3658-4cdd-ba93-30d686b78aa5") : secret "metrics-daemon-secret" not found Jul 10 03:34:58.676839 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:34:58.676786 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-267rs" podUID="99ee7944-11db-4b68-bfe1-4cd910cf2ef2" Jul 10 03:34:59.469670 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:34:59.469639 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-267rs" Jul 10 03:34:59.888781 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:34:59.888734 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-ddntq" podUID="b78bc3c1-3658-4cdd-ba93-30d686b78aa5" Jul 10 03:35:03.632206 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:35:03.632150 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-metrics-tls\") pod \"dns-default-267rs\" (UID: \"99ee7944-11db-4b68-bfe1-4cd910cf2ef2\") " pod="openshift-dns/dns-default-267rs" Jul 10 03:35:03.632610 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:35:03.632280 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 10 03:35:03.632610 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:35:03.632338 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-metrics-tls podName:99ee7944-11db-4b68-bfe1-4cd910cf2ef2 nodeName:}" failed. No retries permitted until 2026-07-10 03:37:05.632320744 +0000 UTC m=+285.284132371 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-metrics-tls") pod "dns-default-267rs" (UID: "99ee7944-11db-4b68-bfe1-4cd910cf2ef2") : secret "dns-default-metrics-tls" not found Jul 10 03:35:10.880087 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:35:10.880053 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:35:48.587064 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:35:48.586981 2582 generic.go:356] "Generic (PLEG): container finished" podID="02f6e25f-158a-4d8e-af6f-a4f4143f0883" containerID="5f9233b4b42e494ef4042812c7bc4d4f73b82390ef8493cf6b26979272d394d4" exitCode=255 Jul 10 03:35:48.587064 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:35:48.587023 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8489f94776-8sx76" event={"ID":"02f6e25f-158a-4d8e-af6f-a4f4143f0883","Type":"ContainerDied","Data":"5f9233b4b42e494ef4042812c7bc4d4f73b82390ef8493cf6b26979272d394d4"} Jul 10 03:35:48.592283 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:35:48.592267 2582 scope.go:117] "RemoveContainer" containerID="5f9233b4b42e494ef4042812c7bc4d4f73b82390ef8493cf6b26979272d394d4" Jul 10 03:35:49.591144 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:35:49.591105 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-8489f94776-8sx76" event={"ID":"02f6e25f-158a-4d8e-af6f-a4f4143f0883","Type":"ContainerStarted","Data":"9d689feae26f3c8450e64572c79df74e31b18425b7144979ee4c42877499192f"} Jul 10 03:36:24.391749 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.391718 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-c9b7b4644-bkzc2"] Jul 10 03:36:24.393609 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.393594 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-c9b7b4644-bkzc2" Jul 10 03:36:24.395716 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.395694 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 10 03:36:24.396608 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.396589 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-jcbvp\"" Jul 10 03:36:24.396760 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.396744 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 10 03:36:24.396895 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.396875 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 10 03:36:24.396895 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.396886 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 10 03:36:24.397033 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.396976 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 10 03:36:24.397195 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.397170 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 10 03:36:24.410508 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.410490 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-c9b7b4644-bkzc2"] Jul 10 03:36:24.482475 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.482448 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qbmht"] Jul 10 03:36:24.484109 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.484095 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qbmht" Jul 10 03:36:24.486230 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.486207 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 10 03:36:24.486338 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.486323 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 10 03:36:24.486398 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.486355 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 10 03:36:24.486671 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.486658 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-xnn6c\"" Jul 10 03:36:24.486752 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.486663 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 10 03:36:24.489484 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.489464 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dd799"] Jul 10 03:36:24.491275 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.491258 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6rhrf"] Jul 10 03:36:24.491377 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.491363 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dd799" Jul 10 03:36:24.493045 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.493030 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-684ff59cc9-5rfpw"] Jul 10 03:36:24.493156 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.493141 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6rhrf" Jul 10 03:36:24.493402 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.493383 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 10 03:36:24.493725 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.493705 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-tvbxc\"" Jul 10 03:36:24.493827 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.493705 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 10 03:36:24.494685 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.494668 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 10 03:36:24.494773 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.494670 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 10 03:36:24.494773 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.494762 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" Jul 10 03:36:24.495185 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.495168 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 10 03:36:24.495451 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.495435 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 10 03:36:24.497772 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.497754 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vd5xr\"" Jul 10 03:36:24.498155 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.498136 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 10 03:36:24.498285 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.498262 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 10 03:36:24.498385 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.498136 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 10 03:36:24.498385 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.498197 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tqxc2\"" Jul 10 03:36:24.498385 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.498149 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 10 03:36:24.499221 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.499131 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qbmht"] Jul 10 03:36:24.504406 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.504389 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 10 03:36:24.507889 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.507868 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dd799"] Jul 10 03:36:24.508921 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.508877 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6rhrf"] Jul 10 03:36:24.509534 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.509516 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-684ff59cc9-5rfpw"] Jul 10 03:36:24.546195 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.546162 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-service-ca-bundle\") pod \"router-default-c9b7b4644-bkzc2\" (UID: \"6cf60a11-25ec-41eb-9683-f3fcdae52ea9\") " pod="openshift-ingress/router-default-c9b7b4644-bkzc2" Jul 10 03:36:24.546300 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.546211 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4kmz\" (UniqueName: \"kubernetes.io/projected/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-kube-api-access-x4kmz\") pod \"router-default-c9b7b4644-bkzc2\" (UID: \"6cf60a11-25ec-41eb-9683-f3fcdae52ea9\") " pod="openshift-ingress/router-default-c9b7b4644-bkzc2" Jul 10 03:36:24.546300 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.546237 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-default-certificate\") pod \"router-default-c9b7b4644-bkzc2\" (UID: \"6cf60a11-25ec-41eb-9683-f3fcdae52ea9\") " pod="openshift-ingress/router-default-c9b7b4644-bkzc2" Jul 10 03:36:24.546300 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.546259 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-stats-auth\") pod \"router-default-c9b7b4644-bkzc2\" (UID: \"6cf60a11-25ec-41eb-9683-f3fcdae52ea9\") " pod="openshift-ingress/router-default-c9b7b4644-bkzc2" Jul 10 03:36:24.546300 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.546278 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-metrics-certs\") pod \"router-default-c9b7b4644-bkzc2\" (UID: \"6cf60a11-25ec-41eb-9683-f3fcdae52ea9\") " pod="openshift-ingress/router-default-c9b7b4644-bkzc2" Jul 10 03:36:24.647625 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.647557 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-bound-sa-token\") pod \"image-registry-684ff59cc9-5rfpw\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" Jul 10 03:36:24.647625 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.647590 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ps2j\" (UniqueName: \"kubernetes.io/projected/92394405-5015-4182-839f-1e023ad37b24-kube-api-access-7ps2j\") pod \"service-ca-operator-7695fc6c8c-qbmht\" (UID: \"92394405-5015-4182-839f-1e023ad37b24\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qbmht" Jul 10 03:36:24.647625 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.647619 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-metrics-certs\") pod \"router-default-c9b7b4644-bkzc2\" (UID: \"6cf60a11-25ec-41eb-9683-f3fcdae52ea9\") " pod="openshift-ingress/router-default-c9b7b4644-bkzc2" Jul 10 03:36:24.647794 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.647643 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-registry-tls\") pod \"image-registry-684ff59cc9-5rfpw\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" Jul 10 03:36:24.647794 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.647672 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-ca-trust-extracted\") pod \"image-registry-684ff59cc9-5rfpw\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" Jul 10 03:36:24.647794 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.647690 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgz6g\" (UniqueName: \"kubernetes.io/projected/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-kube-api-access-fgz6g\") pod \"image-registry-684ff59cc9-5rfpw\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" Jul 10 03:36:24.647794 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:24.647724 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 03:36:24.647794 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.647740 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-service-ca-bundle\") pod \"router-default-c9b7b4644-bkzc2\" (UID: \"6cf60a11-25ec-41eb-9683-f3fcdae52ea9\") " pod="openshift-ingress/router-default-c9b7b4644-bkzc2" Jul 10 03:36:24.647794 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.647761 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/92394405-5015-4182-839f-1e023ad37b24-serving-cert\") pod \"service-ca-operator-7695fc6c8c-qbmht\" (UID: \"92394405-5015-4182-839f-1e023ad37b24\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qbmht" Jul 10 03:36:24.647794 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:24.647786 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-metrics-certs podName:6cf60a11-25ec-41eb-9683-f3fcdae52ea9 nodeName:}" failed. No retries permitted until 2026-07-10 03:36:25.147769696 +0000 UTC m=+244.799581322 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-metrics-certs") pod "router-default-c9b7b4644-bkzc2" (UID: "6cf60a11-25ec-41eb-9683-f3fcdae52ea9") : secret "router-metrics-certs-default" not found Jul 10 03:36:24.648026 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:24.647863 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-service-ca-bundle podName:6cf60a11-25ec-41eb-9683-f3fcdae52ea9 nodeName:}" failed. No retries permitted until 2026-07-10 03:36:25.147845578 +0000 UTC m=+244.799657205 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-service-ca-bundle") pod "router-default-c9b7b4644-bkzc2" (UID: "6cf60a11-25ec-41eb-9683-f3fcdae52ea9") : configmap references non-existent config key: service-ca.crt Jul 10 03:36:24.648026 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.647900 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4kmz\" (UniqueName: \"kubernetes.io/projected/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-kube-api-access-x4kmz\") pod \"router-default-c9b7b4644-bkzc2\" (UID: \"6cf60a11-25ec-41eb-9683-f3fcdae52ea9\") " pod="openshift-ingress/router-default-c9b7b4644-bkzc2" Jul 10 03:36:24.648026 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.647946 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-stats-auth\") pod \"router-default-c9b7b4644-bkzc2\" (UID: \"6cf60a11-25ec-41eb-9683-f3fcdae52ea9\") " pod="openshift-ingress/router-default-c9b7b4644-bkzc2" Jul 10 03:36:24.648026 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.647972 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-registry-certificates\") pod \"image-registry-684ff59cc9-5rfpw\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" Jul 10 03:36:24.648026 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.648003 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fblm\" (UniqueName: \"kubernetes.io/projected/6c477c08-a9cc-4d67-9051-750c3b7a0aab-kube-api-access-8fblm\") pod \"cluster-samples-operator-65db858894-6rhrf\" (UID: \"6c477c08-a9cc-4d67-9051-750c3b7a0aab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6rhrf" Jul 10 03:36:24.648233 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.648027 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-installation-pull-secrets\") pod \"image-registry-684ff59cc9-5rfpw\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" Jul 10 03:36:24.648233 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.648049 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-trusted-ca\") pod \"image-registry-684ff59cc9-5rfpw\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" Jul 10 03:36:24.648233 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.648111 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/92394405-5015-4182-839f-1e023ad37b24-config\") pod \"service-ca-operator-7695fc6c8c-qbmht\" (UID: \"92394405-5015-4182-839f-1e023ad37b24\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qbmht" Jul 10 03:36:24.648233 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.648162 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-default-certificate\") pod \"router-default-c9b7b4644-bkzc2\" (UID: \"6cf60a11-25ec-41eb-9683-f3fcdae52ea9\") " pod="openshift-ingress/router-default-c9b7b4644-bkzc2" Jul 10 03:36:24.648397 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.648244 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/573b4db4-bd46-49b9-9221-54ed2bf71644-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-dd799\" (UID: \"573b4db4-bd46-49b9-9221-54ed2bf71644\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dd799" Jul 10 03:36:24.648397 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.648279 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-image-registry-private-configuration\") pod \"image-registry-684ff59cc9-5rfpw\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" Jul 10 03:36:24.648397 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.648354 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vdxn\" (UniqueName: \"kubernetes.io/projected/573b4db4-bd46-49b9-9221-54ed2bf71644-kube-api-access-7vdxn\") pod \"cluster-monitoring-operator-5f7f494dd4-dd799\" (UID: \"573b4db4-bd46-49b9-9221-54ed2bf71644\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dd799" Jul 10 03:36:24.648527 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.648437 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c477c08-a9cc-4d67-9051-750c3b7a0aab-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-6rhrf\" (UID: \"6c477c08-a9cc-4d67-9051-750c3b7a0aab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6rhrf" Jul 10 03:36:24.648527 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.648475 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/573b4db4-bd46-49b9-9221-54ed2bf71644-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-dd799\" (UID: \"573b4db4-bd46-49b9-9221-54ed2bf71644\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dd799" Jul 10 03:36:24.650291 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.650272 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-stats-auth\") pod \"router-default-c9b7b4644-bkzc2\" (UID: \"6cf60a11-25ec-41eb-9683-f3fcdae52ea9\") " pod="openshift-ingress/router-default-c9b7b4644-bkzc2" Jul 10 03:36:24.650416 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.650398 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-default-certificate\") pod \"router-default-c9b7b4644-bkzc2\" (UID: \"6cf60a11-25ec-41eb-9683-f3fcdae52ea9\") " pod="openshift-ingress/router-default-c9b7b4644-bkzc2" Jul 10 03:36:24.655315 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.655284 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4kmz\" (UniqueName: \"kubernetes.io/projected/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-kube-api-access-x4kmz\") pod \"router-default-c9b7b4644-bkzc2\" (UID: \"6cf60a11-25ec-41eb-9683-f3fcdae52ea9\") " pod="openshift-ingress/router-default-c9b7b4644-bkzc2" Jul 10 03:36:24.749327 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.749305 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/92394405-5015-4182-839f-1e023ad37b24-serving-cert\") pod \"service-ca-operator-7695fc6c8c-qbmht\" (UID: \"92394405-5015-4182-839f-1e023ad37b24\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qbmht" Jul 10 03:36:24.749454 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.749339 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-registry-certificates\") pod \"image-registry-684ff59cc9-5rfpw\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" Jul 10 03:36:24.749454 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.749357 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fblm\" (UniqueName: \"kubernetes.io/projected/6c477c08-a9cc-4d67-9051-750c3b7a0aab-kube-api-access-8fblm\") pod \"cluster-samples-operator-65db858894-6rhrf\" (UID: \"6c477c08-a9cc-4d67-9051-750c3b7a0aab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6rhrf" Jul 10 03:36:24.749454 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.749373 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-installation-pull-secrets\") pod \"image-registry-684ff59cc9-5rfpw\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" Jul 10 03:36:24.749454 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.749388 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-trusted-ca\") pod \"image-registry-684ff59cc9-5rfpw\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" Jul 10 03:36:24.749454 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.749403 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/92394405-5015-4182-839f-1e023ad37b24-config\") pod \"service-ca-operator-7695fc6c8c-qbmht\" (UID: \"92394405-5015-4182-839f-1e023ad37b24\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qbmht" Jul 10 03:36:24.749700 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.749533 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/573b4db4-bd46-49b9-9221-54ed2bf71644-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-dd799\" (UID: \"573b4db4-bd46-49b9-9221-54ed2bf71644\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dd799" Jul 10 03:36:24.749700 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.749568 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-image-registry-private-configuration\") pod \"image-registry-684ff59cc9-5rfpw\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" Jul 10 03:36:24.749700 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.749607 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vdxn\" (UniqueName: \"kubernetes.io/projected/573b4db4-bd46-49b9-9221-54ed2bf71644-kube-api-access-7vdxn\") pod \"cluster-monitoring-operator-5f7f494dd4-dd799\" (UID: \"573b4db4-bd46-49b9-9221-54ed2bf71644\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dd799" Jul 10 03:36:24.749700 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.749648 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c477c08-a9cc-4d67-9051-750c3b7a0aab-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-6rhrf\" (UID: \"6c477c08-a9cc-4d67-9051-750c3b7a0aab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6rhrf" Jul 10 03:36:24.749700 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.749675 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/573b4db4-bd46-49b9-9221-54ed2bf71644-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-dd799\" (UID: \"573b4db4-bd46-49b9-9221-54ed2bf71644\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dd799" Jul 10 03:36:24.749978 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:24.749768 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 03:36:24.749978 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:24.749821 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/573b4db4-bd46-49b9-9221-54ed2bf71644-cluster-monitoring-operator-tls podName:573b4db4-bd46-49b9-9221-54ed2bf71644 nodeName:}" failed. No retries permitted until 2026-07-10 03:36:25.249803259 +0000 UTC m=+244.901614896 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/573b4db4-bd46-49b9-9221-54ed2bf71644-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-dd799" (UID: "573b4db4-bd46-49b9-9221-54ed2bf71644") : secret "cluster-monitoring-operator-tls" not found Jul 10 03:36:24.750105 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.750053 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-registry-certificates\") pod \"image-registry-684ff59cc9-5rfpw\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" Jul 10 03:36:24.750105 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.750091 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/92394405-5015-4182-839f-1e023ad37b24-config\") pod \"service-ca-operator-7695fc6c8c-qbmht\" (UID: \"92394405-5015-4182-839f-1e023ad37b24\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qbmht" Jul 10 03:36:24.750334 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:24.750134 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 03:36:24.750334 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:24.750177 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c477c08-a9cc-4d67-9051-750c3b7a0aab-samples-operator-tls podName:6c477c08-a9cc-4d67-9051-750c3b7a0aab nodeName:}" failed. No retries permitted until 2026-07-10 03:36:25.250162314 +0000 UTC m=+244.901973946 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6c477c08-a9cc-4d67-9051-750c3b7a0aab-samples-operator-tls") pod "cluster-samples-operator-65db858894-6rhrf" (UID: "6c477c08-a9cc-4d67-9051-750c3b7a0aab") : secret "samples-operator-tls" not found Jul 10 03:36:24.750334 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.750198 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-bound-sa-token\") pod \"image-registry-684ff59cc9-5rfpw\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" Jul 10 03:36:24.750334 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.750227 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ps2j\" (UniqueName: \"kubernetes.io/projected/92394405-5015-4182-839f-1e023ad37b24-kube-api-access-7ps2j\") pod \"service-ca-operator-7695fc6c8c-qbmht\" (UID: \"92394405-5015-4182-839f-1e023ad37b24\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qbmht" Jul 10 03:36:24.750334 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.750253 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-registry-tls\") pod \"image-registry-684ff59cc9-5rfpw\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" Jul 10 03:36:24.750334 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.750286 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-ca-trust-extracted\") pod \"image-registry-684ff59cc9-5rfpw\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" Jul 10 03:36:24.750334 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.750311 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgz6g\" (UniqueName: \"kubernetes.io/projected/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-kube-api-access-fgz6g\") pod \"image-registry-684ff59cc9-5rfpw\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" Jul 10 03:36:24.750721 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:24.750455 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 03:36:24.750721 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:24.750471 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-684ff59cc9-5rfpw: secret "image-registry-tls" not found Jul 10 03:36:24.750721 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.750472 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-trusted-ca\") pod \"image-registry-684ff59cc9-5rfpw\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" Jul 10 03:36:24.750721 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:24.750521 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-registry-tls podName:ab3a8cad-f220-460b-a75f-dbbe2e6c6128 nodeName:}" failed. No retries permitted until 2026-07-10 03:36:25.25050672 +0000 UTC m=+244.902318347 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-registry-tls") pod "image-registry-684ff59cc9-5rfpw" (UID: "ab3a8cad-f220-460b-a75f-dbbe2e6c6128") : secret "image-registry-tls" not found Jul 10 03:36:24.750721 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.750655 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/573b4db4-bd46-49b9-9221-54ed2bf71644-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-dd799\" (UID: \"573b4db4-bd46-49b9-9221-54ed2bf71644\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dd799" Jul 10 03:36:24.750721 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.750709 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-ca-trust-extracted\") pod \"image-registry-684ff59cc9-5rfpw\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" Jul 10 03:36:24.751652 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.751628 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/92394405-5015-4182-839f-1e023ad37b24-serving-cert\") pod \"service-ca-operator-7695fc6c8c-qbmht\" (UID: \"92394405-5015-4182-839f-1e023ad37b24\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qbmht" Jul 10 03:36:24.752179 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.752160 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-image-registry-private-configuration\") pod \"image-registry-684ff59cc9-5rfpw\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" Jul 10 03:36:24.752232 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.752190 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-installation-pull-secrets\") pod \"image-registry-684ff59cc9-5rfpw\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" Jul 10 03:36:24.758346 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.758317 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ps2j\" (UniqueName: \"kubernetes.io/projected/92394405-5015-4182-839f-1e023ad37b24-kube-api-access-7ps2j\") pod \"service-ca-operator-7695fc6c8c-qbmht\" (UID: \"92394405-5015-4182-839f-1e023ad37b24\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qbmht" Jul 10 03:36:24.758462 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.758353 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vdxn\" (UniqueName: \"kubernetes.io/projected/573b4db4-bd46-49b9-9221-54ed2bf71644-kube-api-access-7vdxn\") pod \"cluster-monitoring-operator-5f7f494dd4-dd799\" (UID: \"573b4db4-bd46-49b9-9221-54ed2bf71644\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dd799" Jul 10 03:36:24.758688 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.758665 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgz6g\" (UniqueName: \"kubernetes.io/projected/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-kube-api-access-fgz6g\") pod \"image-registry-684ff59cc9-5rfpw\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" Jul 10 03:36:24.758880 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.758864 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-bound-sa-token\") pod \"image-registry-684ff59cc9-5rfpw\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" Jul 10 03:36:24.759178 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.759156 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fblm\" (UniqueName: \"kubernetes.io/projected/6c477c08-a9cc-4d67-9051-750c3b7a0aab-kube-api-access-8fblm\") pod \"cluster-samples-operator-65db858894-6rhrf\" (UID: \"6c477c08-a9cc-4d67-9051-750c3b7a0aab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6rhrf" Jul 10 03:36:24.792824 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.792800 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qbmht" Jul 10 03:36:24.909654 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:24.909585 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qbmht"] Jul 10 03:36:24.912563 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:36:24.912539 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92394405_5015_4182_839f_1e023ad37b24.slice/crio-dda9a0a6088ea2eda98a0bf02634782c0b1852ddf245493f9d76ae783b04d1e0 WatchSource:0}: Error finding container dda9a0a6088ea2eda98a0bf02634782c0b1852ddf245493f9d76ae783b04d1e0: Status 404 returned error can't find the container with id dda9a0a6088ea2eda98a0bf02634782c0b1852ddf245493f9d76ae783b04d1e0 Jul 10 03:36:25.155968 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:25.155940 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-metrics-certs\") pod \"router-default-c9b7b4644-bkzc2\" (UID: \"6cf60a11-25ec-41eb-9683-f3fcdae52ea9\") " pod="openshift-ingress/router-default-c9b7b4644-bkzc2" Jul 10 03:36:25.156124 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:25.155988 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-service-ca-bundle\") pod \"router-default-c9b7b4644-bkzc2\" (UID: \"6cf60a11-25ec-41eb-9683-f3fcdae52ea9\") " pod="openshift-ingress/router-default-c9b7b4644-bkzc2" Jul 10 03:36:25.156124 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:25.156079 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 03:36:25.156124 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:25.156103 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-service-ca-bundle podName:6cf60a11-25ec-41eb-9683-f3fcdae52ea9 nodeName:}" failed. No retries permitted until 2026-07-10 03:36:26.156090214 +0000 UTC m=+245.807901840 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-service-ca-bundle") pod "router-default-c9b7b4644-bkzc2" (UID: "6cf60a11-25ec-41eb-9683-f3fcdae52ea9") : configmap references non-existent config key: service-ca.crt Jul 10 03:36:25.156226 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:25.156129 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-metrics-certs podName:6cf60a11-25ec-41eb-9683-f3fcdae52ea9 nodeName:}" failed. No retries permitted until 2026-07-10 03:36:26.156116577 +0000 UTC m=+245.807928203 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-metrics-certs") pod "router-default-c9b7b4644-bkzc2" (UID: "6cf60a11-25ec-41eb-9683-f3fcdae52ea9") : secret "router-metrics-certs-default" not found Jul 10 03:36:25.257025 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:25.257004 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-registry-tls\") pod \"image-registry-684ff59cc9-5rfpw\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" Jul 10 03:36:25.257192 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:25.257084 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c477c08-a9cc-4d67-9051-750c3b7a0aab-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-6rhrf\" (UID: \"6c477c08-a9cc-4d67-9051-750c3b7a0aab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6rhrf" Jul 10 03:36:25.257192 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:25.257104 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/573b4db4-bd46-49b9-9221-54ed2bf71644-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-dd799\" (UID: \"573b4db4-bd46-49b9-9221-54ed2bf71644\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dd799" Jul 10 03:36:25.257192 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:25.257181 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 03:36:25.257353 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:25.257222 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/573b4db4-bd46-49b9-9221-54ed2bf71644-cluster-monitoring-operator-tls podName:573b4db4-bd46-49b9-9221-54ed2bf71644 nodeName:}" failed. No retries permitted until 2026-07-10 03:36:26.257208911 +0000 UTC m=+245.909020537 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/573b4db4-bd46-49b9-9221-54ed2bf71644-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-dd799" (UID: "573b4db4-bd46-49b9-9221-54ed2bf71644") : secret "cluster-monitoring-operator-tls" not found Jul 10 03:36:25.257353 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:25.257225 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 03:36:25.257353 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:25.257179 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 03:36:25.257353 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:25.257276 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-684ff59cc9-5rfpw: secret "image-registry-tls" not found Jul 10 03:36:25.257353 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:25.257287 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c477c08-a9cc-4d67-9051-750c3b7a0aab-samples-operator-tls podName:6c477c08-a9cc-4d67-9051-750c3b7a0aab nodeName:}" failed. No retries permitted until 2026-07-10 03:36:26.257274629 +0000 UTC m=+245.909086256 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6c477c08-a9cc-4d67-9051-750c3b7a0aab-samples-operator-tls") pod "cluster-samples-operator-65db858894-6rhrf" (UID: "6c477c08-a9cc-4d67-9051-750c3b7a0aab") : secret "samples-operator-tls" not found Jul 10 03:36:25.257353 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:25.257325 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-registry-tls podName:ab3a8cad-f220-460b-a75f-dbbe2e6c6128 nodeName:}" failed. No retries permitted until 2026-07-10 03:36:26.25730835 +0000 UTC m=+245.909119981 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-registry-tls") pod "image-registry-684ff59cc9-5rfpw" (UID: "ab3a8cad-f220-460b-a75f-dbbe2e6c6128") : secret "image-registry-tls" not found Jul 10 03:36:25.676856 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:25.676783 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qbmht" event={"ID":"92394405-5015-4182-839f-1e023ad37b24","Type":"ContainerStarted","Data":"dda9a0a6088ea2eda98a0bf02634782c0b1852ddf245493f9d76ae783b04d1e0"} Jul 10 03:36:26.163445 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:26.163409 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-metrics-certs\") pod \"router-default-c9b7b4644-bkzc2\" (UID: \"6cf60a11-25ec-41eb-9683-f3fcdae52ea9\") " pod="openshift-ingress/router-default-c9b7b4644-bkzc2" Jul 10 03:36:26.163625 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:26.163473 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-service-ca-bundle\") pod \"router-default-c9b7b4644-bkzc2\" (UID: \"6cf60a11-25ec-41eb-9683-f3fcdae52ea9\") " pod="openshift-ingress/router-default-c9b7b4644-bkzc2" Jul 10 03:36:26.163625 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:26.163548 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 03:36:26.163625 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:26.163607 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-metrics-certs podName:6cf60a11-25ec-41eb-9683-f3fcdae52ea9 nodeName:}" failed. No retries permitted until 2026-07-10 03:36:28.163592691 +0000 UTC m=+247.815404318 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-metrics-certs") pod "router-default-c9b7b4644-bkzc2" (UID: "6cf60a11-25ec-41eb-9683-f3fcdae52ea9") : secret "router-metrics-certs-default" not found Jul 10 03:36:26.163625 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:26.163621 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-service-ca-bundle podName:6cf60a11-25ec-41eb-9683-f3fcdae52ea9 nodeName:}" failed. No retries permitted until 2026-07-10 03:36:28.163615441 +0000 UTC m=+247.815427068 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-service-ca-bundle") pod "router-default-c9b7b4644-bkzc2" (UID: "6cf60a11-25ec-41eb-9683-f3fcdae52ea9") : configmap references non-existent config key: service-ca.crt Jul 10 03:36:26.264396 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:26.264362 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c477c08-a9cc-4d67-9051-750c3b7a0aab-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-6rhrf\" (UID: \"6c477c08-a9cc-4d67-9051-750c3b7a0aab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6rhrf" Jul 10 03:36:26.264565 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:26.264403 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/573b4db4-bd46-49b9-9221-54ed2bf71644-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-dd799\" (UID: \"573b4db4-bd46-49b9-9221-54ed2bf71644\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dd799" Jul 10 03:36:26.264565 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:26.264433 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-registry-tls\") pod \"image-registry-684ff59cc9-5rfpw\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" Jul 10 03:36:26.264565 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:26.264514 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 03:36:26.264565 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:26.264541 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 03:36:26.264565 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:26.264553 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-684ff59cc9-5rfpw: secret "image-registry-tls" not found Jul 10 03:36:26.264795 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:26.264572 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c477c08-a9cc-4d67-9051-750c3b7a0aab-samples-operator-tls podName:6c477c08-a9cc-4d67-9051-750c3b7a0aab nodeName:}" failed. No retries permitted until 2026-07-10 03:36:28.264557353 +0000 UTC m=+247.916368982 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6c477c08-a9cc-4d67-9051-750c3b7a0aab-samples-operator-tls") pod "cluster-samples-operator-65db858894-6rhrf" (UID: "6c477c08-a9cc-4d67-9051-750c3b7a0aab") : secret "samples-operator-tls" not found Jul 10 03:36:26.264795 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:26.264518 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 03:36:26.264795 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:26.264585 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-registry-tls podName:ab3a8cad-f220-460b-a75f-dbbe2e6c6128 nodeName:}" failed. No retries permitted until 2026-07-10 03:36:28.264579171 +0000 UTC m=+247.916390804 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-registry-tls") pod "image-registry-684ff59cc9-5rfpw" (UID: "ab3a8cad-f220-460b-a75f-dbbe2e6c6128") : secret "image-registry-tls" not found Jul 10 03:36:26.264795 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:26.264602 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/573b4db4-bd46-49b9-9221-54ed2bf71644-cluster-monitoring-operator-tls podName:573b4db4-bd46-49b9-9221-54ed2bf71644 nodeName:}" failed. No retries permitted until 2026-07-10 03:36:28.264591769 +0000 UTC m=+247.916403396 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/573b4db4-bd46-49b9-9221-54ed2bf71644-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-dd799" (UID: "573b4db4-bd46-49b9-9221-54ed2bf71644") : secret "cluster-monitoring-operator-tls" not found Jul 10 03:36:27.683106 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:27.683066 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qbmht" event={"ID":"92394405-5015-4182-839f-1e023ad37b24","Type":"ContainerStarted","Data":"4b5fda5e8c99f5559fb4af9c144cd4c2b12b517e9b8d7cc3058a8418903660b4"} Jul 10 03:36:27.697796 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:27.697747 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qbmht" podStartSLOduration=1.6255134199999999 podStartE2EDuration="3.697730464s" totalImagesPullingTime="2.072217044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:36:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:36:27.696889689 +0000 UTC m=+247.348701341" watchObservedRunningTime="2026-07-10 03:36:27.697730464 +0000 UTC m=+247.349542113" Jul 10 03:36:28.179623 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:28.179585 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-service-ca-bundle\") pod \"router-default-c9b7b4644-bkzc2\" (UID: \"6cf60a11-25ec-41eb-9683-f3fcdae52ea9\") " pod="openshift-ingress/router-default-c9b7b4644-bkzc2" Jul 10 03:36:28.179785 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:28.179714 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-metrics-certs\") pod \"router-default-c9b7b4644-bkzc2\" (UID: \"6cf60a11-25ec-41eb-9683-f3fcdae52ea9\") " pod="openshift-ingress/router-default-c9b7b4644-bkzc2" Jul 10 03:36:28.179785 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:28.179737 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-service-ca-bundle podName:6cf60a11-25ec-41eb-9683-f3fcdae52ea9 nodeName:}" failed. No retries permitted until 2026-07-10 03:36:32.17971917 +0000 UTC m=+251.831530798 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-service-ca-bundle") pod "router-default-c9b7b4644-bkzc2" (UID: "6cf60a11-25ec-41eb-9683-f3fcdae52ea9") : configmap references non-existent config key: service-ca.crt Jul 10 03:36:28.179869 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:28.179799 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 03:36:28.179869 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:28.179853 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-metrics-certs podName:6cf60a11-25ec-41eb-9683-f3fcdae52ea9 nodeName:}" failed. No retries permitted until 2026-07-10 03:36:32.179838949 +0000 UTC m=+251.831650579 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-metrics-certs") pod "router-default-c9b7b4644-bkzc2" (UID: "6cf60a11-25ec-41eb-9683-f3fcdae52ea9") : secret "router-metrics-certs-default" not found Jul 10 03:36:28.281022 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:28.280686 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c477c08-a9cc-4d67-9051-750c3b7a0aab-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-6rhrf\" (UID: \"6c477c08-a9cc-4d67-9051-750c3b7a0aab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6rhrf" Jul 10 03:36:28.281022 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:28.280736 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/573b4db4-bd46-49b9-9221-54ed2bf71644-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-dd799\" (UID: \"573b4db4-bd46-49b9-9221-54ed2bf71644\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dd799" Jul 10 03:36:28.281022 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:28.280783 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-registry-tls\") pod \"image-registry-684ff59cc9-5rfpw\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" Jul 10 03:36:28.281022 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:28.280966 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 03:36:28.281022 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:28.280980 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-684ff59cc9-5rfpw: secret "image-registry-tls" not found Jul 10 03:36:28.281022 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:28.281029 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-registry-tls podName:ab3a8cad-f220-460b-a75f-dbbe2e6c6128 nodeName:}" failed. No retries permitted until 2026-07-10 03:36:32.281012089 +0000 UTC m=+251.932823731 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-registry-tls") pod "image-registry-684ff59cc9-5rfpw" (UID: "ab3a8cad-f220-460b-a75f-dbbe2e6c6128") : secret "image-registry-tls" not found Jul 10 03:36:28.281422 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:28.281118 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 03:36:28.281422 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:28.281184 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/573b4db4-bd46-49b9-9221-54ed2bf71644-cluster-monitoring-operator-tls podName:573b4db4-bd46-49b9-9221-54ed2bf71644 nodeName:}" failed. No retries permitted until 2026-07-10 03:36:32.281165234 +0000 UTC m=+251.932976876 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/573b4db4-bd46-49b9-9221-54ed2bf71644-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-dd799" (UID: "573b4db4-bd46-49b9-9221-54ed2bf71644") : secret "cluster-monitoring-operator-tls" not found Jul 10 03:36:28.281422 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:28.281118 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 03:36:28.281422 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:28.281232 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c477c08-a9cc-4d67-9051-750c3b7a0aab-samples-operator-tls podName:6c477c08-a9cc-4d67-9051-750c3b7a0aab nodeName:}" failed. No retries permitted until 2026-07-10 03:36:32.281221981 +0000 UTC m=+251.933033613 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6c477c08-a9cc-4d67-9051-750c3b7a0aab-samples-operator-tls") pod "cluster-samples-operator-65db858894-6rhrf" (UID: "6c477c08-a9cc-4d67-9051-750c3b7a0aab") : secret "samples-operator-tls" not found Jul 10 03:36:29.299462 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:29.299434 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zzvjv"] Jul 10 03:36:29.301535 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:29.301519 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zzvjv" Jul 10 03:36:29.303524 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:29.303502 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 10 03:36:29.303725 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:29.303706 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 10 03:36:29.303793 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:29.303775 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 10 03:36:29.304511 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:29.304496 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 10 03:36:29.304592 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:29.304556 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lwzwp\"" Jul 10 03:36:29.314227 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:29.314195 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zzvjv"] Jul 10 03:36:29.390151 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:29.390123 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gdph\" (UniqueName: \"kubernetes.io/projected/aff0e551-f1c9-47e8-869d-36f28cebb925-kube-api-access-9gdph\") pod \"insights-runtime-extractor-zzvjv\" (UID: \"aff0e551-f1c9-47e8-869d-36f28cebb925\") " pod="openshift-insights/insights-runtime-extractor-zzvjv" Jul 10 03:36:29.390298 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:29.390157 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aff0e551-f1c9-47e8-869d-36f28cebb925-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zzvjv\" (UID: \"aff0e551-f1c9-47e8-869d-36f28cebb925\") " pod="openshift-insights/insights-runtime-extractor-zzvjv" Jul 10 03:36:29.390298 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:29.390174 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aff0e551-f1c9-47e8-869d-36f28cebb925-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zzvjv\" (UID: \"aff0e551-f1c9-47e8-869d-36f28cebb925\") " pod="openshift-insights/insights-runtime-extractor-zzvjv" Jul 10 03:36:29.390413 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:29.390328 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aff0e551-f1c9-47e8-869d-36f28cebb925-crio-socket\") pod \"insights-runtime-extractor-zzvjv\" (UID: \"aff0e551-f1c9-47e8-869d-36f28cebb925\") " pod="openshift-insights/insights-runtime-extractor-zzvjv" Jul 10 03:36:29.390413 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:29.390361 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aff0e551-f1c9-47e8-869d-36f28cebb925-data-volume\") pod \"insights-runtime-extractor-zzvjv\" (UID: \"aff0e551-f1c9-47e8-869d-36f28cebb925\") " pod="openshift-insights/insights-runtime-extractor-zzvjv" Jul 10 03:36:29.491447 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:29.491421 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gdph\" (UniqueName: \"kubernetes.io/projected/aff0e551-f1c9-47e8-869d-36f28cebb925-kube-api-access-9gdph\") pod \"insights-runtime-extractor-zzvjv\" (UID: \"aff0e551-f1c9-47e8-869d-36f28cebb925\") " pod="openshift-insights/insights-runtime-extractor-zzvjv" Jul 10 03:36:29.491447 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:29.491451 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aff0e551-f1c9-47e8-869d-36f28cebb925-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zzvjv\" (UID: \"aff0e551-f1c9-47e8-869d-36f28cebb925\") " pod="openshift-insights/insights-runtime-extractor-zzvjv" Jul 10 03:36:29.491630 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:29.491470 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aff0e551-f1c9-47e8-869d-36f28cebb925-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zzvjv\" (UID: \"aff0e551-f1c9-47e8-869d-36f28cebb925\") " pod="openshift-insights/insights-runtime-extractor-zzvjv" Jul 10 03:36:29.491630 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:29.491539 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aff0e551-f1c9-47e8-869d-36f28cebb925-crio-socket\") pod \"insights-runtime-extractor-zzvjv\" (UID: \"aff0e551-f1c9-47e8-869d-36f28cebb925\") " pod="openshift-insights/insights-runtime-extractor-zzvjv" Jul 10 03:36:29.491630 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:29.491549 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 03:36:29.491630 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:29.491611 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aff0e551-f1c9-47e8-869d-36f28cebb925-kube-rbac-proxy-cm podName:aff0e551-f1c9-47e8-869d-36f28cebb925 nodeName:}" failed. No retries permitted until 2026-07-10 03:36:29.991591408 +0000 UTC m=+249.643403038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aff0e551-f1c9-47e8-869d-36f28cebb925-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zzvjv" (UID: "aff0e551-f1c9-47e8-869d-36f28cebb925") : configmap "kube-rbac-proxy" not found Jul 10 03:36:29.491630 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:29.491554 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aff0e551-f1c9-47e8-869d-36f28cebb925-data-volume\") pod \"insights-runtime-extractor-zzvjv\" (UID: \"aff0e551-f1c9-47e8-869d-36f28cebb925\") " pod="openshift-insights/insights-runtime-extractor-zzvjv" Jul 10 03:36:29.491879 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:29.491643 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 03:36:29.491879 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:29.491650 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/aff0e551-f1c9-47e8-869d-36f28cebb925-crio-socket\") pod \"insights-runtime-extractor-zzvjv\" (UID: \"aff0e551-f1c9-47e8-869d-36f28cebb925\") " pod="openshift-insights/insights-runtime-extractor-zzvjv" Jul 10 03:36:29.491879 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:29.491693 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aff0e551-f1c9-47e8-869d-36f28cebb925-insights-runtime-extractor-tls podName:aff0e551-f1c9-47e8-869d-36f28cebb925 nodeName:}" failed. No retries permitted until 2026-07-10 03:36:29.991677056 +0000 UTC m=+249.643488686 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aff0e551-f1c9-47e8-869d-36f28cebb925-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zzvjv" (UID: "aff0e551-f1c9-47e8-869d-36f28cebb925") : secret "insights-runtime-extractor-tls" not found Jul 10 03:36:29.491879 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:29.491825 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/aff0e551-f1c9-47e8-869d-36f28cebb925-data-volume\") pod \"insights-runtime-extractor-zzvjv\" (UID: \"aff0e551-f1c9-47e8-869d-36f28cebb925\") " pod="openshift-insights/insights-runtime-extractor-zzvjv" Jul 10 03:36:29.500457 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:29.500424 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gdph\" (UniqueName: \"kubernetes.io/projected/aff0e551-f1c9-47e8-869d-36f28cebb925-kube-api-access-9gdph\") pod \"insights-runtime-extractor-zzvjv\" (UID: \"aff0e551-f1c9-47e8-869d-36f28cebb925\") " pod="openshift-insights/insights-runtime-extractor-zzvjv" Jul 10 03:36:29.995904 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:29.995869 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aff0e551-f1c9-47e8-869d-36f28cebb925-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zzvjv\" (UID: \"aff0e551-f1c9-47e8-869d-36f28cebb925\") " pod="openshift-insights/insights-runtime-extractor-zzvjv" Jul 10 03:36:29.995904 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:29.995921 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aff0e551-f1c9-47e8-869d-36f28cebb925-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zzvjv\" (UID: \"aff0e551-f1c9-47e8-869d-36f28cebb925\") " pod="openshift-insights/insights-runtime-extractor-zzvjv" Jul 10 03:36:29.996243 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:29.995973 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 03:36:29.996243 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:29.996031 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aff0e551-f1c9-47e8-869d-36f28cebb925-kube-rbac-proxy-cm podName:aff0e551-f1c9-47e8-869d-36f28cebb925 nodeName:}" failed. No retries permitted until 2026-07-10 03:36:30.996016357 +0000 UTC m=+250.647827983 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aff0e551-f1c9-47e8-869d-36f28cebb925-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zzvjv" (UID: "aff0e551-f1c9-47e8-869d-36f28cebb925") : configmap "kube-rbac-proxy" not found Jul 10 03:36:29.996243 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:29.996084 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 03:36:29.996243 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:29.996149 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aff0e551-f1c9-47e8-869d-36f28cebb925-insights-runtime-extractor-tls podName:aff0e551-f1c9-47e8-869d-36f28cebb925 nodeName:}" failed. No retries permitted until 2026-07-10 03:36:30.996131017 +0000 UTC m=+250.647942655 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aff0e551-f1c9-47e8-869d-36f28cebb925-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zzvjv" (UID: "aff0e551-f1c9-47e8-869d-36f28cebb925") : secret "insights-runtime-extractor-tls" not found Jul 10 03:36:31.002878 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:31.002832 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aff0e551-f1c9-47e8-869d-36f28cebb925-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zzvjv\" (UID: \"aff0e551-f1c9-47e8-869d-36f28cebb925\") " pod="openshift-insights/insights-runtime-extractor-zzvjv" Jul 10 03:36:31.002878 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:31.002883 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aff0e551-f1c9-47e8-869d-36f28cebb925-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zzvjv\" (UID: \"aff0e551-f1c9-47e8-869d-36f28cebb925\") " pod="openshift-insights/insights-runtime-extractor-zzvjv" Jul 10 03:36:31.003378 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:31.002975 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 03:36:31.003378 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:31.002982 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 03:36:31.003378 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:31.003051 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aff0e551-f1c9-47e8-869d-36f28cebb925-kube-rbac-proxy-cm podName:aff0e551-f1c9-47e8-869d-36f28cebb925 nodeName:}" failed. No retries permitted until 2026-07-10 03:36:33.003028268 +0000 UTC m=+252.654839896 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aff0e551-f1c9-47e8-869d-36f28cebb925-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zzvjv" (UID: "aff0e551-f1c9-47e8-869d-36f28cebb925") : configmap "kube-rbac-proxy" not found Jul 10 03:36:31.003378 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:31.003074 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aff0e551-f1c9-47e8-869d-36f28cebb925-insights-runtime-extractor-tls podName:aff0e551-f1c9-47e8-869d-36f28cebb925 nodeName:}" failed. No retries permitted until 2026-07-10 03:36:33.003065308 +0000 UTC m=+252.654876943 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aff0e551-f1c9-47e8-869d-36f28cebb925-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zzvjv" (UID: "aff0e551-f1c9-47e8-869d-36f28cebb925") : secret "insights-runtime-extractor-tls" not found Jul 10 03:36:32.215108 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:32.215078 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-metrics-certs\") pod \"router-default-c9b7b4644-bkzc2\" (UID: \"6cf60a11-25ec-41eb-9683-f3fcdae52ea9\") " pod="openshift-ingress/router-default-c9b7b4644-bkzc2" Jul 10 03:36:32.215499 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:32.215128 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-service-ca-bundle\") pod \"router-default-c9b7b4644-bkzc2\" (UID: \"6cf60a11-25ec-41eb-9683-f3fcdae52ea9\") " pod="openshift-ingress/router-default-c9b7b4644-bkzc2" Jul 10 03:36:32.215499 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:32.215233 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-service-ca-bundle podName:6cf60a11-25ec-41eb-9683-f3fcdae52ea9 nodeName:}" failed. No retries permitted until 2026-07-10 03:36:40.215220398 +0000 UTC m=+259.867032026 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-service-ca-bundle") pod "router-default-c9b7b4644-bkzc2" (UID: "6cf60a11-25ec-41eb-9683-f3fcdae52ea9") : configmap references non-existent config key: service-ca.crt Jul 10 03:36:32.215499 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:32.215234 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 10 03:36:32.215499 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:32.215300 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-metrics-certs podName:6cf60a11-25ec-41eb-9683-f3fcdae52ea9 nodeName:}" failed. No retries permitted until 2026-07-10 03:36:40.21528504 +0000 UTC m=+259.867096667 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-metrics-certs") pod "router-default-c9b7b4644-bkzc2" (UID: "6cf60a11-25ec-41eb-9683-f3fcdae52ea9") : secret "router-metrics-certs-default" not found Jul 10 03:36:32.279345 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:32.279321 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n7lff_4a14a14c-8129-478b-a6b4-4e0f933ae323/dns-node-resolver/0.log" Jul 10 03:36:32.316125 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:32.316098 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c477c08-a9cc-4d67-9051-750c3b7a0aab-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-6rhrf\" (UID: \"6c477c08-a9cc-4d67-9051-750c3b7a0aab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6rhrf" Jul 10 03:36:32.316232 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:32.316129 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/573b4db4-bd46-49b9-9221-54ed2bf71644-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-dd799\" (UID: \"573b4db4-bd46-49b9-9221-54ed2bf71644\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dd799" Jul 10 03:36:32.316232 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:32.316165 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-registry-tls\") pod \"image-registry-684ff59cc9-5rfpw\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" Jul 10 03:36:32.316326 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:32.316260 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 10 03:36:32.316326 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:32.316281 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 03:36:32.316326 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:32.316306 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 10 03:36:32.316326 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:32.316319 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-684ff59cc9-5rfpw: secret "image-registry-tls" not found Jul 10 03:36:32.316440 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:32.316320 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c477c08-a9cc-4d67-9051-750c3b7a0aab-samples-operator-tls podName:6c477c08-a9cc-4d67-9051-750c3b7a0aab nodeName:}" failed. No retries permitted until 2026-07-10 03:36:40.31630719 +0000 UTC m=+259.968118817 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6c477c08-a9cc-4d67-9051-750c3b7a0aab-samples-operator-tls") pod "cluster-samples-operator-65db858894-6rhrf" (UID: "6c477c08-a9cc-4d67-9051-750c3b7a0aab") : secret "samples-operator-tls" not found Jul 10 03:36:32.316440 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:32.316357 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/573b4db4-bd46-49b9-9221-54ed2bf71644-cluster-monitoring-operator-tls podName:573b4db4-bd46-49b9-9221-54ed2bf71644 nodeName:}" failed. No retries permitted until 2026-07-10 03:36:40.316345967 +0000 UTC m=+259.968157597 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/573b4db4-bd46-49b9-9221-54ed2bf71644-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-dd799" (UID: "573b4db4-bd46-49b9-9221-54ed2bf71644") : secret "cluster-monitoring-operator-tls" not found Jul 10 03:36:32.316440 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:32.316368 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-registry-tls podName:ab3a8cad-f220-460b-a75f-dbbe2e6c6128 nodeName:}" failed. No retries permitted until 2026-07-10 03:36:40.316361929 +0000 UTC m=+259.968173556 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-registry-tls") pod "image-registry-684ff59cc9-5rfpw" (UID: "ab3a8cad-f220-460b-a75f-dbbe2e6c6128") : secret "image-registry-tls" not found Jul 10 03:36:32.719879 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:32.719843 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-metrics-certs\") pod \"network-metrics-daemon-ddntq\" (UID: \"b78bc3c1-3658-4cdd-ba93-30d686b78aa5\") " pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:36:32.720058 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:32.719994 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 10 03:36:32.720099 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:32.720060 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-metrics-certs podName:b78bc3c1-3658-4cdd-ba93-30d686b78aa5 nodeName:}" failed. No retries permitted until 2026-07-10 03:38:34.720043932 +0000 UTC m=+374.371855559 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-metrics-certs") pod "network-metrics-daemon-ddntq" (UID: "b78bc3c1-3658-4cdd-ba93-30d686b78aa5") : secret "metrics-daemon-secret" not found Jul 10 03:36:33.022560 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:33.022532 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aff0e551-f1c9-47e8-869d-36f28cebb925-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zzvjv\" (UID: \"aff0e551-f1c9-47e8-869d-36f28cebb925\") " pod="openshift-insights/insights-runtime-extractor-zzvjv" Jul 10 03:36:33.022705 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:33.022567 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aff0e551-f1c9-47e8-869d-36f28cebb925-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zzvjv\" (UID: \"aff0e551-f1c9-47e8-869d-36f28cebb925\") " pod="openshift-insights/insights-runtime-extractor-zzvjv" Jul 10 03:36:33.022705 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:33.022649 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 03:36:33.022705 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:33.022663 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 03:36:33.022799 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:33.022706 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aff0e551-f1c9-47e8-869d-36f28cebb925-kube-rbac-proxy-cm podName:aff0e551-f1c9-47e8-869d-36f28cebb925 nodeName:}" failed. No retries permitted until 2026-07-10 03:36:37.022692354 +0000 UTC m=+256.674503981 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aff0e551-f1c9-47e8-869d-36f28cebb925-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zzvjv" (UID: "aff0e551-f1c9-47e8-869d-36f28cebb925") : configmap "kube-rbac-proxy" not found Jul 10 03:36:33.022799 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:33.022719 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aff0e551-f1c9-47e8-869d-36f28cebb925-insights-runtime-extractor-tls podName:aff0e551-f1c9-47e8-869d-36f28cebb925 nodeName:}" failed. No retries permitted until 2026-07-10 03:36:37.022713371 +0000 UTC m=+256.674524997 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aff0e551-f1c9-47e8-869d-36f28cebb925-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zzvjv" (UID: "aff0e551-f1c9-47e8-869d-36f28cebb925") : secret "insights-runtime-extractor-tls" not found Jul 10 03:36:33.079248 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:33.079222 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7glzx_27c224f5-8cb1-4c4a-b9bf-27eaf5cf4dec/node-ca/0.log" Jul 10 03:36:34.080135 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:34.080105 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-njp2r_d4e07574-8e12-4c22-9f6c-49c0bc88cd5f/serve-healthcheck-canary/0.log" Jul 10 03:36:37.057480 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:37.057431 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aff0e551-f1c9-47e8-869d-36f28cebb925-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zzvjv\" (UID: \"aff0e551-f1c9-47e8-869d-36f28cebb925\") " pod="openshift-insights/insights-runtime-extractor-zzvjv" Jul 10 03:36:37.057480 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:37.057480 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aff0e551-f1c9-47e8-869d-36f28cebb925-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zzvjv\" (UID: \"aff0e551-f1c9-47e8-869d-36f28cebb925\") " pod="openshift-insights/insights-runtime-extractor-zzvjv" Jul 10 03:36:37.057975 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:37.057557 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 10 03:36:37.057975 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:37.057564 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 10 03:36:37.057975 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:37.057628 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/aff0e551-f1c9-47e8-869d-36f28cebb925-kube-rbac-proxy-cm podName:aff0e551-f1c9-47e8-869d-36f28cebb925 nodeName:}" failed. No retries permitted until 2026-07-10 03:36:45.057608839 +0000 UTC m=+264.709420486 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/aff0e551-f1c9-47e8-869d-36f28cebb925-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zzvjv" (UID: "aff0e551-f1c9-47e8-869d-36f28cebb925") : configmap "kube-rbac-proxy" not found Jul 10 03:36:37.057975 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:37.057669 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aff0e551-f1c9-47e8-869d-36f28cebb925-insights-runtime-extractor-tls podName:aff0e551-f1c9-47e8-869d-36f28cebb925 nodeName:}" failed. No retries permitted until 2026-07-10 03:36:45.057649292 +0000 UTC m=+264.709460933 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/aff0e551-f1c9-47e8-869d-36f28cebb925-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zzvjv" (UID: "aff0e551-f1c9-47e8-869d-36f28cebb925") : secret "insights-runtime-extractor-tls" not found Jul 10 03:36:40.284557 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:40.284522 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-metrics-certs\") pod \"router-default-c9b7b4644-bkzc2\" (UID: \"6cf60a11-25ec-41eb-9683-f3fcdae52ea9\") " pod="openshift-ingress/router-default-c9b7b4644-bkzc2" Jul 10 03:36:40.284966 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:40.284578 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-service-ca-bundle\") pod \"router-default-c9b7b4644-bkzc2\" (UID: \"6cf60a11-25ec-41eb-9683-f3fcdae52ea9\") " pod="openshift-ingress/router-default-c9b7b4644-bkzc2" Jul 10 03:36:40.285191 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:40.285173 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-service-ca-bundle\") pod \"router-default-c9b7b4644-bkzc2\" (UID: \"6cf60a11-25ec-41eb-9683-f3fcdae52ea9\") " pod="openshift-ingress/router-default-c9b7b4644-bkzc2" Jul 10 03:36:40.286799 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:40.286772 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6cf60a11-25ec-41eb-9683-f3fcdae52ea9-metrics-certs\") pod \"router-default-c9b7b4644-bkzc2\" (UID: \"6cf60a11-25ec-41eb-9683-f3fcdae52ea9\") " pod="openshift-ingress/router-default-c9b7b4644-bkzc2" Jul 10 03:36:40.302692 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:40.302664 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-c9b7b4644-bkzc2" Jul 10 03:36:40.385443 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:40.385413 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/573b4db4-bd46-49b9-9221-54ed2bf71644-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-dd799\" (UID: \"573b4db4-bd46-49b9-9221-54ed2bf71644\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dd799" Jul 10 03:36:40.385576 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:40.385469 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-registry-tls\") pod \"image-registry-684ff59cc9-5rfpw\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" Jul 10 03:36:40.385633 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:40.385586 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 10 03:36:40.385633 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:40.385600 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c477c08-a9cc-4d67-9051-750c3b7a0aab-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-6rhrf\" (UID: \"6c477c08-a9cc-4d67-9051-750c3b7a0aab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6rhrf" Jul 10 03:36:40.385734 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:40.385663 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/573b4db4-bd46-49b9-9221-54ed2bf71644-cluster-monitoring-operator-tls podName:573b4db4-bd46-49b9-9221-54ed2bf71644 nodeName:}" failed. No retries permitted until 2026-07-10 03:36:56.385640948 +0000 UTC m=+276.037452575 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/573b4db4-bd46-49b9-9221-54ed2bf71644-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-dd799" (UID: "573b4db4-bd46-49b9-9221-54ed2bf71644") : secret "cluster-monitoring-operator-tls" not found Jul 10 03:36:40.387892 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:40.387869 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-registry-tls\") pod \"image-registry-684ff59cc9-5rfpw\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" Jul 10 03:36:40.388003 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:40.387973 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6c477c08-a9cc-4d67-9051-750c3b7a0aab-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-6rhrf\" (UID: \"6c477c08-a9cc-4d67-9051-750c3b7a0aab\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6rhrf" Jul 10 03:36:40.409447 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:40.409425 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" Jul 10 03:36:40.413641 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:40.413628 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6rhrf" Jul 10 03:36:40.424442 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:40.424417 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-c9b7b4644-bkzc2"] Jul 10 03:36:40.428449 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:36:40.428427 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cf60a11_25ec_41eb_9683_f3fcdae52ea9.slice/crio-de84d78b3c698f6bedf127ce63775c239a1930c24bef70e9f93ba8c3d261019f WatchSource:0}: Error finding container de84d78b3c698f6bedf127ce63775c239a1930c24bef70e9f93ba8c3d261019f: Status 404 returned error can't find the container with id de84d78b3c698f6bedf127ce63775c239a1930c24bef70e9f93ba8c3d261019f Jul 10 03:36:40.548879 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:40.548811 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6rhrf"] Jul 10 03:36:40.561544 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:40.561516 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-684ff59cc9-5rfpw"] Jul 10 03:36:40.565116 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:36:40.565088 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab3a8cad_f220_460b_a75f_dbbe2e6c6128.slice/crio-c6770fe0de12dc635ae714db22b62589ee489d7214d60719c14e192cb2b27211 WatchSource:0}: Error finding container c6770fe0de12dc635ae714db22b62589ee489d7214d60719c14e192cb2b27211: Status 404 returned error can't find the container with id c6770fe0de12dc635ae714db22b62589ee489d7214d60719c14e192cb2b27211 Jul 10 03:36:40.720726 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:40.720689 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-c9b7b4644-bkzc2" event={"ID":"6cf60a11-25ec-41eb-9683-f3fcdae52ea9","Type":"ContainerStarted","Data":"9e212939082d200ce53238becc12cce399285b215d007bfdacfaa2bff03d8dd5"} Jul 10 03:36:40.720902 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:40.720744 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-c9b7b4644-bkzc2" event={"ID":"6cf60a11-25ec-41eb-9683-f3fcdae52ea9","Type":"ContainerStarted","Data":"de84d78b3c698f6bedf127ce63775c239a1930c24bef70e9f93ba8c3d261019f"} Jul 10 03:36:40.721888 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:40.721858 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6rhrf" event={"ID":"6c477c08-a9cc-4d67-9051-750c3b7a0aab","Type":"ContainerStarted","Data":"2270035ab30d06ff37da35b346e106ce98b111882309a7aa4e76bdb2a68e2b32"} Jul 10 03:36:40.723269 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:40.723244 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" event={"ID":"ab3a8cad-f220-460b-a75f-dbbe2e6c6128","Type":"ContainerStarted","Data":"689e8a9ce185d79029adbc366cb31eba32197f2ce3df81116d37e11205c5a2c8"} Jul 10 03:36:40.723394 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:40.723280 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" event={"ID":"ab3a8cad-f220-460b-a75f-dbbe2e6c6128","Type":"ContainerStarted","Data":"c6770fe0de12dc635ae714db22b62589ee489d7214d60719c14e192cb2b27211"} Jul 10 03:36:40.723394 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:40.723384 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" Jul 10 03:36:40.737848 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:40.737812 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-c9b7b4644-bkzc2" podStartSLOduration=16.737797857 podStartE2EDuration="16.737797857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:36:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:36:40.736304197 +0000 UTC m=+260.388115846" watchObservedRunningTime="2026-07-10 03:36:40.737797857 +0000 UTC m=+260.389609505" Jul 10 03:36:40.753442 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:40.753399 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" podStartSLOduration=16.753381421 podStartE2EDuration="16.753381421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:36:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:36:40.753089572 +0000 UTC m=+260.404901223" watchObservedRunningTime="2026-07-10 03:36:40.753381421 +0000 UTC m=+260.405193071" Jul 10 03:36:41.302832 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:41.302802 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-c9b7b4644-bkzc2" Jul 10 03:36:41.305779 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:41.305755 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-c9b7b4644-bkzc2" Jul 10 03:36:41.726499 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:41.726419 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-c9b7b4644-bkzc2" Jul 10 03:36:41.727902 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:41.727877 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-c9b7b4644-bkzc2" Jul 10 03:36:42.730592 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:42.730559 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6rhrf" event={"ID":"6c477c08-a9cc-4d67-9051-750c3b7a0aab","Type":"ContainerStarted","Data":"32066654fa893dfb8545b1ab1d93865788c6ed42dbbff1027239e6849e9ad499"} Jul 10 03:36:42.731005 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:42.730628 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6rhrf" event={"ID":"6c477c08-a9cc-4d67-9051-750c3b7a0aab","Type":"ContainerStarted","Data":"ffbc7f34612d5c4887d2d18a1abc2abf662dd41e1e10bdd8aa04d8c1ba612770"} Jul 10 03:36:42.747921 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:42.747857 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-6rhrf" podStartSLOduration=17.255922449 podStartE2EDuration="18.74784209s" totalImagesPullingTime="1.491919641s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:36:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:36:42.746157588 +0000 UTC m=+262.397969237" watchObservedRunningTime="2026-07-10 03:36:42.74784209 +0000 UTC m=+262.399653739" Jul 10 03:36:45.122361 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:45.122281 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aff0e551-f1c9-47e8-869d-36f28cebb925-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zzvjv\" (UID: \"aff0e551-f1c9-47e8-869d-36f28cebb925\") " pod="openshift-insights/insights-runtime-extractor-zzvjv" Jul 10 03:36:45.122361 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:45.122314 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aff0e551-f1c9-47e8-869d-36f28cebb925-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zzvjv\" (UID: \"aff0e551-f1c9-47e8-869d-36f28cebb925\") " pod="openshift-insights/insights-runtime-extractor-zzvjv" Jul 10 03:36:45.122778 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:45.122758 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/aff0e551-f1c9-47e8-869d-36f28cebb925-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zzvjv\" (UID: \"aff0e551-f1c9-47e8-869d-36f28cebb925\") " pod="openshift-insights/insights-runtime-extractor-zzvjv" Jul 10 03:36:45.124488 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:45.124466 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/aff0e551-f1c9-47e8-869d-36f28cebb925-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zzvjv\" (UID: \"aff0e551-f1c9-47e8-869d-36f28cebb925\") " pod="openshift-insights/insights-runtime-extractor-zzvjv" Jul 10 03:36:45.210006 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:45.209970 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zzvjv" Jul 10 03:36:45.329453 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:45.329425 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zzvjv"] Jul 10 03:36:45.332203 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:36:45.332179 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaff0e551_f1c9_47e8_869d_36f28cebb925.slice/crio-ff44ac3fdc991f29025d7c0173e2f5e4b722e15974bc79b01d730c00810d1fe4 WatchSource:0}: Error finding container ff44ac3fdc991f29025d7c0173e2f5e4b722e15974bc79b01d730c00810d1fe4: Status 404 returned error can't find the container with id ff44ac3fdc991f29025d7c0173e2f5e4b722e15974bc79b01d730c00810d1fe4 Jul 10 03:36:45.742504 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:45.742440 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zzvjv" event={"ID":"aff0e551-f1c9-47e8-869d-36f28cebb925","Type":"ContainerStarted","Data":"ff44ac3fdc991f29025d7c0173e2f5e4b722e15974bc79b01d730c00810d1fe4"} Jul 10 03:36:49.762652 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:49.762620 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zzvjv" event={"ID":"aff0e551-f1c9-47e8-869d-36f28cebb925","Type":"ContainerStarted","Data":"5514dc9fb394301c85864317ae751d0c373e037b83b4c89c88549080de320203"} Jul 10 03:36:49.763027 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:49.762685 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zzvjv" event={"ID":"aff0e551-f1c9-47e8-869d-36f28cebb925","Type":"ContainerStarted","Data":"6375e77f47190d041baf1601ec0a08caac37b716eb508d640a7eaa0663502c32"} Jul 10 03:36:50.419860 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:50.419827 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-684ff59cc9-5rfpw"] Jul 10 03:36:52.774298 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:52.774263 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zzvjv" event={"ID":"aff0e551-f1c9-47e8-869d-36f28cebb925","Type":"ContainerStarted","Data":"81e81140834356f900685db4bab2bea4282cca26dee8ccf360d146ff5a8e7fbc"} Jul 10 03:36:52.790600 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:52.790557 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zzvjv" podStartSLOduration=17.358082258 podStartE2EDuration="23.790542047s" totalImagesPullingTime="6.432459789s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 03:36:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:36:52.789824279 +0000 UTC m=+272.441635940" watchObservedRunningTime="2026-07-10 03:36:52.790542047 +0000 UTC m=+272.442353695" Jul 10 03:36:56.410238 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:56.410202 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/573b4db4-bd46-49b9-9221-54ed2bf71644-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-dd799\" (UID: \"573b4db4-bd46-49b9-9221-54ed2bf71644\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dd799" Jul 10 03:36:56.412517 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:56.412497 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/573b4db4-bd46-49b9-9221-54ed2bf71644-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-dd799\" (UID: \"573b4db4-bd46-49b9-9221-54ed2bf71644\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dd799" Jul 10 03:36:56.602698 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:56.602658 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dd799" Jul 10 03:36:56.718265 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:56.718240 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dd799"] Jul 10 03:36:56.720377 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:36:56.720353 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod573b4db4_bd46_49b9_9221_54ed2bf71644.slice/crio-12485400d954b02375adde83bff6c69be185fbc181947e56444cda65857f2f78 WatchSource:0}: Error finding container 12485400d954b02375adde83bff6c69be185fbc181947e56444cda65857f2f78: Status 404 returned error can't find the container with id 12485400d954b02375adde83bff6c69be185fbc181947e56444cda65857f2f78 Jul 10 03:36:56.787368 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:56.787334 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dd799" event={"ID":"573b4db4-bd46-49b9-9221-54ed2bf71644","Type":"ContainerStarted","Data":"12485400d954b02375adde83bff6c69be185fbc181947e56444cda65857f2f78"} Jul 10 03:36:58.795014 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:58.794976 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4922m"] Jul 10 03:36:58.798139 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:58.798108 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dd799" event={"ID":"573b4db4-bd46-49b9-9221-54ed2bf71644","Type":"ContainerStarted","Data":"324e376067920976bac1f13b7a9a0bbe23a428e7af49b2152e07ae5f7c94394e"} Jul 10 03:36:58.798292 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:58.798187 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4922m" Jul 10 03:36:58.800036 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:58.800017 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-xx7c6\"" Jul 10 03:36:58.800122 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:58.800055 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 10 03:36:58.806134 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:58.806114 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4922m"] Jul 10 03:36:58.814164 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:58.814116 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-dd799" podStartSLOduration=33.216309906 podStartE2EDuration="34.814099822s" totalImagesPullingTime="1.597789916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:36:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:36:58.813180406 +0000 UTC m=+278.464992058" watchObservedRunningTime="2026-07-10 03:36:58.814099822 +0000 UTC m=+278.465911472" Jul 10 03:36:58.930233 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:58.930204 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a46e4490-589d-47d0-ab53-3547ddbc3b76-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-4922m\" (UID: \"a46e4490-589d-47d0-ab53-3547ddbc3b76\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4922m" Jul 10 03:36:59.031506 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:59.031474 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a46e4490-589d-47d0-ab53-3547ddbc3b76-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-4922m\" (UID: \"a46e4490-589d-47d0-ab53-3547ddbc3b76\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4922m" Jul 10 03:36:59.031650 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:59.031572 2582 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 10 03:36:59.031650 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:36:59.031629 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a46e4490-589d-47d0-ab53-3547ddbc3b76-tls-certificates podName:a46e4490-589d-47d0-ab53-3547ddbc3b76 nodeName:}" failed. No retries permitted until 2026-07-10 03:36:59.531615372 +0000 UTC m=+279.183426999 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/a46e4490-589d-47d0-ab53-3547ddbc3b76-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-4922m" (UID: "a46e4490-589d-47d0-ab53-3547ddbc3b76") : secret "prometheus-operator-admission-webhook-tls" not found Jul 10 03:36:59.535742 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:59.535709 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a46e4490-589d-47d0-ab53-3547ddbc3b76-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-4922m\" (UID: \"a46e4490-589d-47d0-ab53-3547ddbc3b76\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4922m" Jul 10 03:36:59.538206 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:59.538179 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a46e4490-589d-47d0-ab53-3547ddbc3b76-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-4922m\" (UID: \"a46e4490-589d-47d0-ab53-3547ddbc3b76\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4922m" Jul 10 03:36:59.706720 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:59.706692 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4922m" Jul 10 03:36:59.822833 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:36:59.822809 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4922m"] Jul 10 03:36:59.825213 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:36:59.825184 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda46e4490_589d_47d0_ab53_3547ddbc3b76.slice/crio-e97c0e8cb74bab4967ceadf0134a890f523fcbf0e186fac488c8579b6e40a71a WatchSource:0}: Error finding container e97c0e8cb74bab4967ceadf0134a890f523fcbf0e186fac488c8579b6e40a71a: Status 404 returned error can't find the container with id e97c0e8cb74bab4967ceadf0134a890f523fcbf0e186fac488c8579b6e40a71a Jul 10 03:37:00.425471 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.425438 2582 patch_prober.go:28] interesting pod/image-registry-684ff59cc9-5rfpw container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 10 03:37:00.425629 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.425505 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" podUID="ab3a8cad-f220-460b-a75f-dbbe2e6c6128" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 03:37:00.665831 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.665798 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c84dd6555-qd26f"] Jul 10 03:37:00.669075 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.669054 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c84dd6555-qd26f" Jul 10 03:37:00.672395 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.672371 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 10 03:37:00.672395 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.672382 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-j6wc5\"" Jul 10 03:37:00.672578 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.672371 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 10 03:37:00.672791 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.672750 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 10 03:37:00.672927 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.672841 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 10 03:37:00.672988 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.672927 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 10 03:37:00.672988 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.672933 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 10 03:37:00.673108 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.672987 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 10 03:37:00.677226 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.677171 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c84dd6555-qd26f"] Jul 10 03:37:00.677531 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.677513 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 10 03:37:00.746234 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.746198 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-oauth-serving-cert\") pod \"console-6c84dd6555-qd26f\" (UID: \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\") " pod="openshift-console/console-6c84dd6555-qd26f" Jul 10 03:37:00.746405 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.746267 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-console-oauth-config\") pod \"console-6c84dd6555-qd26f\" (UID: \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\") " pod="openshift-console/console-6c84dd6555-qd26f" Jul 10 03:37:00.746405 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.746293 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-console-config\") pod \"console-6c84dd6555-qd26f\" (UID: \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\") " pod="openshift-console/console-6c84dd6555-qd26f" Jul 10 03:37:00.746405 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.746317 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-console-serving-cert\") pod \"console-6c84dd6555-qd26f\" (UID: \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\") " pod="openshift-console/console-6c84dd6555-qd26f" Jul 10 03:37:00.746405 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.746359 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-service-ca\") pod \"console-6c84dd6555-qd26f\" (UID: \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\") " pod="openshift-console/console-6c84dd6555-qd26f" Jul 10 03:37:00.746405 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.746376 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt6c7\" (UniqueName: \"kubernetes.io/projected/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-kube-api-access-dt6c7\") pod \"console-6c84dd6555-qd26f\" (UID: \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\") " pod="openshift-console/console-6c84dd6555-qd26f" Jul 10 03:37:00.746405 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.746402 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-trusted-ca-bundle\") pod \"console-6c84dd6555-qd26f\" (UID: \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\") " pod="openshift-console/console-6c84dd6555-qd26f" Jul 10 03:37:00.805263 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.805222 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4922m" event={"ID":"a46e4490-589d-47d0-ab53-3547ddbc3b76","Type":"ContainerStarted","Data":"e97c0e8cb74bab4967ceadf0134a890f523fcbf0e186fac488c8579b6e40a71a"} Jul 10 03:37:00.846778 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.846751 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-console-oauth-config\") pod \"console-6c84dd6555-qd26f\" (UID: \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\") " pod="openshift-console/console-6c84dd6555-qd26f" Jul 10 03:37:00.847098 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.846794 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-console-config\") pod \"console-6c84dd6555-qd26f\" (UID: \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\") " pod="openshift-console/console-6c84dd6555-qd26f" Jul 10 03:37:00.847098 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.846835 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-console-serving-cert\") pod \"console-6c84dd6555-qd26f\" (UID: \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\") " pod="openshift-console/console-6c84dd6555-qd26f" Jul 10 03:37:00.847098 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.846947 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-service-ca\") pod \"console-6c84dd6555-qd26f\" (UID: \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\") " pod="openshift-console/console-6c84dd6555-qd26f" Jul 10 03:37:00.847098 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.846975 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt6c7\" (UniqueName: \"kubernetes.io/projected/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-kube-api-access-dt6c7\") pod \"console-6c84dd6555-qd26f\" (UID: \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\") " pod="openshift-console/console-6c84dd6555-qd26f" Jul 10 03:37:00.847329 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.847271 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-trusted-ca-bundle\") pod \"console-6c84dd6555-qd26f\" (UID: \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\") " pod="openshift-console/console-6c84dd6555-qd26f" Jul 10 03:37:00.847329 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.847321 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-oauth-serving-cert\") pod \"console-6c84dd6555-qd26f\" (UID: \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\") " pod="openshift-console/console-6c84dd6555-qd26f" Jul 10 03:37:00.847850 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.847670 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-console-config\") pod \"console-6c84dd6555-qd26f\" (UID: \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\") " pod="openshift-console/console-6c84dd6555-qd26f" Jul 10 03:37:00.847949 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.847903 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-service-ca\") pod \"console-6c84dd6555-qd26f\" (UID: \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\") " pod="openshift-console/console-6c84dd6555-qd26f" Jul 10 03:37:00.848374 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.848353 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-trusted-ca-bundle\") pod \"console-6c84dd6555-qd26f\" (UID: \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\") " pod="openshift-console/console-6c84dd6555-qd26f" Jul 10 03:37:00.848547 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.848531 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-oauth-serving-cert\") pod \"console-6c84dd6555-qd26f\" (UID: \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\") " pod="openshift-console/console-6c84dd6555-qd26f" Jul 10 03:37:00.849770 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.849749 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-console-serving-cert\") pod \"console-6c84dd6555-qd26f\" (UID: \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\") " pod="openshift-console/console-6c84dd6555-qd26f" Jul 10 03:37:00.849859 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.849765 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-console-oauth-config\") pod \"console-6c84dd6555-qd26f\" (UID: \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\") " pod="openshift-console/console-6c84dd6555-qd26f" Jul 10 03:37:00.854583 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.854558 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt6c7\" (UniqueName: \"kubernetes.io/projected/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-kube-api-access-dt6c7\") pod \"console-6c84dd6555-qd26f\" (UID: \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\") " pod="openshift-console/console-6c84dd6555-qd26f" Jul 10 03:37:00.981595 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:00.981530 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c84dd6555-qd26f" Jul 10 03:37:01.115586 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:01.115569 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c84dd6555-qd26f"] Jul 10 03:37:01.117811 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:37:01.117775 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f54e5a2_0d31_44db_9d02_89d6c145ea9e.slice/crio-7fd03544579ac5ab8e90aefbcc513c651eee6f5cecb8005bc62afc7a1194520c WatchSource:0}: Error finding container 7fd03544579ac5ab8e90aefbcc513c651eee6f5cecb8005bc62afc7a1194520c: Status 404 returned error can't find the container with id 7fd03544579ac5ab8e90aefbcc513c651eee6f5cecb8005bc62afc7a1194520c Jul 10 03:37:01.810049 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:01.810010 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4922m" event={"ID":"a46e4490-589d-47d0-ab53-3547ddbc3b76","Type":"ContainerStarted","Data":"7dd7570938ab0cddd7cc34bb18deec756fa47196c1e101ca5725ed138a7b53bd"} Jul 10 03:37:01.810353 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:01.810074 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4922m" Jul 10 03:37:01.811350 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:01.811318 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c84dd6555-qd26f" event={"ID":"0f54e5a2-0d31-44db-9d02-89d6c145ea9e","Type":"ContainerStarted","Data":"7fd03544579ac5ab8e90aefbcc513c651eee6f5cecb8005bc62afc7a1194520c"} Jul 10 03:37:01.815436 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:01.815412 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4922m" Jul 10 03:37:01.824300 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:01.824262 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-4922m" podStartSLOduration=2.845027256 podStartE2EDuration="3.824249315s" totalImagesPullingTime="979.222059ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:36:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:37:01.823293709 +0000 UTC m=+281.475105359" watchObservedRunningTime="2026-07-10 03:37:01.824249315 +0000 UTC m=+281.476060964" Jul 10 03:37:02.470661 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:37:02.470614 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-267rs" podUID="99ee7944-11db-4b68-bfe1-4cd910cf2ef2" Jul 10 03:37:02.815639 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:02.815598 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-267rs" Jul 10 03:37:04.825006 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:04.824968 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c84dd6555-qd26f" event={"ID":"0f54e5a2-0d31-44db-9d02-89d6c145ea9e","Type":"ContainerStarted","Data":"a847a0760ed034b5b91deb9849315c6baaaf3d24112d1970a557c40ccce52c25"} Jul 10 03:37:04.841201 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:04.841159 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c84dd6555-qd26f" podStartSLOduration=1.9227842019999999 podStartE2EDuration="4.841144526s" totalImagesPullingTime="2.918360324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:37:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:37:04.839776658 +0000 UTC m=+284.491588307" watchObservedRunningTime="2026-07-10 03:37:04.841144526 +0000 UTC m=+284.492956174" Jul 10 03:37:05.689821 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:05.689788 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-metrics-tls\") pod \"dns-default-267rs\" (UID: \"99ee7944-11db-4b68-bfe1-4cd910cf2ef2\") " pod="openshift-dns/dns-default-267rs" Jul 10 03:37:05.692056 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:05.692029 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/99ee7944-11db-4b68-bfe1-4cd910cf2ef2-metrics-tls\") pod \"dns-default-267rs\" (UID: \"99ee7944-11db-4b68-bfe1-4cd910cf2ef2\") " pod="openshift-dns/dns-default-267rs" Jul 10 03:37:05.818398 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:05.818369 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dk2pk\"" Jul 10 03:37:05.826361 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:05.826339 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-267rs" Jul 10 03:37:05.944819 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:05.944756 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-267rs"] Jul 10 03:37:05.947704 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:37:05.947675 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99ee7944_11db_4b68_bfe1_4cd910cf2ef2.slice/crio-2b3a6f0a8259fab6eab3a231739920c0b624152e3004b5ab843036db48f5224e WatchSource:0}: Error finding container 2b3a6f0a8259fab6eab3a231739920c0b624152e3004b5ab843036db48f5224e: Status 404 returned error can't find the container with id 2b3a6f0a8259fab6eab3a231739920c0b624152e3004b5ab843036db48f5224e Jul 10 03:37:06.833447 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:06.833414 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-267rs" event={"ID":"99ee7944-11db-4b68-bfe1-4cd910cf2ef2","Type":"ContainerStarted","Data":"2b3a6f0a8259fab6eab3a231739920c0b624152e3004b5ab843036db48f5224e"} Jul 10 03:37:08.843382 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:08.843349 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-267rs" event={"ID":"99ee7944-11db-4b68-bfe1-4cd910cf2ef2","Type":"ContainerStarted","Data":"48f5454f766fbecd60a36a4fc95406fd64395624dec13fcdde1874db256c4509"} Jul 10 03:37:08.843765 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:08.843397 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-267rs" event={"ID":"99ee7944-11db-4b68-bfe1-4cd910cf2ef2","Type":"ContainerStarted","Data":"377294716d54889a7733dd299d93c2348725ecef5a218fbc32bfc83d3253e951"} Jul 10 03:37:08.843765 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:08.843468 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-267rs" Jul 10 03:37:08.865688 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:08.862735 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-267rs" podStartSLOduration=251.9960894 podStartE2EDuration="4m13.862716727s" totalImagesPullingTime="1.866627327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:32:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:37:08.860678844 +0000 UTC m=+288.512490485" watchObservedRunningTime="2026-07-10 03:37:08.862716727 +0000 UTC m=+288.514528382" Jul 10 03:37:10.424677 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:10.424644 2582 patch_prober.go:28] interesting pod/image-registry-684ff59cc9-5rfpw container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 10 03:37:10.425048 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:10.424694 2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" podUID="ab3a8cad-f220-460b-a75f-dbbe2e6c6128" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 03:37:10.982009 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:10.981977 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c84dd6555-qd26f" Jul 10 03:37:10.982176 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:10.982057 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c84dd6555-qd26f" Jul 10 03:37:10.983264 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:10.983243 2582 patch_prober.go:28] interesting pod/console-6c84dd6555-qd26f container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" start-of-body= Jul 10 03:37:10.983382 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:10.983277 2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6c84dd6555-qd26f" podUID="0f54e5a2-0d31-44db-9d02-89d6c145ea9e" containerName="console" probeResult="failure" output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" Jul 10 03:37:13.881268 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:37:13.881210 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-ddntq" podUID="b78bc3c1-3658-4cdd-ba93-30d686b78aa5" Jul 10 03:37:14.178192 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.178101 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-4rttv"] Jul 10 03:37:14.181279 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.181262 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4rttv" Jul 10 03:37:14.183384 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.183355 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 10 03:37:14.184176 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.184159 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 10 03:37:14.184311 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.184183 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-9zw7v\"" Jul 10 03:37:14.184311 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.184183 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 10 03:37:14.191385 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.191365 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-4rttv"] Jul 10 03:37:14.207422 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.207402 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-4vtch"] Jul 10 03:37:14.210492 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.210476 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-4vtch" Jul 10 03:37:14.212834 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.212811 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 10 03:37:14.212948 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.212882 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-dxkzj\"" Jul 10 03:37:14.213802 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.213781 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 10 03:37:14.213873 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.213843 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 10 03:37:14.219940 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.219921 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bxbc7"] Jul 10 03:37:14.223392 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.223375 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bxbc7" Jul 10 03:37:14.223467 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.223449 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-4vtch"] Jul 10 03:37:14.225713 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.225695 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8h9sp\"" Jul 10 03:37:14.225876 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.225852 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 10 03:37:14.226272 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.226254 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 10 03:37:14.226366 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.226340 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 10 03:37:14.252856 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.252796 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bcc5775-6fc0-4602-bee4-6d4ed5f6e96d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-4rttv\" (UID: \"2bcc5775-6fc0-4602-bee4-6d4ed5f6e96d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4rttv" Jul 10 03:37:14.252997 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.252938 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmwz8\" (UniqueName: \"kubernetes.io/projected/6180a5b2-24f4-47c5-87e8-463171c865cb-kube-api-access-dmwz8\") pod \"kube-state-metrics-785778ff74-4vtch\" (UID: \"6180a5b2-24f4-47c5-87e8-463171c865cb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4vtch" Jul 10 03:37:14.252997 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.252977 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6180a5b2-24f4-47c5-87e8-463171c865cb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-4vtch\" (UID: \"6180a5b2-24f4-47c5-87e8-463171c865cb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4vtch" Jul 10 03:37:14.253121 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.253007 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6180a5b2-24f4-47c5-87e8-463171c865cb-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-4vtch\" (UID: \"6180a5b2-24f4-47c5-87e8-463171c865cb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4vtch" Jul 10 03:37:14.253121 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.253028 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/96f8d9dd-8c2b-4c75-99c1-f885a684d8de-root\") pod \"node-exporter-bxbc7\" (UID: \"96f8d9dd-8c2b-4c75-99c1-f885a684d8de\") " pod="openshift-monitoring/node-exporter-bxbc7" Jul 10 03:37:14.253121 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.253051 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/96f8d9dd-8c2b-4c75-99c1-f885a684d8de-node-exporter-accelerators-collector-config\") pod \"node-exporter-bxbc7\" (UID: \"96f8d9dd-8c2b-4c75-99c1-f885a684d8de\") " pod="openshift-monitoring/node-exporter-bxbc7" Jul 10 03:37:14.253121 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.253081 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6180a5b2-24f4-47c5-87e8-463171c865cb-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-4vtch\" (UID: \"6180a5b2-24f4-47c5-87e8-463171c865cb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4vtch" Jul 10 03:37:14.253121 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.253108 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2bcc5775-6fc0-4602-bee4-6d4ed5f6e96d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-4rttv\" (UID: \"2bcc5775-6fc0-4602-bee4-6d4ed5f6e96d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4rttv" Jul 10 03:37:14.253365 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.253131 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bcc5775-6fc0-4602-bee4-6d4ed5f6e96d-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-4rttv\" (UID: \"2bcc5775-6fc0-4602-bee4-6d4ed5f6e96d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4rttv" Jul 10 03:37:14.253365 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.253166 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96f8d9dd-8c2b-4c75-99c1-f885a684d8de-sys\") pod \"node-exporter-bxbc7\" (UID: \"96f8d9dd-8c2b-4c75-99c1-f885a684d8de\") " pod="openshift-monitoring/node-exporter-bxbc7" Jul 10 03:37:14.253365 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.253188 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/96f8d9dd-8c2b-4c75-99c1-f885a684d8de-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bxbc7\" (UID: \"96f8d9dd-8c2b-4c75-99c1-f885a684d8de\") " pod="openshift-monitoring/node-exporter-bxbc7" Jul 10 03:37:14.253365 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.253254 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6180a5b2-24f4-47c5-87e8-463171c865cb-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-4vtch\" (UID: \"6180a5b2-24f4-47c5-87e8-463171c865cb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4vtch" Jul 10 03:37:14.253365 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.253280 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wzwk\" (UniqueName: \"kubernetes.io/projected/96f8d9dd-8c2b-4c75-99c1-f885a684d8de-kube-api-access-7wzwk\") pod \"node-exporter-bxbc7\" (UID: \"96f8d9dd-8c2b-4c75-99c1-f885a684d8de\") " pod="openshift-monitoring/node-exporter-bxbc7" Jul 10 03:37:14.253365 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.253297 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/96f8d9dd-8c2b-4c75-99c1-f885a684d8de-node-exporter-tls\") pod \"node-exporter-bxbc7\" (UID: \"96f8d9dd-8c2b-4c75-99c1-f885a684d8de\") " pod="openshift-monitoring/node-exporter-bxbc7" Jul 10 03:37:14.253365 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.253312 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/96f8d9dd-8c2b-4c75-99c1-f885a684d8de-node-exporter-wtmp\") pod \"node-exporter-bxbc7\" (UID: \"96f8d9dd-8c2b-4c75-99c1-f885a684d8de\") " pod="openshift-monitoring/node-exporter-bxbc7" Jul 10 03:37:14.253365 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.253331 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96f8d9dd-8c2b-4c75-99c1-f885a684d8de-metrics-client-ca\") pod \"node-exporter-bxbc7\" (UID: \"96f8d9dd-8c2b-4c75-99c1-f885a684d8de\") " pod="openshift-monitoring/node-exporter-bxbc7" Jul 10 03:37:14.253365 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.253349 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqk4s\" (UniqueName: \"kubernetes.io/projected/2bcc5775-6fc0-4602-bee4-6d4ed5f6e96d-kube-api-access-hqk4s\") pod \"openshift-state-metrics-84bd68b896-4rttv\" (UID: \"2bcc5775-6fc0-4602-bee4-6d4ed5f6e96d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4rttv" Jul 10 03:37:14.253793 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.253394 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6180a5b2-24f4-47c5-87e8-463171c865cb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-4vtch\" (UID: \"6180a5b2-24f4-47c5-87e8-463171c865cb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4vtch" Jul 10 03:37:14.253793 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.253413 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/96f8d9dd-8c2b-4c75-99c1-f885a684d8de-node-exporter-textfile\") pod \"node-exporter-bxbc7\" (UID: \"96f8d9dd-8c2b-4c75-99c1-f885a684d8de\") " pod="openshift-monitoring/node-exporter-bxbc7" Jul 10 03:37:14.354124 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.354094 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/96f8d9dd-8c2b-4c75-99c1-f885a684d8de-node-exporter-textfile\") pod \"node-exporter-bxbc7\" (UID: \"96f8d9dd-8c2b-4c75-99c1-f885a684d8de\") " pod="openshift-monitoring/node-exporter-bxbc7" Jul 10 03:37:14.354248 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.354129 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bcc5775-6fc0-4602-bee4-6d4ed5f6e96d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-4rttv\" (UID: \"2bcc5775-6fc0-4602-bee4-6d4ed5f6e96d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4rttv" Jul 10 03:37:14.354248 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.354158 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmwz8\" (UniqueName: \"kubernetes.io/projected/6180a5b2-24f4-47c5-87e8-463171c865cb-kube-api-access-dmwz8\") pod \"kube-state-metrics-785778ff74-4vtch\" (UID: \"6180a5b2-24f4-47c5-87e8-463171c865cb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4vtch" Jul 10 03:37:14.354248 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.354175 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6180a5b2-24f4-47c5-87e8-463171c865cb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-4vtch\" (UID: \"6180a5b2-24f4-47c5-87e8-463171c865cb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4vtch" Jul 10 03:37:14.354248 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.354195 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6180a5b2-24f4-47c5-87e8-463171c865cb-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-4vtch\" (UID: \"6180a5b2-24f4-47c5-87e8-463171c865cb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4vtch" Jul 10 03:37:14.354248 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.354216 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/96f8d9dd-8c2b-4c75-99c1-f885a684d8de-root\") pod \"node-exporter-bxbc7\" (UID: \"96f8d9dd-8c2b-4c75-99c1-f885a684d8de\") " pod="openshift-monitoring/node-exporter-bxbc7" Jul 10 03:37:14.354248 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.354232 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/96f8d9dd-8c2b-4c75-99c1-f885a684d8de-node-exporter-accelerators-collector-config\") pod \"node-exporter-bxbc7\" (UID: \"96f8d9dd-8c2b-4c75-99c1-f885a684d8de\") " pod="openshift-monitoring/node-exporter-bxbc7" Jul 10 03:37:14.354559 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.354251 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6180a5b2-24f4-47c5-87e8-463171c865cb-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-4vtch\" (UID: \"6180a5b2-24f4-47c5-87e8-463171c865cb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4vtch" Jul 10 03:37:14.354559 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.354318 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/96f8d9dd-8c2b-4c75-99c1-f885a684d8de-root\") pod \"node-exporter-bxbc7\" (UID: \"96f8d9dd-8c2b-4c75-99c1-f885a684d8de\") " pod="openshift-monitoring/node-exporter-bxbc7" Jul 10 03:37:14.354559 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.354279 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2bcc5775-6fc0-4602-bee4-6d4ed5f6e96d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-4rttv\" (UID: \"2bcc5775-6fc0-4602-bee4-6d4ed5f6e96d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4rttv" Jul 10 03:37:14.354559 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.354430 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bcc5775-6fc0-4602-bee4-6d4ed5f6e96d-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-4rttv\" (UID: \"2bcc5775-6fc0-4602-bee4-6d4ed5f6e96d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4rttv" Jul 10 03:37:14.354559 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.354455 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96f8d9dd-8c2b-4c75-99c1-f885a684d8de-sys\") pod \"node-exporter-bxbc7\" (UID: \"96f8d9dd-8c2b-4c75-99c1-f885a684d8de\") " pod="openshift-monitoring/node-exporter-bxbc7" Jul 10 03:37:14.354559 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.354488 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/96f8d9dd-8c2b-4c75-99c1-f885a684d8de-node-exporter-textfile\") pod \"node-exporter-bxbc7\" (UID: \"96f8d9dd-8c2b-4c75-99c1-f885a684d8de\") " pod="openshift-monitoring/node-exporter-bxbc7" Jul 10 03:37:14.354559 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.354490 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/96f8d9dd-8c2b-4c75-99c1-f885a684d8de-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bxbc7\" (UID: \"96f8d9dd-8c2b-4c75-99c1-f885a684d8de\") " pod="openshift-monitoring/node-exporter-bxbc7" Jul 10 03:37:14.354897 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.354583 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/96f8d9dd-8c2b-4c75-99c1-f885a684d8de-sys\") pod \"node-exporter-bxbc7\" (UID: \"96f8d9dd-8c2b-4c75-99c1-f885a684d8de\") " pod="openshift-monitoring/node-exporter-bxbc7" Jul 10 03:37:14.354897 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.354700 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6180a5b2-24f4-47c5-87e8-463171c865cb-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-4vtch\" (UID: \"6180a5b2-24f4-47c5-87e8-463171c865cb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4vtch" Jul 10 03:37:14.354897 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.354812 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6180a5b2-24f4-47c5-87e8-463171c865cb-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-4vtch\" (UID: \"6180a5b2-24f4-47c5-87e8-463171c865cb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4vtch" Jul 10 03:37:14.354897 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.354847 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wzwk\" (UniqueName: \"kubernetes.io/projected/96f8d9dd-8c2b-4c75-99c1-f885a684d8de-kube-api-access-7wzwk\") pod \"node-exporter-bxbc7\" (UID: \"96f8d9dd-8c2b-4c75-99c1-f885a684d8de\") " pod="openshift-monitoring/node-exporter-bxbc7" Jul 10 03:37:14.354897 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.354853 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/96f8d9dd-8c2b-4c75-99c1-f885a684d8de-node-exporter-accelerators-collector-config\") pod \"node-exporter-bxbc7\" (UID: \"96f8d9dd-8c2b-4c75-99c1-f885a684d8de\") " pod="openshift-monitoring/node-exporter-bxbc7" Jul 10 03:37:14.354897 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.354878 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/96f8d9dd-8c2b-4c75-99c1-f885a684d8de-node-exporter-tls\") pod \"node-exporter-bxbc7\" (UID: \"96f8d9dd-8c2b-4c75-99c1-f885a684d8de\") " pod="openshift-monitoring/node-exporter-bxbc7" Jul 10 03:37:14.355209 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.354926 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/96f8d9dd-8c2b-4c75-99c1-f885a684d8de-node-exporter-wtmp\") pod \"node-exporter-bxbc7\" (UID: \"96f8d9dd-8c2b-4c75-99c1-f885a684d8de\") " pod="openshift-monitoring/node-exporter-bxbc7" Jul 10 03:37:14.355209 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.354962 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96f8d9dd-8c2b-4c75-99c1-f885a684d8de-metrics-client-ca\") pod \"node-exporter-bxbc7\" (UID: \"96f8d9dd-8c2b-4c75-99c1-f885a684d8de\") " pod="openshift-monitoring/node-exporter-bxbc7" Jul 10 03:37:14.355209 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:37:14.354976 2582 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 10 03:37:14.355209 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.354984 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6180a5b2-24f4-47c5-87e8-463171c865cb-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-4vtch\" (UID: \"6180a5b2-24f4-47c5-87e8-463171c865cb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4vtch" Jul 10 03:37:14.355209 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.354994 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqk4s\" (UniqueName: \"kubernetes.io/projected/2bcc5775-6fc0-4602-bee4-6d4ed5f6e96d-kube-api-access-hqk4s\") pod \"openshift-state-metrics-84bd68b896-4rttv\" (UID: \"2bcc5775-6fc0-4602-bee4-6d4ed5f6e96d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4rttv" Jul 10 03:37:14.355209 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:37:14.355030 2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 10 03:37:14.355209 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:37:14.355046 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6180a5b2-24f4-47c5-87e8-463171c865cb-kube-state-metrics-tls podName:6180a5b2-24f4-47c5-87e8-463171c865cb nodeName:}" failed. No retries permitted until 2026-07-10 03:37:14.855027072 +0000 UTC m=+294.506838719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/6180a5b2-24f4-47c5-87e8-463171c865cb-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-4vtch" (UID: "6180a5b2-24f4-47c5-87e8-463171c865cb") : secret "kube-state-metrics-tls" not found Jul 10 03:37:14.355209 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:37:14.355085 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96f8d9dd-8c2b-4c75-99c1-f885a684d8de-node-exporter-tls podName:96f8d9dd-8c2b-4c75-99c1-f885a684d8de nodeName:}" failed. No retries permitted until 2026-07-10 03:37:14.855070981 +0000 UTC m=+294.506882608 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/96f8d9dd-8c2b-4c75-99c1-f885a684d8de-node-exporter-tls") pod "node-exporter-bxbc7" (UID: "96f8d9dd-8c2b-4c75-99c1-f885a684d8de") : secret "node-exporter-tls" not found Jul 10 03:37:14.355209 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.355104 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6180a5b2-24f4-47c5-87e8-463171c865cb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-4vtch\" (UID: \"6180a5b2-24f4-47c5-87e8-463171c865cb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4vtch" Jul 10 03:37:14.355209 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.355144 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/96f8d9dd-8c2b-4c75-99c1-f885a684d8de-node-exporter-wtmp\") pod \"node-exporter-bxbc7\" (UID: \"96f8d9dd-8c2b-4c75-99c1-f885a684d8de\") " pod="openshift-monitoring/node-exporter-bxbc7" Jul 10 03:37:14.355708 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.355235 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2bcc5775-6fc0-4602-bee4-6d4ed5f6e96d-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-4rttv\" (UID: \"2bcc5775-6fc0-4602-bee4-6d4ed5f6e96d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4rttv" Jul 10 03:37:14.355708 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.355605 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96f8d9dd-8c2b-4c75-99c1-f885a684d8de-metrics-client-ca\") pod \"node-exporter-bxbc7\" (UID: \"96f8d9dd-8c2b-4c75-99c1-f885a684d8de\") " pod="openshift-monitoring/node-exporter-bxbc7" Jul 10 03:37:14.355708 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.355689 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6180a5b2-24f4-47c5-87e8-463171c865cb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-4vtch\" (UID: \"6180a5b2-24f4-47c5-87e8-463171c865cb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4vtch" Jul 10 03:37:14.357027 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.356990 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2bcc5775-6fc0-4602-bee4-6d4ed5f6e96d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-4rttv\" (UID: \"2bcc5775-6fc0-4602-bee4-6d4ed5f6e96d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4rttv" Jul 10 03:37:14.357110 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.357088 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2bcc5775-6fc0-4602-bee4-6d4ed5f6e96d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-4rttv\" (UID: \"2bcc5775-6fc0-4602-bee4-6d4ed5f6e96d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4rttv" Jul 10 03:37:14.357295 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.357272 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/96f8d9dd-8c2b-4c75-99c1-f885a684d8de-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bxbc7\" (UID: \"96f8d9dd-8c2b-4c75-99c1-f885a684d8de\") " pod="openshift-monitoring/node-exporter-bxbc7" Jul 10 03:37:14.357520 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.357502 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6180a5b2-24f4-47c5-87e8-463171c865cb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-4vtch\" (UID: \"6180a5b2-24f4-47c5-87e8-463171c865cb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4vtch" Jul 10 03:37:14.363027 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.362998 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wzwk\" (UniqueName: \"kubernetes.io/projected/96f8d9dd-8c2b-4c75-99c1-f885a684d8de-kube-api-access-7wzwk\") pod \"node-exporter-bxbc7\" (UID: \"96f8d9dd-8c2b-4c75-99c1-f885a684d8de\") " pod="openshift-monitoring/node-exporter-bxbc7" Jul 10 03:37:14.363027 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.363010 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqk4s\" (UniqueName: \"kubernetes.io/projected/2bcc5775-6fc0-4602-bee4-6d4ed5f6e96d-kube-api-access-hqk4s\") pod \"openshift-state-metrics-84bd68b896-4rttv\" (UID: \"2bcc5775-6fc0-4602-bee4-6d4ed5f6e96d\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4rttv" Jul 10 03:37:14.363298 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.363281 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmwz8\" (UniqueName: \"kubernetes.io/projected/6180a5b2-24f4-47c5-87e8-463171c865cb-kube-api-access-dmwz8\") pod \"kube-state-metrics-785778ff74-4vtch\" (UID: \"6180a5b2-24f4-47c5-87e8-463171c865cb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4vtch" Jul 10 03:37:14.490110 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.490022 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4rttv" Jul 10 03:37:14.613523 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.613491 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-4rttv"] Jul 10 03:37:14.616744 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:37:14.616716 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bcc5775_6fc0_4602_bee4_6d4ed5f6e96d.slice/crio-fc22d37eda80e6dd722b4bad9a57a81d285c5bf90d036b84be5097ecc5b5d280 WatchSource:0}: Error finding container fc22d37eda80e6dd722b4bad9a57a81d285c5bf90d036b84be5097ecc5b5d280: Status 404 returned error can't find the container with id fc22d37eda80e6dd722b4bad9a57a81d285c5bf90d036b84be5097ecc5b5d280 Jul 10 03:37:14.859876 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.859842 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6180a5b2-24f4-47c5-87e8-463171c865cb-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-4vtch\" (UID: \"6180a5b2-24f4-47c5-87e8-463171c865cb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4vtch" Jul 10 03:37:14.860043 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.859887 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/96f8d9dd-8c2b-4c75-99c1-f885a684d8de-node-exporter-tls\") pod \"node-exporter-bxbc7\" (UID: \"96f8d9dd-8c2b-4c75-99c1-f885a684d8de\") " pod="openshift-monitoring/node-exporter-bxbc7" Jul 10 03:37:14.862246 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.862224 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/96f8d9dd-8c2b-4c75-99c1-f885a684d8de-node-exporter-tls\") pod \"node-exporter-bxbc7\" (UID: \"96f8d9dd-8c2b-4c75-99c1-f885a684d8de\") " pod="openshift-monitoring/node-exporter-bxbc7" Jul 10 03:37:14.862381 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.862286 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6180a5b2-24f4-47c5-87e8-463171c865cb-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-4vtch\" (UID: \"6180a5b2-24f4-47c5-87e8-463171c865cb\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-4vtch" Jul 10 03:37:14.863711 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.863689 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4rttv" event={"ID":"2bcc5775-6fc0-4602-bee4-6d4ed5f6e96d","Type":"ContainerStarted","Data":"db63417aad9d2b1676e766880a1e7240d28ebd714203c3faf0dd02e55371fdf8"} Jul 10 03:37:14.863791 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.863744 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4rttv" event={"ID":"2bcc5775-6fc0-4602-bee4-6d4ed5f6e96d","Type":"ContainerStarted","Data":"bca2925f5db23bd652b024dd61ccaf816223d43fc4ddd0de3f34bcf5d3e7dfd5"} Jul 10 03:37:14.863791 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:14.863764 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4rttv" event={"ID":"2bcc5775-6fc0-4602-bee4-6d4ed5f6e96d","Type":"ContainerStarted","Data":"fc22d37eda80e6dd722b4bad9a57a81d285c5bf90d036b84be5097ecc5b5d280"} Jul 10 03:37:15.119298 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.119225 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-4vtch" Jul 10 03:37:15.131361 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.131333 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bxbc7" Jul 10 03:37:15.144971 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:37:15.144940 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96f8d9dd_8c2b_4c75_99c1_f885a684d8de.slice/crio-cb593391870a57eb826e0ea069209a8e9648af7d79f30a0421c73c6bd0bad560 WatchSource:0}: Error finding container cb593391870a57eb826e0ea069209a8e9648af7d79f30a0421c73c6bd0bad560: Status 404 returned error can't find the container with id cb593391870a57eb826e0ea069209a8e9648af7d79f30a0421c73c6bd0bad560 Jul 10 03:37:15.266166 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.266135 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-4vtch"] Jul 10 03:37:15.268591 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:37:15.268565 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6180a5b2_24f4_47c5_87e8_463171c865cb.slice/crio-33599e49304fa7fb8adb130610b6ae54368a3cd61661193bd8a154cfd6b87ac3 WatchSource:0}: Error finding container 33599e49304fa7fb8adb130610b6ae54368a3cd61661193bd8a154cfd6b87ac3: Status 404 returned error can't find the container with id 33599e49304fa7fb8adb130610b6ae54368a3cd61661193bd8a154cfd6b87ac3 Jul 10 03:37:15.281708 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.281684 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 03:37:15.285662 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.285641 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.289015 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.288921 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 10 03:37:15.289015 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.288987 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 10 03:37:15.289191 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.288929 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 10 03:37:15.289191 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.288925 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 10 03:37:15.289318 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.289301 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 10 03:37:15.289376 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.289331 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 10 03:37:15.289637 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.289622 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 10 03:37:15.289956 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.289939 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 10 03:37:15.290199 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.290183 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-h9rb8\"" Jul 10 03:37:15.290425 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.290400 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 10 03:37:15.315839 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.315819 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 03:37:15.364499 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.364473 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85d00d25-f032-411d-83e5-1d846ec420a9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.364499 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.364502 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85d00d25-f032-411d-83e5-1d846ec420a9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.364683 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.364522 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85d00d25-f032-411d-83e5-1d846ec420a9-web-config\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.364683 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.364611 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/85d00d25-f032-411d-83e5-1d846ec420a9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.364683 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.364656 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85d00d25-f032-411d-83e5-1d846ec420a9-config-out\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.364683 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.364679 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/85d00d25-f032-411d-83e5-1d846ec420a9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.364826 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.364703 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85d00d25-f032-411d-83e5-1d846ec420a9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.364826 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.364727 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/85d00d25-f032-411d-83e5-1d846ec420a9-config-volume\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.364826 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.364758 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85d00d25-f032-411d-83e5-1d846ec420a9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.364826 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.364806 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/85d00d25-f032-411d-83e5-1d846ec420a9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.365048 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.364829 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7hcb\" (UniqueName: \"kubernetes.io/projected/85d00d25-f032-411d-83e5-1d846ec420a9-kube-api-access-s7hcb\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.365048 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.364862 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85d00d25-f032-411d-83e5-1d846ec420a9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.365048 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.364937 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/85d00d25-f032-411d-83e5-1d846ec420a9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.445892 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.445808 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" podUID="ab3a8cad-f220-460b-a75f-dbbe2e6c6128" containerName="registry" containerID="cri-o://689e8a9ce185d79029adbc366cb31eba32197f2ce3df81116d37e11205c5a2c8" gracePeriod=30 Jul 10 03:37:15.466130 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.466100 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/85d00d25-f032-411d-83e5-1d846ec420a9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.466252 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.466148 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85d00d25-f032-411d-83e5-1d846ec420a9-config-out\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.466252 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.466174 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/85d00d25-f032-411d-83e5-1d846ec420a9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.466252 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.466205 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85d00d25-f032-411d-83e5-1d846ec420a9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.466252 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.466231 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/85d00d25-f032-411d-83e5-1d846ec420a9-config-volume\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.466455 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.466264 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85d00d25-f032-411d-83e5-1d846ec420a9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.466455 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.466307 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/85d00d25-f032-411d-83e5-1d846ec420a9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.466455 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.466330 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7hcb\" (UniqueName: \"kubernetes.io/projected/85d00d25-f032-411d-83e5-1d846ec420a9-kube-api-access-s7hcb\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.466455 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.466360 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85d00d25-f032-411d-83e5-1d846ec420a9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.466455 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.466384 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/85d00d25-f032-411d-83e5-1d846ec420a9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.466455 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.466415 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85d00d25-f032-411d-83e5-1d846ec420a9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.466455 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.466440 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85d00d25-f032-411d-83e5-1d846ec420a9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.466781 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.466472 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85d00d25-f032-411d-83e5-1d846ec420a9-web-config\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.466781 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:37:15.466704 2582 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 10 03:37:15.466781 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:37:15.466761 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85d00d25-f032-411d-83e5-1d846ec420a9-secret-alertmanager-main-tls podName:85d00d25-f032-411d-83e5-1d846ec420a9 nodeName:}" failed. No retries permitted until 2026-07-10 03:37:15.966742432 +0000 UTC m=+295.618554063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/85d00d25-f032-411d-83e5-1d846ec420a9-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "85d00d25-f032-411d-83e5-1d846ec420a9") : secret "alertmanager-main-tls" not found Jul 10 03:37:15.467198 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.467070 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85d00d25-f032-411d-83e5-1d846ec420a9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.467542 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.467442 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/85d00d25-f032-411d-83e5-1d846ec420a9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.469358 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.469330 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/85d00d25-f032-411d-83e5-1d846ec420a9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.469831 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.469806 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/85d00d25-f032-411d-83e5-1d846ec420a9-config-out\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.470184 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.470125 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/85d00d25-f032-411d-83e5-1d846ec420a9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.470286 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.470196 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/85d00d25-f032-411d-83e5-1d846ec420a9-config-volume\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.471304 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.470580 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85d00d25-f032-411d-83e5-1d846ec420a9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.471304 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.470807 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/85d00d25-f032-411d-83e5-1d846ec420a9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.471618 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.471587 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/85d00d25-f032-411d-83e5-1d846ec420a9-web-config\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.472312 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.472294 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/85d00d25-f032-411d-83e5-1d846ec420a9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.472455 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.472436 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/85d00d25-f032-411d-83e5-1d846ec420a9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.475677 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.475658 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7hcb\" (UniqueName: \"kubernetes.io/projected/85d00d25-f032-411d-83e5-1d846ec420a9-kube-api-access-s7hcb\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.754181 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.754156 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" Jul 10 03:37:15.768416 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.768389 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgz6g\" (UniqueName: \"kubernetes.io/projected/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-kube-api-access-fgz6g\") pod \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " Jul 10 03:37:15.768539 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.768435 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-installation-pull-secrets\") pod \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " Jul 10 03:37:15.768539 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.768478 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-bound-sa-token\") pod \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " Jul 10 03:37:15.768539 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.768507 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-trusted-ca\") pod \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " Jul 10 03:37:15.768539 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.768531 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-image-registry-private-configuration\") pod \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " Jul 10 03:37:15.768747 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.768580 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-registry-tls\") pod \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " Jul 10 03:37:15.768747 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.768616 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-registry-certificates\") pod \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " Jul 10 03:37:15.768747 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.768665 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-ca-trust-extracted\") pod \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\" (UID: \"ab3a8cad-f220-460b-a75f-dbbe2e6c6128\") " Jul 10 03:37:15.769602 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.769551 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ab3a8cad-f220-460b-a75f-dbbe2e6c6128" (UID: "ab3a8cad-f220-460b-a75f-dbbe2e6c6128"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 03:37:15.770239 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.770204 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ab3a8cad-f220-460b-a75f-dbbe2e6c6128" (UID: "ab3a8cad-f220-460b-a75f-dbbe2e6c6128"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 03:37:15.772046 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.772005 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-kube-api-access-fgz6g" (OuterVolumeSpecName: "kube-api-access-fgz6g") pod "ab3a8cad-f220-460b-a75f-dbbe2e6c6128" (UID: "ab3a8cad-f220-460b-a75f-dbbe2e6c6128"). InnerVolumeSpecName "kube-api-access-fgz6g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 03:37:15.772860 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.772257 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ab3a8cad-f220-460b-a75f-dbbe2e6c6128" (UID: "ab3a8cad-f220-460b-a75f-dbbe2e6c6128"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 03:37:15.773049 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.772316 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ab3a8cad-f220-460b-a75f-dbbe2e6c6128" (UID: "ab3a8cad-f220-460b-a75f-dbbe2e6c6128"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 03:37:15.775894 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.775858 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ab3a8cad-f220-460b-a75f-dbbe2e6c6128" (UID: "ab3a8cad-f220-460b-a75f-dbbe2e6c6128"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 03:37:15.777463 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.777436 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ab3a8cad-f220-460b-a75f-dbbe2e6c6128" (UID: "ab3a8cad-f220-460b-a75f-dbbe2e6c6128"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 03:37:15.783338 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.783198 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ab3a8cad-f220-460b-a75f-dbbe2e6c6128" (UID: "ab3a8cad-f220-460b-a75f-dbbe2e6c6128"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 03:37:15.869296 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.869262 2582 generic.go:356] "Generic (PLEG): container finished" podID="ab3a8cad-f220-460b-a75f-dbbe2e6c6128" containerID="689e8a9ce185d79029adbc366cb31eba32197f2ce3df81116d37e11205c5a2c8" exitCode=0 Jul 10 03:37:15.869499 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.869315 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" Jul 10 03:37:15.869499 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.869362 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" event={"ID":"ab3a8cad-f220-460b-a75f-dbbe2e6c6128","Type":"ContainerDied","Data":"689e8a9ce185d79029adbc366cb31eba32197f2ce3df81116d37e11205c5a2c8"} Jul 10 03:37:15.869499 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.869374 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgz6g\" (UniqueName: \"kubernetes.io/projected/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-kube-api-access-fgz6g\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jul 10 03:37:15.869499 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.869396 2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-installation-pull-secrets\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jul 10 03:37:15.869499 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.869408 2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-bound-sa-token\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jul 10 03:37:15.869499 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.869417 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-trusted-ca\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jul 10 03:37:15.869499 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.869409 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-684ff59cc9-5rfpw" event={"ID":"ab3a8cad-f220-460b-a75f-dbbe2e6c6128","Type":"ContainerDied","Data":"c6770fe0de12dc635ae714db22b62589ee489d7214d60719c14e192cb2b27211"} Jul 10 03:37:15.869499 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.869425 2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-image-registry-private-configuration\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jul 10 03:37:15.869499 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.869434 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-registry-tls\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jul 10 03:37:15.869499 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.869444 2582 scope.go:117] "RemoveContainer" containerID="689e8a9ce185d79029adbc366cb31eba32197f2ce3df81116d37e11205c5a2c8" Jul 10 03:37:15.869499 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.869447 2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-registry-certificates\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jul 10 03:37:15.869499 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.869504 2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ab3a8cad-f220-460b-a75f-dbbe2e6c6128-ca-trust-extracted\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jul 10 03:37:15.872068 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.872024 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4rttv" event={"ID":"2bcc5775-6fc0-4602-bee4-6d4ed5f6e96d","Type":"ContainerStarted","Data":"50dd1a3f86e6bfbfa145c13836e4c23e3364b18348aa491ff59f4cd31fbb9b70"} Jul 10 03:37:15.873541 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.873516 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bxbc7" event={"ID":"96f8d9dd-8c2b-4c75-99c1-f885a684d8de","Type":"ContainerStarted","Data":"cb593391870a57eb826e0ea069209a8e9648af7d79f30a0421c73c6bd0bad560"} Jul 10 03:37:15.874944 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.874903 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-4vtch" event={"ID":"6180a5b2-24f4-47c5-87e8-463171c865cb","Type":"ContainerStarted","Data":"33599e49304fa7fb8adb130610b6ae54368a3cd61661193bd8a154cfd6b87ac3"} Jul 10 03:37:15.879214 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.879118 2582 scope.go:117] "RemoveContainer" containerID="689e8a9ce185d79029adbc366cb31eba32197f2ce3df81116d37e11205c5a2c8" Jul 10 03:37:15.879477 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:37:15.879449 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"689e8a9ce185d79029adbc366cb31eba32197f2ce3df81116d37e11205c5a2c8\": container with ID starting with 689e8a9ce185d79029adbc366cb31eba32197f2ce3df81116d37e11205c5a2c8 not found: ID does not exist" containerID="689e8a9ce185d79029adbc366cb31eba32197f2ce3df81116d37e11205c5a2c8" Jul 10 03:37:15.879603 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.879486 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"689e8a9ce185d79029adbc366cb31eba32197f2ce3df81116d37e11205c5a2c8"} err="failed to get container status \"689e8a9ce185d79029adbc366cb31eba32197f2ce3df81116d37e11205c5a2c8\": rpc error: code = NotFound desc = could not find container \"689e8a9ce185d79029adbc366cb31eba32197f2ce3df81116d37e11205c5a2c8\": container with ID starting with 689e8a9ce185d79029adbc366cb31eba32197f2ce3df81116d37e11205c5a2c8 not found: ID does not exist" Jul 10 03:37:15.891831 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.891781 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-4rttv" podStartSLOduration=0.953107179 podStartE2EDuration="1.891767792s" totalImagesPullingTime="938.660613ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:37:15.889969494 +0000 UTC m=+295.541781146" watchObservedRunningTime="2026-07-10 03:37:15.891767792 +0000 UTC m=+295.543579441" Jul 10 03:37:15.906658 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.906626 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-684ff59cc9-5rfpw"] Jul 10 03:37:15.911765 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.911746 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-684ff59cc9-5rfpw"] Jul 10 03:37:15.971113 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.971040 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/85d00d25-f032-411d-83e5-1d846ec420a9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:15.973896 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:15.973871 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/85d00d25-f032-411d-83e5-1d846ec420a9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"85d00d25-f032-411d-83e5-1d846ec420a9\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:16.197302 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:16.197271 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 03:37:16.705371 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:37:16.705339 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85d00d25_f032_411d_83e5_1d846ec420a9.slice/crio-782f56f4bdb6dd955bc468d6eb2482d79b7bd77b828ab26adbab745a572e32f7 WatchSource:0}: Error finding container 782f56f4bdb6dd955bc468d6eb2482d79b7bd77b828ab26adbab745a572e32f7: Status 404 returned error can't find the container with id 782f56f4bdb6dd955bc468d6eb2482d79b7bd77b828ab26adbab745a572e32f7 Jul 10 03:37:16.706427 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:16.706300 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 03:37:16.882110 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:16.882039 2582 generic.go:356] "Generic (PLEG): container finished" podID="96f8d9dd-8c2b-4c75-99c1-f885a684d8de" containerID="41abe64e34fdd7dd38498927cb15ae406557697680262385b1a2867bb51d423d" exitCode=0 Jul 10 03:37:16.883126 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:16.883096 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab3a8cad-f220-460b-a75f-dbbe2e6c6128" path="/var/lib/kubelet/pods/ab3a8cad-f220-460b-a75f-dbbe2e6c6128/volumes" Jul 10 03:37:16.883447 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:16.883426 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bxbc7" event={"ID":"96f8d9dd-8c2b-4c75-99c1-f885a684d8de","Type":"ContainerDied","Data":"41abe64e34fdd7dd38498927cb15ae406557697680262385b1a2867bb51d423d"} Jul 10 03:37:16.884301 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:16.884279 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-4vtch" event={"ID":"6180a5b2-24f4-47c5-87e8-463171c865cb","Type":"ContainerStarted","Data":"3724a7fb390a8a9ff7620805218e224bfa9c425bd67be75f004d709b5184ef78"} Jul 10 03:37:16.884410 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:16.884324 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-4vtch" event={"ID":"6180a5b2-24f4-47c5-87e8-463171c865cb","Type":"ContainerStarted","Data":"9cc5df1a090f028622a243f4097bd82c688b722964740ae554f2033829011133"} Jul 10 03:37:16.884410 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:16.884348 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-4vtch" event={"ID":"6180a5b2-24f4-47c5-87e8-463171c865cb","Type":"ContainerStarted","Data":"d1f66402cdb75800394f2d96a4577f0c021a01603d04afac22b33816a67c56e8"} Jul 10 03:37:16.885574 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:16.885555 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85d00d25-f032-411d-83e5-1d846ec420a9","Type":"ContainerStarted","Data":"782f56f4bdb6dd955bc468d6eb2482d79b7bd77b828ab26adbab745a572e32f7"} Jul 10 03:37:16.918364 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:16.918314 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-4vtch" podStartSLOduration=1.626072993 podStartE2EDuration="2.918293442s" totalImagesPullingTime="1.292220449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:37:16.917208461 +0000 UTC m=+296.569020111" watchObservedRunningTime="2026-07-10 03:37:16.918293442 +0000 UTC m=+296.570105097" Jul 10 03:37:17.891045 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:17.890955 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bxbc7" event={"ID":"96f8d9dd-8c2b-4c75-99c1-f885a684d8de","Type":"ContainerStarted","Data":"14d851d0fc8b138515fc1d665b16cdc6475d00f292d40490143dfca78d0d2286"} Jul 10 03:37:17.891045 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:17.891013 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bxbc7" event={"ID":"96f8d9dd-8c2b-4c75-99c1-f885a684d8de","Type":"ContainerStarted","Data":"e29f903965c40698e6663254a460bd2cf67292a9605b1240e12432ab5449ee5d"} Jul 10 03:37:17.892369 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:17.892339 2582 generic.go:356] "Generic (PLEG): container finished" podID="85d00d25-f032-411d-83e5-1d846ec420a9" containerID="f6acb8c22ad748866f564a21d5107490646dc6c5bb5cb7022a553ec19c113ed9" exitCode=0 Jul 10 03:37:17.892462 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:17.892427 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85d00d25-f032-411d-83e5-1d846ec420a9","Type":"ContainerDied","Data":"f6acb8c22ad748866f564a21d5107490646dc6c5bb5cb7022a553ec19c113ed9"} Jul 10 03:37:17.912894 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:17.912850 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bxbc7" podStartSLOduration=2.422433467 podStartE2EDuration="3.912836679s" totalImagesPullingTime="1.414512948s" totalInitContainerRuntime="75.890264ms" isStatefulPod=true podCreationTimestamp="2026-07-10 03:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:37:17.911615973 +0000 UTC m=+297.563427621" watchObservedRunningTime="2026-07-10 03:37:17.912836679 +0000 UTC m=+297.564648355" Jul 10 03:37:18.848399 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:18.848361 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-267rs" Jul 10 03:37:19.903858 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:19.903814 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85d00d25-f032-411d-83e5-1d846ec420a9","Type":"ContainerStarted","Data":"2b11b2926593aca47fad6b34f091904275d190386419edea9552b526e81f557f"} Jul 10 03:37:19.904393 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:19.903962 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85d00d25-f032-411d-83e5-1d846ec420a9","Type":"ContainerStarted","Data":"0de2e35c402f6383b921ed86f9f1a989c0bc562871721f40712e3cecf55778e1"} Jul 10 03:37:19.904393 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:19.903995 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85d00d25-f032-411d-83e5-1d846ec420a9","Type":"ContainerStarted","Data":"cd5b832b9ca8820d40e40ac1299f93dca4fade61cac2f37b0bd672be7dac614f"} Jul 10 03:37:19.904393 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:19.904020 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85d00d25-f032-411d-83e5-1d846ec420a9","Type":"ContainerStarted","Data":"9759e34a947f3f7b919e5090afe4a18d32f35945313e571ca9855c7fe17e2a45"} Jul 10 03:37:19.904393 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:19.904047 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85d00d25-f032-411d-83e5-1d846ec420a9","Type":"ContainerStarted","Data":"e20948bf27142cc754339d9988508a05c26059fedd28c91328d279bde70e75ad"} Jul 10 03:37:20.498107 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.498070 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 03:37:20.498453 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.498435 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab3a8cad-f220-460b-a75f-dbbe2e6c6128" containerName="registry" Jul 10 03:37:20.498538 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.498455 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab3a8cad-f220-460b-a75f-dbbe2e6c6128" containerName="registry" Jul 10 03:37:20.498538 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.498517 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab3a8cad-f220-460b-a75f-dbbe2e6c6128" containerName="registry" Jul 10 03:37:20.502524 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.502502 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.505286 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.505260 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 10 03:37:20.505393 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.505283 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 10 03:37:20.505393 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.505283 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 10 03:37:20.505693 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.505621 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 10 03:37:20.505693 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.505670 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cdcl74oeiuqq3\"" Jul 10 03:37:20.505693 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.505684 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 10 03:37:20.506564 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.506524 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 10 03:37:20.506564 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.506548 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 10 03:37:20.506564 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.506553 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 10 03:37:20.506811 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.506555 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sbshm\"" Jul 10 03:37:20.506811 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.506632 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 10 03:37:20.506811 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.506756 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 10 03:37:20.506811 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.506810 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 10 03:37:20.507145 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.506937 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 10 03:37:20.507145 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.506951 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 10 03:37:20.509057 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.509003 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 10 03:37:20.512591 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.512570 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 10 03:37:20.522231 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.522211 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 03:37:20.613230 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.613203 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/92d7242c-e60b-485c-874a-e82a7b8f241b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.613338 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.613233 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92d7242c-e60b-485c-874a-e82a7b8f241b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.613338 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.613285 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92d7242c-e60b-485c-874a-e82a7b8f241b-web-config\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.613338 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.613313 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/92d7242c-e60b-485c-874a-e82a7b8f241b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.613338 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.613329 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92d7242c-e60b-485c-874a-e82a7b8f241b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.613458 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.613388 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92d7242c-e60b-485c-874a-e82a7b8f241b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.613458 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.613416 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/92d7242c-e60b-485c-874a-e82a7b8f241b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.613458 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.613447 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92d7242c-e60b-485c-874a-e82a7b8f241b-config-out\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.613553 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.613462 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7tnw\" (UniqueName: \"kubernetes.io/projected/92d7242c-e60b-485c-874a-e82a7b8f241b-kube-api-access-l7tnw\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.613553 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.613501 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/92d7242c-e60b-485c-874a-e82a7b8f241b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.613553 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.613535 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92d7242c-e60b-485c-874a-e82a7b8f241b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.613641 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.613551 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92d7242c-e60b-485c-874a-e82a7b8f241b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.613641 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.613569 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/92d7242c-e60b-485c-874a-e82a7b8f241b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.613641 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.613590 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/92d7242c-e60b-485c-874a-e82a7b8f241b-config\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.613641 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.613610 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92d7242c-e60b-485c-874a-e82a7b8f241b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.613641 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.613630 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92d7242c-e60b-485c-874a-e82a7b8f241b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.613782 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.613650 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/92d7242c-e60b-485c-874a-e82a7b8f241b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.613782 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.613722 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/92d7242c-e60b-485c-874a-e82a7b8f241b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.613782 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.613749 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/92d7242c-e60b-485c-874a-e82a7b8f241b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.613782 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.613772 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92d7242c-e60b-485c-874a-e82a7b8f241b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.714882 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.714851 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/92d7242c-e60b-485c-874a-e82a7b8f241b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.715017 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.714890 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92d7242c-e60b-485c-874a-e82a7b8f241b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.715017 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.714933 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92d7242c-e60b-485c-874a-e82a7b8f241b-web-config\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.715017 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.714962 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/92d7242c-e60b-485c-874a-e82a7b8f241b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.715172 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.715040 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92d7242c-e60b-485c-874a-e82a7b8f241b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.715172 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.715075 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92d7242c-e60b-485c-874a-e82a7b8f241b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.715172 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.715101 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/92d7242c-e60b-485c-874a-e82a7b8f241b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.715172 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.715141 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92d7242c-e60b-485c-874a-e82a7b8f241b-config-out\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.715172 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.715167 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7tnw\" (UniqueName: \"kubernetes.io/projected/92d7242c-e60b-485c-874a-e82a7b8f241b-kube-api-access-l7tnw\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.715406 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.715229 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/92d7242c-e60b-485c-874a-e82a7b8f241b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.715406 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.715262 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92d7242c-e60b-485c-874a-e82a7b8f241b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.715406 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.715290 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92d7242c-e60b-485c-874a-e82a7b8f241b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.715406 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.715318 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/92d7242c-e60b-485c-874a-e82a7b8f241b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.715604 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.715444 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/92d7242c-e60b-485c-874a-e82a7b8f241b-config\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.715604 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.715475 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92d7242c-e60b-485c-874a-e82a7b8f241b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.715604 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.715513 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92d7242c-e60b-485c-874a-e82a7b8f241b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.715604 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.715546 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/92d7242c-e60b-485c-874a-e82a7b8f241b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.715604 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.715583 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/92d7242c-e60b-485c-874a-e82a7b8f241b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.715835 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.715585 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/92d7242c-e60b-485c-874a-e82a7b8f241b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.715835 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.715647 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/92d7242c-e60b-485c-874a-e82a7b8f241b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.715835 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.715700 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92d7242c-e60b-485c-874a-e82a7b8f241b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.716002 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.715840 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/92d7242c-e60b-485c-874a-e82a7b8f241b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.717504 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.717478 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/92d7242c-e60b-485c-874a-e82a7b8f241b-config-out\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.718327 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.718070 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 10 03:37:20.718327 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.718160 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 10 03:37:20.718327 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.718168 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cdcl74oeiuqq3\"" Jul 10 03:37:20.718327 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.718175 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 10 03:37:20.718327 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.718267 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 10 03:37:20.718327 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.718161 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 10 03:37:20.718327 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.718298 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 10 03:37:20.718712 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.718399 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 10 03:37:20.718712 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.718542 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 10 03:37:20.718712 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.718551 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 10 03:37:20.718712 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.718611 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 10 03:37:20.719026 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.719009 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 10 03:37:20.719108 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.719090 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 10 03:37:20.719163 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.719099 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 10 03:37:20.720347 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.720332 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 10 03:37:20.724275 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.724254 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7tnw\" (UniqueName: \"kubernetes.io/projected/92d7242c-e60b-485c-874a-e82a7b8f241b-kube-api-access-l7tnw\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.725853 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.725031 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 10 03:37:20.725853 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.725583 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/92d7242c-e60b-485c-874a-e82a7b8f241b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.726307 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.726251 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/92d7242c-e60b-485c-874a-e82a7b8f241b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.727328 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.727301 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92d7242c-e60b-485c-874a-e82a7b8f241b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.728544 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.728515 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/92d7242c-e60b-485c-874a-e82a7b8f241b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.730632 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.730603 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/92d7242c-e60b-485c-874a-e82a7b8f241b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.731143 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.731123 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92d7242c-e60b-485c-874a-e82a7b8f241b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.732058 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.731903 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/92d7242c-e60b-485c-874a-e82a7b8f241b-config\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.732058 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.731994 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/92d7242c-e60b-485c-874a-e82a7b8f241b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.732442 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.732414 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/92d7242c-e60b-485c-874a-e82a7b8f241b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.733366 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.733341 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/92d7242c-e60b-485c-874a-e82a7b8f241b-web-config\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.735033 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.734381 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/92d7242c-e60b-485c-874a-e82a7b8f241b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.735033 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.734393 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/92d7242c-e60b-485c-874a-e82a7b8f241b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.735033 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.734792 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/92d7242c-e60b-485c-874a-e82a7b8f241b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.735033 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.734894 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/92d7242c-e60b-485c-874a-e82a7b8f241b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.739630 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.738171 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/92d7242c-e60b-485c-874a-e82a7b8f241b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.740817 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.740793 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/92d7242c-e60b-485c-874a-e82a7b8f241b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"92d7242c-e60b-485c-874a-e82a7b8f241b\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.764773 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.764733 2582 kubelet.go:1648] "Image garbage collection succeeded" Jul 10 03:37:20.816091 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.816071 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-sbshm\"" Jul 10 03:37:20.823967 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.823946 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:20.913204 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.913168 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"85d00d25-f032-411d-83e5-1d846ec420a9","Type":"ContainerStarted","Data":"81a13001a902e6aa84a8b76f568359f439e152e301c210b779871427df227882"} Jul 10 03:37:20.937929 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.937766 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.708613627 podStartE2EDuration="5.937749504s" totalImagesPullingTime="3.214167788s" totalInitContainerRuntime="14.968089ms" isStatefulPod=false podCreationTimestamp="2026-07-10 03:37:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:37:20.936699756 +0000 UTC m=+300.588511405" watchObservedRunningTime="2026-07-10 03:37:20.937749504 +0000 UTC m=+300.589561154" Jul 10 03:37:20.961840 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.961500 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 03:37:20.963820 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:37:20.963794 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92d7242c_e60b_485c_874a_e82a7b8f241b.slice/crio-2b4cc3c57f4f3b6f537df50958da9dd5e180f25b7e485b8cf0a849984bafc5fc WatchSource:0}: Error finding container 2b4cc3c57f4f3b6f537df50958da9dd5e180f25b7e485b8cf0a849984bafc5fc: Status 404 returned error can't find the container with id 2b4cc3c57f4f3b6f537df50958da9dd5e180f25b7e485b8cf0a849984bafc5fc Jul 10 03:37:20.985926 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.985884 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c84dd6555-qd26f" Jul 10 03:37:20.989784 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:20.989764 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c84dd6555-qd26f" Jul 10 03:37:21.918623 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:21.918587 2582 generic.go:356] "Generic (PLEG): container finished" podID="92d7242c-e60b-485c-874a-e82a7b8f241b" containerID="b00a928c0cf9b62c087dce01ba51f35771c1e56f6b63efed50eac3e9d17f12a2" exitCode=0 Jul 10 03:37:21.919061 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:21.918673 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92d7242c-e60b-485c-874a-e82a7b8f241b","Type":"ContainerDied","Data":"b00a928c0cf9b62c087dce01ba51f35771c1e56f6b63efed50eac3e9d17f12a2"} Jul 10 03:37:21.919061 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:21.918766 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92d7242c-e60b-485c-874a-e82a7b8f241b","Type":"ContainerStarted","Data":"2b4cc3c57f4f3b6f537df50958da9dd5e180f25b7e485b8cf0a849984bafc5fc"} Jul 10 03:37:25.208403 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:25.208379 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 03:37:25.938726 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:25.938689 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92d7242c-e60b-485c-874a-e82a7b8f241b","Type":"ContainerStarted","Data":"2a56b617e27a6756fa8434fe09f4fbce6f62476f8aa8fff31803ca07cc716f01"} Jul 10 03:37:25.938876 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:25.938759 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92d7242c-e60b-485c-874a-e82a7b8f241b","Type":"ContainerStarted","Data":"d575e5c48c20a484a4900b9f02678cfa5d92077e594f191691f5ae0ab317cb3d"} Jul 10 03:37:26.878653 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:26.878455 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:37:26.945737 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:26.945710 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92d7242c-e60b-485c-874a-e82a7b8f241b","Type":"ContainerStarted","Data":"8b3334b5779e7a8bdd7393df271e4e46229e64de67897cb1f28566cc7d00dded"} Jul 10 03:37:27.952786 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:27.952753 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92d7242c-e60b-485c-874a-e82a7b8f241b","Type":"ContainerStarted","Data":"4c27ecdf560f18f85ebfd50e9c600e9a50616eece8282afdd588664892878bce"} Jul 10 03:37:27.953289 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:27.952822 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92d7242c-e60b-485c-874a-e82a7b8f241b","Type":"ContainerStarted","Data":"9286d4a96b947df8455f10b1f0192cba9b64caa771cc2042fb4316568ff6ef08"} Jul 10 03:37:27.953289 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:27.952860 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"92d7242c-e60b-485c-874a-e82a7b8f241b","Type":"ContainerStarted","Data":"b9b567eef1622dcb9d25096db4599a45e409833283239fda1b58d6bb8d2d1b36"} Jul 10 03:37:27.978516 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:27.978467 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.17965819 podStartE2EDuration="7.978446911s" totalImagesPullingTime="4.77892462s" totalInitContainerRuntime="19.864101ms" isStatefulPod=false podCreationTimestamp="2026-07-10 03:37:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:37:27.976296476 +0000 UTC m=+307.628108130" watchObservedRunningTime="2026-07-10 03:37:27.978446911 +0000 UTC m=+307.630258560" Jul 10 03:37:30.824318 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:30.824278 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:37:36.181857 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:36.181826 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c84dd6555-qd26f"] Jul 10 03:37:53.056349 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:53.056303 2582 generic.go:356] "Generic (PLEG): container finished" podID="92394405-5015-4182-839f-1e023ad37b24" containerID="4b5fda5e8c99f5559fb4af9c144cd4c2b12b517e9b8d7cc3058a8418903660b4" exitCode=0 Jul 10 03:37:53.056691 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:53.056373 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qbmht" event={"ID":"92394405-5015-4182-839f-1e023ad37b24","Type":"ContainerDied","Data":"4b5fda5e8c99f5559fb4af9c144cd4c2b12b517e9b8d7cc3058a8418903660b4"} Jul 10 03:37:53.056691 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:53.056655 2582 scope.go:117] "RemoveContainer" containerID="4b5fda5e8c99f5559fb4af9c144cd4c2b12b517e9b8d7cc3058a8418903660b4" Jul 10 03:37:54.061791 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:37:54.061759 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-qbmht" event={"ID":"92394405-5015-4182-839f-1e023ad37b24","Type":"ContainerStarted","Data":"54b3a95bbda1b89600c9e51b7b6886672144c15342ebe02d6136bd5d11020960"} Jul 10 03:38:01.203871 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:01.203828 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6c84dd6555-qd26f" podUID="0f54e5a2-0d31-44db-9d02-89d6c145ea9e" containerName="console" containerID="cri-o://a847a0760ed034b5b91deb9849315c6baaaf3d24112d1970a557c40ccce52c25" gracePeriod=15 Jul 10 03:38:01.440451 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:01.440429 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c84dd6555-qd26f" Jul 10 03:38:01.461617 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:01.461562 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-trusted-ca-bundle\") pod \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\" (UID: \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\") " Jul 10 03:38:01.461617 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:01.461603 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-console-config\") pod \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\" (UID: \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\") " Jul 10 03:38:01.461785 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:01.461676 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-oauth-serving-cert\") pod \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\" (UID: \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\") " Jul 10 03:38:01.461785 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:01.461707 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-console-serving-cert\") pod \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\" (UID: \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\") " Jul 10 03:38:01.461785 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:01.461730 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-service-ca\") pod \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\" (UID: \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\") " Jul 10 03:38:01.461785 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:01.461759 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-console-oauth-config\") pod \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\" (UID: \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\") " Jul 10 03:38:01.462008 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:01.461814 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dt6c7\" (UniqueName: \"kubernetes.io/projected/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-kube-api-access-dt6c7\") pod \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\" (UID: \"0f54e5a2-0d31-44db-9d02-89d6c145ea9e\") " Jul 10 03:38:01.462075 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:01.462044 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0f54e5a2-0d31-44db-9d02-89d6c145ea9e" (UID: "0f54e5a2-0d31-44db-9d02-89d6c145ea9e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 03:38:01.462137 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:01.462099 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-console-config" (OuterVolumeSpecName: "console-config") pod "0f54e5a2-0d31-44db-9d02-89d6c145ea9e" (UID: "0f54e5a2-0d31-44db-9d02-89d6c145ea9e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 03:38:01.462192 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:01.462167 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-service-ca" (OuterVolumeSpecName: "service-ca") pod "0f54e5a2-0d31-44db-9d02-89d6c145ea9e" (UID: "0f54e5a2-0d31-44db-9d02-89d6c145ea9e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 03:38:01.462289 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:01.462266 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "0f54e5a2-0d31-44db-9d02-89d6c145ea9e" (UID: "0f54e5a2-0d31-44db-9d02-89d6c145ea9e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 03:38:01.463881 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:01.463859 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0f54e5a2-0d31-44db-9d02-89d6c145ea9e" (UID: "0f54e5a2-0d31-44db-9d02-89d6c145ea9e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 03:38:01.464214 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:01.464189 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0f54e5a2-0d31-44db-9d02-89d6c145ea9e" (UID: "0f54e5a2-0d31-44db-9d02-89d6c145ea9e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 03:38:01.464333 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:01.464309 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-kube-api-access-dt6c7" (OuterVolumeSpecName: "kube-api-access-dt6c7") pod "0f54e5a2-0d31-44db-9d02-89d6c145ea9e" (UID: "0f54e5a2-0d31-44db-9d02-89d6c145ea9e"). InnerVolumeSpecName "kube-api-access-dt6c7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 03:38:01.562416 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:01.562382 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dt6c7\" (UniqueName: \"kubernetes.io/projected/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-kube-api-access-dt6c7\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jul 10 03:38:01.562416 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:01.562406 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-trusted-ca-bundle\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jul 10 03:38:01.562416 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:01.562417 2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-console-config\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jul 10 03:38:01.562644 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:01.562425 2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-oauth-serving-cert\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jul 10 03:38:01.562644 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:01.562433 2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-console-serving-cert\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jul 10 03:38:01.562644 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:01.562442 2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-service-ca\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jul 10 03:38:01.562644 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:01.562449 2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0f54e5a2-0d31-44db-9d02-89d6c145ea9e-console-oauth-config\") on node \"ip-10-0-129-177.ec2.internal\" DevicePath \"\"" Jul 10 03:38:02.096960 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:02.096903 2582 generic.go:356] "Generic (PLEG): container finished" podID="0f54e5a2-0d31-44db-9d02-89d6c145ea9e" containerID="a847a0760ed034b5b91deb9849315c6baaaf3d24112d1970a557c40ccce52c25" exitCode=0 Jul 10 03:38:02.096960 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:02.096942 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c84dd6555-qd26f" event={"ID":"0f54e5a2-0d31-44db-9d02-89d6c145ea9e","Type":"ContainerDied","Data":"a847a0760ed034b5b91deb9849315c6baaaf3d24112d1970a557c40ccce52c25"} Jul 10 03:38:02.097183 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:02.096972 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c84dd6555-qd26f" Jul 10 03:38:02.097183 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:02.096997 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c84dd6555-qd26f" event={"ID":"0f54e5a2-0d31-44db-9d02-89d6c145ea9e","Type":"ContainerDied","Data":"7fd03544579ac5ab8e90aefbcc513c651eee6f5cecb8005bc62afc7a1194520c"} Jul 10 03:38:02.097183 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:02.097017 2582 scope.go:117] "RemoveContainer" containerID="a847a0760ed034b5b91deb9849315c6baaaf3d24112d1970a557c40ccce52c25" Jul 10 03:38:02.105521 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:02.105505 2582 scope.go:117] "RemoveContainer" containerID="a847a0760ed034b5b91deb9849315c6baaaf3d24112d1970a557c40ccce52c25" Jul 10 03:38:02.105750 ip-10-0-129-177 kubenswrapper[2582]: E0710 03:38:02.105734 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a847a0760ed034b5b91deb9849315c6baaaf3d24112d1970a557c40ccce52c25\": container with ID starting with a847a0760ed034b5b91deb9849315c6baaaf3d24112d1970a557c40ccce52c25 not found: ID does not exist" containerID="a847a0760ed034b5b91deb9849315c6baaaf3d24112d1970a557c40ccce52c25" Jul 10 03:38:02.105814 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:02.105757 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a847a0760ed034b5b91deb9849315c6baaaf3d24112d1970a557c40ccce52c25"} err="failed to get container status \"a847a0760ed034b5b91deb9849315c6baaaf3d24112d1970a557c40ccce52c25\": rpc error: code = NotFound desc = could not find container \"a847a0760ed034b5b91deb9849315c6baaaf3d24112d1970a557c40ccce52c25\": container with ID starting with a847a0760ed034b5b91deb9849315c6baaaf3d24112d1970a557c40ccce52c25 not found: ID does not exist" Jul 10 03:38:02.116547 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:02.116525 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c84dd6555-qd26f"] Jul 10 03:38:02.117771 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:02.117753 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c84dd6555-qd26f"] Jul 10 03:38:02.883870 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:02.883829 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f54e5a2-0d31-44db-9d02-89d6c145ea9e" path="/var/lib/kubelet/pods/0f54e5a2-0d31-44db-9d02-89d6c145ea9e/volumes" Jul 10 03:38:20.824760 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:20.824733 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:38:20.840006 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:20.839985 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:38:21.189964 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:21.189869 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 03:38:34.750653 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:34.750620 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-metrics-certs\") pod \"network-metrics-daemon-ddntq\" (UID: \"b78bc3c1-3658-4cdd-ba93-30d686b78aa5\") " pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:38:34.752846 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:34.752827 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b78bc3c1-3658-4cdd-ba93-30d686b78aa5-metrics-certs\") pod \"network-metrics-daemon-ddntq\" (UID: \"b78bc3c1-3658-4cdd-ba93-30d686b78aa5\") " pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:38:34.981826 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:34.981801 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-sg5lf\"" Jul 10 03:38:34.990590 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:34.990569 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ddntq" Jul 10 03:38:35.116656 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:35.116633 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ddntq"] Jul 10 03:38:35.119431 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:38:35.119404 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb78bc3c1_3658_4cdd_ba93_30d686b78aa5.slice/crio-86a9ddfcc309ff4acf0b48f8e403af09a242782af0f8c599233ecee01a17a20b WatchSource:0}: Error finding container 86a9ddfcc309ff4acf0b48f8e403af09a242782af0f8c599233ecee01a17a20b: Status 404 returned error can't find the container with id 86a9ddfcc309ff4acf0b48f8e403af09a242782af0f8c599233ecee01a17a20b Jul 10 03:38:35.230453 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:35.230421 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ddntq" event={"ID":"b78bc3c1-3658-4cdd-ba93-30d686b78aa5","Type":"ContainerStarted","Data":"86a9ddfcc309ff4acf0b48f8e403af09a242782af0f8c599233ecee01a17a20b"} Jul 10 03:38:37.242186 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:37.242148 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ddntq" event={"ID":"b78bc3c1-3658-4cdd-ba93-30d686b78aa5","Type":"ContainerStarted","Data":"3b97e314bf5887a0f77d934b98e05227bbb40b9bdaf01e3672c45a78615f3808"} Jul 10 03:38:37.242591 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:37.242200 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ddntq" event={"ID":"b78bc3c1-3658-4cdd-ba93-30d686b78aa5","Type":"ContainerStarted","Data":"73ba14a14f5188cf94c3550fe81b905e086eb7c7baa0c17c06e5cab96f3628ec"} Jul 10 03:38:37.258886 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:38:37.258839 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ddntq" podStartSLOduration=375.192436637 podStartE2EDuration="6m16.258822422s" totalImagesPullingTime="1.066385785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:32:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:38:37.256958885 +0000 UTC m=+376.908770535" watchObservedRunningTime="2026-07-10 03:38:37.258822422 +0000 UTC m=+376.910634071" Jul 10 03:40:00.777811 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:00.777731 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-thtqd"] Jul 10 03:40:00.778318 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:00.778072 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f54e5a2-0d31-44db-9d02-89d6c145ea9e" containerName="console" Jul 10 03:40:00.778318 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:00.778084 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f54e5a2-0d31-44db-9d02-89d6c145ea9e" containerName="console" Jul 10 03:40:00.778318 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:00.778142 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f54e5a2-0d31-44db-9d02-89d6c145ea9e" containerName="console" Jul 10 03:40:00.781442 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:00.781424 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-thtqd" Jul 10 03:40:00.784112 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:00.784091 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-srwkv\"" Jul 10 03:40:00.784208 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:00.784111 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 10 03:40:00.784367 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:00.784349 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 10 03:40:00.797026 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:00.797003 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-thtqd"] Jul 10 03:40:00.823170 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:00.823144 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bd7zp\" (UniqueName: \"kubernetes.io/projected/53026e9f-d3c7-48b2-a52b-9e0565254b3d-kube-api-access-bd7zp\") pod \"openshift-lws-operator-fd8ccff4c-thtqd\" (UID: \"53026e9f-d3c7-48b2-a52b-9e0565254b3d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-thtqd" Jul 10 03:40:00.823260 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:00.823191 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53026e9f-d3c7-48b2-a52b-9e0565254b3d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-thtqd\" (UID: \"53026e9f-d3c7-48b2-a52b-9e0565254b3d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-thtqd" Jul 10 03:40:00.924185 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:00.924156 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bd7zp\" (UniqueName: \"kubernetes.io/projected/53026e9f-d3c7-48b2-a52b-9e0565254b3d-kube-api-access-bd7zp\") pod \"openshift-lws-operator-fd8ccff4c-thtqd\" (UID: \"53026e9f-d3c7-48b2-a52b-9e0565254b3d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-thtqd" Jul 10 03:40:00.924337 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:00.924202 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53026e9f-d3c7-48b2-a52b-9e0565254b3d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-thtqd\" (UID: \"53026e9f-d3c7-48b2-a52b-9e0565254b3d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-thtqd" Jul 10 03:40:00.924521 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:00.924506 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53026e9f-d3c7-48b2-a52b-9e0565254b3d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-thtqd\" (UID: \"53026e9f-d3c7-48b2-a52b-9e0565254b3d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-thtqd" Jul 10 03:40:00.937695 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:00.937668 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bd7zp\" (UniqueName: \"kubernetes.io/projected/53026e9f-d3c7-48b2-a52b-9e0565254b3d-kube-api-access-bd7zp\") pod \"openshift-lws-operator-fd8ccff4c-thtqd\" (UID: \"53026e9f-d3c7-48b2-a52b-9e0565254b3d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-thtqd" Jul 10 03:40:01.089928 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:01.089839 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-thtqd" Jul 10 03:40:01.215480 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:01.215449 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-thtqd"] Jul 10 03:40:01.217940 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:40:01.217898 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod53026e9f_d3c7_48b2_a52b_9e0565254b3d.slice/crio-18342ac5b5b1da0720001adc120babd31b150ed501814846761ac2753940d2f0 WatchSource:0}: Error finding container 18342ac5b5b1da0720001adc120babd31b150ed501814846761ac2753940d2f0: Status 404 returned error can't find the container with id 18342ac5b5b1da0720001adc120babd31b150ed501814846761ac2753940d2f0 Jul 10 03:40:01.557598 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:01.557562 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-thtqd" event={"ID":"53026e9f-d3c7-48b2-a52b-9e0565254b3d","Type":"ContainerStarted","Data":"18342ac5b5b1da0720001adc120babd31b150ed501814846761ac2753940d2f0"} Jul 10 03:40:05.577424 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:05.577389 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-thtqd" event={"ID":"53026e9f-d3c7-48b2-a52b-9e0565254b3d","Type":"ContainerStarted","Data":"c9fe45ed048f668abd9ee7ff552c3eacf47f44b288625496b5affbfd4be8219c"} Jul 10 03:40:05.623584 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:05.623535 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-thtqd" podStartSLOduration=1.882914554 podStartE2EDuration="5.623519493s" totalImagesPullingTime="3.740604939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:40:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:40:05.623186154 +0000 UTC m=+465.274997803" watchObservedRunningTime="2026-07-10 03:40:05.623519493 +0000 UTC m=+465.275331143" Jul 10 03:40:21.117962 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:21.117932 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d676bbf4b-2zcrr"] Jul 10 03:40:21.121489 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:21.121473 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d676bbf4b-2zcrr" Jul 10 03:40:21.123722 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:21.123703 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 10 03:40:21.123968 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:21.123952 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 10 03:40:21.124039 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:21.123964 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 10 03:40:21.124143 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:21.124126 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 10 03:40:21.124223 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:21.124138 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mzf2m\"" Jul 10 03:40:21.136750 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:21.136725 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d676bbf4b-2zcrr"] Jul 10 03:40:21.163611 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:21.163590 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4ktj\" (UniqueName: \"kubernetes.io/projected/30d60bf0-6f49-48fc-9a31-42d83fae2ea9-kube-api-access-r4ktj\") pod \"opendatahub-operator-controller-manager-7d676bbf4b-2zcrr\" (UID: \"30d60bf0-6f49-48fc-9a31-42d83fae2ea9\") " pod="opendatahub/opendatahub-operator-controller-manager-7d676bbf4b-2zcrr" Jul 10 03:40:21.163707 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:21.163634 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/30d60bf0-6f49-48fc-9a31-42d83fae2ea9-manifests\") pod \"opendatahub-operator-controller-manager-7d676bbf4b-2zcrr\" (UID: \"30d60bf0-6f49-48fc-9a31-42d83fae2ea9\") " pod="opendatahub/opendatahub-operator-controller-manager-7d676bbf4b-2zcrr" Jul 10 03:40:21.163707 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:21.163666 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30d60bf0-6f49-48fc-9a31-42d83fae2ea9-tmp\") pod \"opendatahub-operator-controller-manager-7d676bbf4b-2zcrr\" (UID: \"30d60bf0-6f49-48fc-9a31-42d83fae2ea9\") " pod="opendatahub/opendatahub-operator-controller-manager-7d676bbf4b-2zcrr" Jul 10 03:40:21.163707 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:21.163692 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/30d60bf0-6f49-48fc-9a31-42d83fae2ea9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d676bbf4b-2zcrr\" (UID: \"30d60bf0-6f49-48fc-9a31-42d83fae2ea9\") " pod="opendatahub/opendatahub-operator-controller-manager-7d676bbf4b-2zcrr" Jul 10 03:40:21.163810 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:21.163716 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/30d60bf0-6f49-48fc-9a31-42d83fae2ea9-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d676bbf4b-2zcrr\" (UID: \"30d60bf0-6f49-48fc-9a31-42d83fae2ea9\") " pod="opendatahub/opendatahub-operator-controller-manager-7d676bbf4b-2zcrr" Jul 10 03:40:21.264159 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:21.264135 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/30d60bf0-6f49-48fc-9a31-42d83fae2ea9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d676bbf4b-2zcrr\" (UID: \"30d60bf0-6f49-48fc-9a31-42d83fae2ea9\") " pod="opendatahub/opendatahub-operator-controller-manager-7d676bbf4b-2zcrr" Jul 10 03:40:21.264313 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:21.264171 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/30d60bf0-6f49-48fc-9a31-42d83fae2ea9-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d676bbf4b-2zcrr\" (UID: \"30d60bf0-6f49-48fc-9a31-42d83fae2ea9\") " pod="opendatahub/opendatahub-operator-controller-manager-7d676bbf4b-2zcrr" Jul 10 03:40:21.264366 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:21.264308 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4ktj\" (UniqueName: \"kubernetes.io/projected/30d60bf0-6f49-48fc-9a31-42d83fae2ea9-kube-api-access-r4ktj\") pod \"opendatahub-operator-controller-manager-7d676bbf4b-2zcrr\" (UID: \"30d60bf0-6f49-48fc-9a31-42d83fae2ea9\") " pod="opendatahub/opendatahub-operator-controller-manager-7d676bbf4b-2zcrr" Jul 10 03:40:21.264407 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:21.264380 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/30d60bf0-6f49-48fc-9a31-42d83fae2ea9-manifests\") pod \"opendatahub-operator-controller-manager-7d676bbf4b-2zcrr\" (UID: \"30d60bf0-6f49-48fc-9a31-42d83fae2ea9\") " pod="opendatahub/opendatahub-operator-controller-manager-7d676bbf4b-2zcrr" Jul 10 03:40:21.264449 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:21.264412 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30d60bf0-6f49-48fc-9a31-42d83fae2ea9-tmp\") pod \"opendatahub-operator-controller-manager-7d676bbf4b-2zcrr\" (UID: \"30d60bf0-6f49-48fc-9a31-42d83fae2ea9\") " pod="opendatahub/opendatahub-operator-controller-manager-7d676bbf4b-2zcrr" Jul 10 03:40:21.264755 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:21.264727 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/30d60bf0-6f49-48fc-9a31-42d83fae2ea9-manifests\") pod \"opendatahub-operator-controller-manager-7d676bbf4b-2zcrr\" (UID: \"30d60bf0-6f49-48fc-9a31-42d83fae2ea9\") " pod="opendatahub/opendatahub-operator-controller-manager-7d676bbf4b-2zcrr" Jul 10 03:40:21.266383 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:21.266362 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30d60bf0-6f49-48fc-9a31-42d83fae2ea9-tmp\") pod \"opendatahub-operator-controller-manager-7d676bbf4b-2zcrr\" (UID: \"30d60bf0-6f49-48fc-9a31-42d83fae2ea9\") " pod="opendatahub/opendatahub-operator-controller-manager-7d676bbf4b-2zcrr" Jul 10 03:40:21.266519 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:21.266502 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/30d60bf0-6f49-48fc-9a31-42d83fae2ea9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d676bbf4b-2zcrr\" (UID: \"30d60bf0-6f49-48fc-9a31-42d83fae2ea9\") " pod="opendatahub/opendatahub-operator-controller-manager-7d676bbf4b-2zcrr" Jul 10 03:40:21.266584 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:21.266572 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/30d60bf0-6f49-48fc-9a31-42d83fae2ea9-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d676bbf4b-2zcrr\" (UID: \"30d60bf0-6f49-48fc-9a31-42d83fae2ea9\") " pod="opendatahub/opendatahub-operator-controller-manager-7d676bbf4b-2zcrr" Jul 10 03:40:21.271654 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:21.271634 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4ktj\" (UniqueName: \"kubernetes.io/projected/30d60bf0-6f49-48fc-9a31-42d83fae2ea9-kube-api-access-r4ktj\") pod \"opendatahub-operator-controller-manager-7d676bbf4b-2zcrr\" (UID: \"30d60bf0-6f49-48fc-9a31-42d83fae2ea9\") " pod="opendatahub/opendatahub-operator-controller-manager-7d676bbf4b-2zcrr" Jul 10 03:40:21.432028 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:21.431944 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d676bbf4b-2zcrr" Jul 10 03:40:21.579076 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:21.579053 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d676bbf4b-2zcrr"] Jul 10 03:40:21.581227 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:40:21.581203 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30d60bf0_6f49_48fc_9a31_42d83fae2ea9.slice/crio-168fd4c2e88c363560e7b23a6ed34614d65e5a60503dc5acfdac0974270eaf37 WatchSource:0}: Error finding container 168fd4c2e88c363560e7b23a6ed34614d65e5a60503dc5acfdac0974270eaf37: Status 404 returned error can't find the container with id 168fd4c2e88c363560e7b23a6ed34614d65e5a60503dc5acfdac0974270eaf37 Jul 10 03:40:21.640071 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:21.640043 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d676bbf4b-2zcrr" event={"ID":"30d60bf0-6f49-48fc-9a31-42d83fae2ea9","Type":"ContainerStarted","Data":"168fd4c2e88c363560e7b23a6ed34614d65e5a60503dc5acfdac0974270eaf37"} Jul 10 03:40:24.656203 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:24.656169 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d676bbf4b-2zcrr" event={"ID":"30d60bf0-6f49-48fc-9a31-42d83fae2ea9","Type":"ContainerStarted","Data":"6e7b70b18c5311be6b742f1f115241ffb4b4db5e32feba469d3b4941941eab40"} Jul 10 03:40:25.662450 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:25.662414 2582 generic.go:356] "Generic (PLEG): container finished" podID="30d60bf0-6f49-48fc-9a31-42d83fae2ea9" containerID="6e7b70b18c5311be6b742f1f115241ffb4b4db5e32feba469d3b4941941eab40" exitCode=0 Jul 10 03:40:25.662800 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:25.662487 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d676bbf4b-2zcrr" event={"ID":"30d60bf0-6f49-48fc-9a31-42d83fae2ea9","Type":"ContainerDied","Data":"6e7b70b18c5311be6b742f1f115241ffb4b4db5e32feba469d3b4941941eab40"} Jul 10 03:40:26.668658 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:26.668623 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d676bbf4b-2zcrr" event={"ID":"30d60bf0-6f49-48fc-9a31-42d83fae2ea9","Type":"ContainerStarted","Data":"fd04010679e429d1f2c1e783d7db981fc2b82402121bc574a079409dc1bd9eb6"} Jul 10 03:40:26.669087 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:26.668721 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d676bbf4b-2zcrr" Jul 10 03:40:26.689102 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:26.689054 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d676bbf4b-2zcrr" podStartSLOduration=1.2718159980000001 podStartE2EDuration="5.68903591s" totalImagesPullingTime="3.353464599s" totalInitContainerRuntime="1.063755313s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:40:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:40:26.688482035 +0000 UTC m=+486.340293721" watchObservedRunningTime="2026-07-10 03:40:26.68903591 +0000 UTC m=+486.340847559" Jul 10 03:40:37.675132 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:37.675104 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d676bbf4b-2zcrr" Jul 10 03:40:47.676945 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:47.676895 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6549b595fc-z2d44"] Jul 10 03:40:47.679098 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:47.679082 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6549b595fc-z2d44" Jul 10 03:40:47.682960 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:47.682932 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 10 03:40:47.682960 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:47.682945 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 10 03:40:47.683136 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:47.682936 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-j9928\"" Jul 10 03:40:47.683136 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:47.682967 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 10 03:40:47.701799 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:47.701773 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6549b595fc-z2d44"] Jul 10 03:40:47.799274 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:47.799242 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7f2jh\" (UniqueName: \"kubernetes.io/projected/2dca815b-cedc-4a7a-8afb-aa6c151b78f5-kube-api-access-7f2jh\") pod \"lws-controller-manager-6549b595fc-z2d44\" (UID: \"2dca815b-cedc-4a7a-8afb-aa6c151b78f5\") " pod="openshift-lws-operator/lws-controller-manager-6549b595fc-z2d44" Jul 10 03:40:47.799436 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:47.799304 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2dca815b-cedc-4a7a-8afb-aa6c151b78f5-manager-config\") pod \"lws-controller-manager-6549b595fc-z2d44\" (UID: \"2dca815b-cedc-4a7a-8afb-aa6c151b78f5\") " pod="openshift-lws-operator/lws-controller-manager-6549b595fc-z2d44" Jul 10 03:40:47.799436 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:47.799324 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2dca815b-cedc-4a7a-8afb-aa6c151b78f5-metrics-cert\") pod \"lws-controller-manager-6549b595fc-z2d44\" (UID: \"2dca815b-cedc-4a7a-8afb-aa6c151b78f5\") " pod="openshift-lws-operator/lws-controller-manager-6549b595fc-z2d44" Jul 10 03:40:47.799436 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:47.799355 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2dca815b-cedc-4a7a-8afb-aa6c151b78f5-cert\") pod \"lws-controller-manager-6549b595fc-z2d44\" (UID: \"2dca815b-cedc-4a7a-8afb-aa6c151b78f5\") " pod="openshift-lws-operator/lws-controller-manager-6549b595fc-z2d44" Jul 10 03:40:47.900314 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:47.900282 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7f2jh\" (UniqueName: \"kubernetes.io/projected/2dca815b-cedc-4a7a-8afb-aa6c151b78f5-kube-api-access-7f2jh\") pod \"lws-controller-manager-6549b595fc-z2d44\" (UID: \"2dca815b-cedc-4a7a-8afb-aa6c151b78f5\") " pod="openshift-lws-operator/lws-controller-manager-6549b595fc-z2d44" Jul 10 03:40:47.900512 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:47.900339 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2dca815b-cedc-4a7a-8afb-aa6c151b78f5-manager-config\") pod \"lws-controller-manager-6549b595fc-z2d44\" (UID: \"2dca815b-cedc-4a7a-8afb-aa6c151b78f5\") " pod="openshift-lws-operator/lws-controller-manager-6549b595fc-z2d44" Jul 10 03:40:47.900512 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:47.900355 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2dca815b-cedc-4a7a-8afb-aa6c151b78f5-metrics-cert\") pod \"lws-controller-manager-6549b595fc-z2d44\" (UID: \"2dca815b-cedc-4a7a-8afb-aa6c151b78f5\") " pod="openshift-lws-operator/lws-controller-manager-6549b595fc-z2d44" Jul 10 03:40:47.900512 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:47.900389 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2dca815b-cedc-4a7a-8afb-aa6c151b78f5-cert\") pod \"lws-controller-manager-6549b595fc-z2d44\" (UID: \"2dca815b-cedc-4a7a-8afb-aa6c151b78f5\") " pod="openshift-lws-operator/lws-controller-manager-6549b595fc-z2d44" Jul 10 03:40:47.901020 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:47.900992 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/2dca815b-cedc-4a7a-8afb-aa6c151b78f5-manager-config\") pod \"lws-controller-manager-6549b595fc-z2d44\" (UID: \"2dca815b-cedc-4a7a-8afb-aa6c151b78f5\") " pod="openshift-lws-operator/lws-controller-manager-6549b595fc-z2d44" Jul 10 03:40:47.902828 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:47.902808 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2dca815b-cedc-4a7a-8afb-aa6c151b78f5-cert\") pod \"lws-controller-manager-6549b595fc-z2d44\" (UID: \"2dca815b-cedc-4a7a-8afb-aa6c151b78f5\") " pod="openshift-lws-operator/lws-controller-manager-6549b595fc-z2d44" Jul 10 03:40:47.902904 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:47.902849 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2dca815b-cedc-4a7a-8afb-aa6c151b78f5-metrics-cert\") pod \"lws-controller-manager-6549b595fc-z2d44\" (UID: \"2dca815b-cedc-4a7a-8afb-aa6c151b78f5\") " pod="openshift-lws-operator/lws-controller-manager-6549b595fc-z2d44" Jul 10 03:40:47.914457 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:47.914432 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7f2jh\" (UniqueName: \"kubernetes.io/projected/2dca815b-cedc-4a7a-8afb-aa6c151b78f5-kube-api-access-7f2jh\") pod \"lws-controller-manager-6549b595fc-z2d44\" (UID: \"2dca815b-cedc-4a7a-8afb-aa6c151b78f5\") " pod="openshift-lws-operator/lws-controller-manager-6549b595fc-z2d44" Jul 10 03:40:47.988060 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:47.987989 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6549b595fc-z2d44" Jul 10 03:40:48.125829 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:48.125793 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6549b595fc-z2d44"] Jul 10 03:40:48.127370 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:40:48.127347 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dca815b_cedc_4a7a_8afb_aa6c151b78f5.slice/crio-94339e0d50181cc7cdca0590a29b12bd9f41f93a8c2f29a45cb98371e2733327 WatchSource:0}: Error finding container 94339e0d50181cc7cdca0590a29b12bd9f41f93a8c2f29a45cb98371e2733327: Status 404 returned error can't find the container with id 94339e0d50181cc7cdca0590a29b12bd9f41f93a8c2f29a45cb98371e2733327 Jul 10 03:40:48.252005 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:48.251978 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xljh4"] Jul 10 03:40:48.254744 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:48.254728 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xljh4" Jul 10 03:40:48.259306 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:48.259283 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 10 03:40:48.259406 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:48.259291 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 10 03:40:48.259613 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:48.259595 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 10 03:40:48.259821 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:48.259806 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 10 03:40:48.259858 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:48.259822 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-qdvfk\"" Jul 10 03:40:48.280866 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:48.280839 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xljh4"] Jul 10 03:40:48.404790 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:48.404751 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2537024-3dda-43d0-900d-0aab1fed2ed0-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-xljh4\" (UID: \"e2537024-3dda-43d0-900d-0aab1fed2ed0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xljh4" Jul 10 03:40:48.404790 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:48.404797 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2537024-3dda-43d0-900d-0aab1fed2ed0-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-xljh4\" (UID: \"e2537024-3dda-43d0-900d-0aab1fed2ed0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xljh4" Jul 10 03:40:48.405024 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:48.404814 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e2537024-3dda-43d0-900d-0aab1fed2ed0-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-xljh4\" (UID: \"e2537024-3dda-43d0-900d-0aab1fed2ed0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xljh4" Jul 10 03:40:48.405024 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:48.404898 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e2537024-3dda-43d0-900d-0aab1fed2ed0-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-xljh4\" (UID: \"e2537024-3dda-43d0-900d-0aab1fed2ed0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xljh4" Jul 10 03:40:48.405024 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:48.404973 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e2537024-3dda-43d0-900d-0aab1fed2ed0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-xljh4\" (UID: \"e2537024-3dda-43d0-900d-0aab1fed2ed0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xljh4" Jul 10 03:40:48.405024 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:48.405010 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e2537024-3dda-43d0-900d-0aab1fed2ed0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-xljh4\" (UID: \"e2537024-3dda-43d0-900d-0aab1fed2ed0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xljh4" Jul 10 03:40:48.405154 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:48.405060 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gjlv\" (UniqueName: \"kubernetes.io/projected/e2537024-3dda-43d0-900d-0aab1fed2ed0-kube-api-access-9gjlv\") pod \"istiod-openshift-gateway-94bb8fbfd-xljh4\" (UID: \"e2537024-3dda-43d0-900d-0aab1fed2ed0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xljh4" Jul 10 03:40:48.506149 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:48.506064 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e2537024-3dda-43d0-900d-0aab1fed2ed0-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-xljh4\" (UID: \"e2537024-3dda-43d0-900d-0aab1fed2ed0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xljh4" Jul 10 03:40:48.506149 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:48.506122 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e2537024-3dda-43d0-900d-0aab1fed2ed0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-xljh4\" (UID: \"e2537024-3dda-43d0-900d-0aab1fed2ed0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xljh4" Jul 10 03:40:48.506149 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:48.506148 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e2537024-3dda-43d0-900d-0aab1fed2ed0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-xljh4\" (UID: \"e2537024-3dda-43d0-900d-0aab1fed2ed0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xljh4" Jul 10 03:40:48.506392 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:48.506181 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gjlv\" (UniqueName: \"kubernetes.io/projected/e2537024-3dda-43d0-900d-0aab1fed2ed0-kube-api-access-9gjlv\") pod \"istiod-openshift-gateway-94bb8fbfd-xljh4\" (UID: \"e2537024-3dda-43d0-900d-0aab1fed2ed0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xljh4" Jul 10 03:40:48.506392 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:48.506206 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2537024-3dda-43d0-900d-0aab1fed2ed0-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-xljh4\" (UID: \"e2537024-3dda-43d0-900d-0aab1fed2ed0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xljh4" Jul 10 03:40:48.506392 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:48.506225 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2537024-3dda-43d0-900d-0aab1fed2ed0-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-xljh4\" (UID: \"e2537024-3dda-43d0-900d-0aab1fed2ed0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xljh4" Jul 10 03:40:48.506392 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:48.506242 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e2537024-3dda-43d0-900d-0aab1fed2ed0-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-xljh4\" (UID: \"e2537024-3dda-43d0-900d-0aab1fed2ed0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xljh4" Jul 10 03:40:48.506781 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:48.506753 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e2537024-3dda-43d0-900d-0aab1fed2ed0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-xljh4\" (UID: \"e2537024-3dda-43d0-900d-0aab1fed2ed0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xljh4" Jul 10 03:40:48.508495 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:48.508473 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2537024-3dda-43d0-900d-0aab1fed2ed0-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-xljh4\" (UID: \"e2537024-3dda-43d0-900d-0aab1fed2ed0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xljh4" Jul 10 03:40:48.508677 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:48.508653 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e2537024-3dda-43d0-900d-0aab1fed2ed0-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-xljh4\" (UID: \"e2537024-3dda-43d0-900d-0aab1fed2ed0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xljh4" Jul 10 03:40:48.508841 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:48.508826 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e2537024-3dda-43d0-900d-0aab1fed2ed0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-xljh4\" (UID: \"e2537024-3dda-43d0-900d-0aab1fed2ed0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xljh4" Jul 10 03:40:48.508886 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:48.508862 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e2537024-3dda-43d0-900d-0aab1fed2ed0-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-xljh4\" (UID: \"e2537024-3dda-43d0-900d-0aab1fed2ed0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xljh4" Jul 10 03:40:48.513956 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:48.513934 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2537024-3dda-43d0-900d-0aab1fed2ed0-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-xljh4\" (UID: \"e2537024-3dda-43d0-900d-0aab1fed2ed0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xljh4" Jul 10 03:40:48.514577 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:48.514561 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gjlv\" (UniqueName: \"kubernetes.io/projected/e2537024-3dda-43d0-900d-0aab1fed2ed0-kube-api-access-9gjlv\") pod \"istiod-openshift-gateway-94bb8fbfd-xljh4\" (UID: \"e2537024-3dda-43d0-900d-0aab1fed2ed0\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xljh4" Jul 10 03:40:48.564574 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:48.564552 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xljh4" Jul 10 03:40:48.711538 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:48.711513 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xljh4"] Jul 10 03:40:48.713175 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:40:48.713149 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2537024_3dda_43d0_900d_0aab1fed2ed0.slice/crio-ab6d2fe0c86bbd2297714167bfca59ee703c5034350543341e88f949b63c771d WatchSource:0}: Error finding container ab6d2fe0c86bbd2297714167bfca59ee703c5034350543341e88f949b63c771d: Status 404 returned error can't find the container with id ab6d2fe0c86bbd2297714167bfca59ee703c5034350543341e88f949b63c771d Jul 10 03:40:48.773959 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:48.773859 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6549b595fc-z2d44" event={"ID":"2dca815b-cedc-4a7a-8afb-aa6c151b78f5","Type":"ContainerStarted","Data":"94339e0d50181cc7cdca0590a29b12bd9f41f93a8c2f29a45cb98371e2733327"} Jul 10 03:40:48.775015 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:48.774993 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xljh4" event={"ID":"e2537024-3dda-43d0-900d-0aab1fed2ed0","Type":"ContainerStarted","Data":"ab6d2fe0c86bbd2297714167bfca59ee703c5034350543341e88f949b63c771d"} Jul 10 03:40:50.796027 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:50.795983 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6549b595fc-z2d44" event={"ID":"2dca815b-cedc-4a7a-8afb-aa6c151b78f5","Type":"ContainerStarted","Data":"bd4a3a980a10517447cf89014e95282f6c4f495149c776a30186d6c96c81018f"} Jul 10 03:40:50.796439 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:50.796104 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6549b595fc-z2d44" Jul 10 03:40:50.820423 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:50.820194 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6549b595fc-z2d44" podStartSLOduration=1.829506748 podStartE2EDuration="3.820177183s" totalImagesPullingTime="1.990670435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:40:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:40:50.819653205 +0000 UTC m=+510.471464857" watchObservedRunningTime="2026-07-10 03:40:50.820177183 +0000 UTC m=+510.471988832" Jul 10 03:40:51.240047 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:51.240003 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 03:40:51.240162 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:51.240074 2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 10 03:40:51.802392 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:51.802356 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xljh4" event={"ID":"e2537024-3dda-43d0-900d-0aab1fed2ed0","Type":"ContainerStarted","Data":"815dfdd3b04a2117123631f992b0d61fbd7b4020e4cc079fbeb1d74dd94f8977"} Jul 10 03:40:51.802763 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:51.802646 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xljh4" Jul 10 03:40:51.823137 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:51.823083 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xljh4" podStartSLOduration=1.298531696 podStartE2EDuration="3.823068552s" totalImagesPullingTime="2.524536856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:40:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:40:51.821355041 +0000 UTC m=+511.473166691" watchObservedRunningTime="2026-07-10 03:40:51.823068552 +0000 UTC m=+511.474880201" Jul 10 03:40:52.813985 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:40:52.813956 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xljh4" Jul 10 03:41:01.804529 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:41:01.804489 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6549b595fc-z2d44" Jul 10 03:43:08.937772 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:43:08.937732 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:43:08.941165 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:43:08.941147 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-xm6ch" Jul 10 03:43:08.943412 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:43:08.943388 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 10 03:43:08.944052 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:43:08.944034 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 10 03:43:08.944151 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:43:08.944042 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8p5ls\"" Jul 10 03:43:08.944151 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:43:08.944103 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 10 03:43:08.951085 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:43:08.951066 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:43:08.979610 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:43:08.979580 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2eaad7db-ab26-4ad1-a5d2-8d4352cf85cd-config-file\") pod \"limitador-limitador-54d6d988d5-xm6ch\" (UID: \"2eaad7db-ab26-4ad1-a5d2-8d4352cf85cd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xm6ch" Jul 10 03:43:08.979706 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:43:08.979641 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfkls\" (UniqueName: \"kubernetes.io/projected/2eaad7db-ab26-4ad1-a5d2-8d4352cf85cd-kube-api-access-lfkls\") pod \"limitador-limitador-54d6d988d5-xm6ch\" (UID: \"2eaad7db-ab26-4ad1-a5d2-8d4352cf85cd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xm6ch" Jul 10 03:43:08.988541 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:43:08.988516 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:43:09.080709 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:43:09.080683 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2eaad7db-ab26-4ad1-a5d2-8d4352cf85cd-config-file\") pod \"limitador-limitador-54d6d988d5-xm6ch\" (UID: \"2eaad7db-ab26-4ad1-a5d2-8d4352cf85cd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xm6ch" Jul 10 03:43:09.080851 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:43:09.080728 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfkls\" (UniqueName: \"kubernetes.io/projected/2eaad7db-ab26-4ad1-a5d2-8d4352cf85cd-kube-api-access-lfkls\") pod \"limitador-limitador-54d6d988d5-xm6ch\" (UID: \"2eaad7db-ab26-4ad1-a5d2-8d4352cf85cd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xm6ch" Jul 10 03:43:09.081362 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:43:09.081339 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2eaad7db-ab26-4ad1-a5d2-8d4352cf85cd-config-file\") pod \"limitador-limitador-54d6d988d5-xm6ch\" (UID: \"2eaad7db-ab26-4ad1-a5d2-8d4352cf85cd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xm6ch" Jul 10 03:43:09.088521 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:43:09.088499 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfkls\" (UniqueName: \"kubernetes.io/projected/2eaad7db-ab26-4ad1-a5d2-8d4352cf85cd-kube-api-access-lfkls\") pod \"limitador-limitador-54d6d988d5-xm6ch\" (UID: \"2eaad7db-ab26-4ad1-a5d2-8d4352cf85cd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-xm6ch" Jul 10 03:43:09.251656 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:43:09.251626 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-xm6ch" Jul 10 03:43:09.382426 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:43:09.382404 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:43:09.384316 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:43:09.384292 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eaad7db_ab26_4ad1_a5d2_8d4352cf85cd.slice/crio-ee060ab4a03ebeed2be6c1332533de98107de99d1e8c5bef74b3219b8e423155 WatchSource:0}: Error finding container ee060ab4a03ebeed2be6c1332533de98107de99d1e8c5bef74b3219b8e423155: Status 404 returned error can't find the container with id ee060ab4a03ebeed2be6c1332533de98107de99d1e8c5bef74b3219b8e423155 Jul 10 03:43:09.386159 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:43:09.386137 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 03:43:09.409815 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:43:09.409788 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-xm6ch" event={"ID":"2eaad7db-ab26-4ad1-a5d2-8d4352cf85cd","Type":"ContainerStarted","Data":"ee060ab4a03ebeed2be6c1332533de98107de99d1e8c5bef74b3219b8e423155"} Jul 10 03:43:12.425082 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:43:12.425040 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-xm6ch" event={"ID":"2eaad7db-ab26-4ad1-a5d2-8d4352cf85cd","Type":"ContainerStarted","Data":"d5ded0bccdddbb454eebd9b3b67cbc6b9fcc1922c2d892c4b70e7fba6fdbad45"} Jul 10 03:43:12.425490 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:43:12.425256 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-xm6ch" Jul 10 03:43:12.442843 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:43:12.442793 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-xm6ch" podStartSLOduration=2.034926342 podStartE2EDuration="4.442778089s" totalImagesPullingTime="2.407851747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:43:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:43:12.44088446 +0000 UTC m=+652.092696107" watchObservedRunningTime="2026-07-10 03:43:12.442778089 +0000 UTC m=+652.094589738" Jul 10 03:43:23.431777 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:43:23.431747 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-xm6ch" Jul 10 03:44:19.215790 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:19.215717 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:44:36.782251 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:36.782218 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5"] Jul 10 03:44:36.785811 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:36.785792 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5" Jul 10 03:44:36.788957 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:36.788936 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 10 03:44:36.789093 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:36.788986 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 10 03:44:36.789093 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:36.789017 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 10 03:44:36.789093 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:36.788990 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vxxnm\"" Jul 10 03:44:36.795625 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:36.795594 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5"] Jul 10 03:44:36.821238 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:36.821215 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2191888e-0b18-4826-a04d-ce2a584db698-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5\" (UID: \"2191888e-0b18-4826-a04d-ce2a584db698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5" Jul 10 03:44:36.821348 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:36.821269 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2191888e-0b18-4826-a04d-ce2a584db698-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5\" (UID: \"2191888e-0b18-4826-a04d-ce2a584db698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5" Jul 10 03:44:36.821348 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:36.821330 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2191888e-0b18-4826-a04d-ce2a584db698-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5\" (UID: \"2191888e-0b18-4826-a04d-ce2a584db698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5" Jul 10 03:44:36.821432 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:36.821347 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2191888e-0b18-4826-a04d-ce2a584db698-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5\" (UID: \"2191888e-0b18-4826-a04d-ce2a584db698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5" Jul 10 03:44:36.821432 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:36.821403 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2191888e-0b18-4826-a04d-ce2a584db698-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5\" (UID: \"2191888e-0b18-4826-a04d-ce2a584db698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5" Jul 10 03:44:36.821516 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:36.821445 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gghm2\" (UniqueName: \"kubernetes.io/projected/2191888e-0b18-4826-a04d-ce2a584db698-kube-api-access-gghm2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5\" (UID: \"2191888e-0b18-4826-a04d-ce2a584db698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5" Jul 10 03:44:36.922787 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:36.922762 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2191888e-0b18-4826-a04d-ce2a584db698-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5\" (UID: \"2191888e-0b18-4826-a04d-ce2a584db698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5" Jul 10 03:44:36.922955 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:36.922804 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2191888e-0b18-4826-a04d-ce2a584db698-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5\" (UID: \"2191888e-0b18-4826-a04d-ce2a584db698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5" Jul 10 03:44:36.922955 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:36.922831 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2191888e-0b18-4826-a04d-ce2a584db698-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5\" (UID: \"2191888e-0b18-4826-a04d-ce2a584db698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5" Jul 10 03:44:36.923073 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:36.922950 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2191888e-0b18-4826-a04d-ce2a584db698-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5\" (UID: \"2191888e-0b18-4826-a04d-ce2a584db698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5" Jul 10 03:44:36.923073 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:36.923037 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2191888e-0b18-4826-a04d-ce2a584db698-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5\" (UID: \"2191888e-0b18-4826-a04d-ce2a584db698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5" Jul 10 03:44:36.923174 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:36.923119 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gghm2\" (UniqueName: \"kubernetes.io/projected/2191888e-0b18-4826-a04d-ce2a584db698-kube-api-access-gghm2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5\" (UID: \"2191888e-0b18-4826-a04d-ce2a584db698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5" Jul 10 03:44:36.923245 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:36.923219 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2191888e-0b18-4826-a04d-ce2a584db698-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5\" (UID: \"2191888e-0b18-4826-a04d-ce2a584db698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5" Jul 10 03:44:36.923325 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:36.923270 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2191888e-0b18-4826-a04d-ce2a584db698-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5\" (UID: \"2191888e-0b18-4826-a04d-ce2a584db698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5" Jul 10 03:44:36.923395 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:36.923372 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2191888e-0b18-4826-a04d-ce2a584db698-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5\" (UID: \"2191888e-0b18-4826-a04d-ce2a584db698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5" Jul 10 03:44:36.925126 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:36.925107 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2191888e-0b18-4826-a04d-ce2a584db698-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5\" (UID: \"2191888e-0b18-4826-a04d-ce2a584db698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5" Jul 10 03:44:36.925293 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:36.925276 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2191888e-0b18-4826-a04d-ce2a584db698-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5\" (UID: \"2191888e-0b18-4826-a04d-ce2a584db698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5" Jul 10 03:44:36.932814 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:36.932795 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gghm2\" (UniqueName: \"kubernetes.io/projected/2191888e-0b18-4826-a04d-ce2a584db698-kube-api-access-gghm2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5\" (UID: \"2191888e-0b18-4826-a04d-ce2a584db698\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5" Jul 10 03:44:37.097207 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:37.097135 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5" Jul 10 03:44:37.226532 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:37.226494 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5"] Jul 10 03:44:37.229341 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:44:37.229309 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2191888e_0b18_4826_a04d_ce2a584db698.slice/crio-defb9dedfafa0e251d21e29f34eb0cc827445ae3388dab2560393df5c6ca2550 WatchSource:0}: Error finding container defb9dedfafa0e251d21e29f34eb0cc827445ae3388dab2560393df5c6ca2550: Status 404 returned error can't find the container with id defb9dedfafa0e251d21e29f34eb0cc827445ae3388dab2560393df5c6ca2550 Jul 10 03:44:37.584761 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:37.584726 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:44:37.797894 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:37.797856 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5" event={"ID":"2191888e-0b18-4826-a04d-ce2a584db698","Type":"ContainerStarted","Data":"defb9dedfafa0e251d21e29f34eb0cc827445ae3388dab2560393df5c6ca2550"} Jul 10 03:44:38.807385 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:38.807351 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5" event={"ID":"2191888e-0b18-4826-a04d-ce2a584db698","Type":"ContainerStarted","Data":"7402f9abad61f5f747728f18d00b7e46b367335f0efda08df582cf9ed5cfb89a"} Jul 10 03:44:38.823572 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:38.823527 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5" podStartSLOduration=1.787727343 podStartE2EDuration="2.823512348s" totalImagesPullingTime="1.035785005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:44:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:44:38.822392452 +0000 UTC m=+738.474204123" watchObservedRunningTime="2026-07-10 03:44:38.823512348 +0000 UTC m=+738.475324044" Jul 10 03:44:40.786041 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:40.786008 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:44:47.097551 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:47.097518 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5" Jul 10 03:44:47.097952 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:47.097576 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5" Jul 10 03:44:47.109774 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:47.109749 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5" Jul 10 03:44:47.857726 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:47.857698 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5" Jul 10 03:44:59.980787 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:44:59.980753 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:45:16.393283 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:16.393251 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm"] Jul 10 03:45:16.399719 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:16.399698 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm" Jul 10 03:45:16.402645 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:16.402625 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 10 03:45:16.406661 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:16.406361 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm"] Jul 10 03:45:16.570448 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:16.570418 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz2td\" (UniqueName: \"kubernetes.io/projected/94785750-820c-4b62-af77-f6622db3f8fb-kube-api-access-bz2td\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm\" (UID: \"94785750-820c-4b62-af77-f6622db3f8fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm" Jul 10 03:45:16.570613 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:16.570459 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94785750-820c-4b62-af77-f6622db3f8fb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm\" (UID: \"94785750-820c-4b62-af77-f6622db3f8fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm" Jul 10 03:45:16.570613 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:16.570481 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94785750-820c-4b62-af77-f6622db3f8fb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm\" (UID: \"94785750-820c-4b62-af77-f6622db3f8fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm" Jul 10 03:45:16.570613 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:16.570566 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94785750-820c-4b62-af77-f6622db3f8fb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm\" (UID: \"94785750-820c-4b62-af77-f6622db3f8fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm" Jul 10 03:45:16.570743 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:16.570624 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94785750-820c-4b62-af77-f6622db3f8fb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm\" (UID: \"94785750-820c-4b62-af77-f6622db3f8fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm" Jul 10 03:45:16.570743 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:16.570665 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94785750-820c-4b62-af77-f6622db3f8fb-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm\" (UID: \"94785750-820c-4b62-af77-f6622db3f8fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm" Jul 10 03:45:16.672014 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:16.671942 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94785750-820c-4b62-af77-f6622db3f8fb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm\" (UID: \"94785750-820c-4b62-af77-f6622db3f8fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm" Jul 10 03:45:16.672014 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:16.671983 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94785750-820c-4b62-af77-f6622db3f8fb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm\" (UID: \"94785750-820c-4b62-af77-f6622db3f8fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm" Jul 10 03:45:16.672206 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:16.672018 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94785750-820c-4b62-af77-f6622db3f8fb-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm\" (UID: \"94785750-820c-4b62-af77-f6622db3f8fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm" Jul 10 03:45:16.672206 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:16.672061 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz2td\" (UniqueName: \"kubernetes.io/projected/94785750-820c-4b62-af77-f6622db3f8fb-kube-api-access-bz2td\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm\" (UID: \"94785750-820c-4b62-af77-f6622db3f8fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm" Jul 10 03:45:16.672206 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:16.672092 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94785750-820c-4b62-af77-f6622db3f8fb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm\" (UID: \"94785750-820c-4b62-af77-f6622db3f8fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm" Jul 10 03:45:16.672206 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:16.672115 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94785750-820c-4b62-af77-f6622db3f8fb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm\" (UID: \"94785750-820c-4b62-af77-f6622db3f8fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm" Jul 10 03:45:16.672427 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:16.672407 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94785750-820c-4b62-af77-f6622db3f8fb-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm\" (UID: \"94785750-820c-4b62-af77-f6622db3f8fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm" Jul 10 03:45:16.672488 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:16.672404 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94785750-820c-4b62-af77-f6622db3f8fb-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm\" (UID: \"94785750-820c-4b62-af77-f6622db3f8fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm" Jul 10 03:45:16.672488 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:16.672454 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94785750-820c-4b62-af77-f6622db3f8fb-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm\" (UID: \"94785750-820c-4b62-af77-f6622db3f8fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm" Jul 10 03:45:16.674403 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:16.674376 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94785750-820c-4b62-af77-f6622db3f8fb-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm\" (UID: \"94785750-820c-4b62-af77-f6622db3f8fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm" Jul 10 03:45:16.674572 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:16.674554 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94785750-820c-4b62-af77-f6622db3f8fb-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm\" (UID: \"94785750-820c-4b62-af77-f6622db3f8fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm" Jul 10 03:45:16.679947 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:16.679926 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz2td\" (UniqueName: \"kubernetes.io/projected/94785750-820c-4b62-af77-f6622db3f8fb-kube-api-access-bz2td\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm\" (UID: \"94785750-820c-4b62-af77-f6622db3f8fb\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm" Jul 10 03:45:16.709937 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:16.709897 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm" Jul 10 03:45:16.840011 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:16.839988 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm"] Jul 10 03:45:16.842378 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:45:16.842350 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94785750_820c_4b62_af77_f6622db3f8fb.slice/crio-38a9923819e7d666cf1c147c150647d04f0df2b66b99ec45ba4942304abf1b1a WatchSource:0}: Error finding container 38a9923819e7d666cf1c147c150647d04f0df2b66b99ec45ba4942304abf1b1a: Status 404 returned error can't find the container with id 38a9923819e7d666cf1c147c150647d04f0df2b66b99ec45ba4942304abf1b1a Jul 10 03:45:16.973645 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:16.973577 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm" event={"ID":"94785750-820c-4b62-af77-f6622db3f8fb","Type":"ContainerStarted","Data":"38a9923819e7d666cf1c147c150647d04f0df2b66b99ec45ba4942304abf1b1a"} Jul 10 03:45:17.979071 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:17.979033 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm" event={"ID":"94785750-820c-4b62-af77-f6622db3f8fb","Type":"ContainerStarted","Data":"db8217d3d0238b5faedd79ed7681008cbeb6a52218be7b6e64813f936acee934"} Jul 10 03:45:17.997271 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:17.997211 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm" podStartSLOduration=1.818196138 podStartE2EDuration="1.997193406s" totalImagesPullingTime="178.997268ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:45:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:45:17.994780879 +0000 UTC m=+777.646592527" watchObservedRunningTime="2026-07-10 03:45:17.997193406 +0000 UTC m=+777.649005054" Jul 10 03:45:18.078421 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:18.078386 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:45:26.710636 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:26.710598 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm" Jul 10 03:45:26.711065 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:26.710661 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm" Jul 10 03:45:26.722935 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:26.722893 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm" Jul 10 03:45:27.028200 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:27.028173 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm" Jul 10 03:45:28.474577 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:28.474547 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dfrxv"] Jul 10 03:45:28.478194 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:28.478166 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfrxv" Jul 10 03:45:28.480665 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:28.480639 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 10 03:45:28.490896 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:28.490868 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dfrxv"] Jul 10 03:45:28.573902 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:28.573870 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e669d18-1f20-432e-9939-9b51e0bfe1d1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfrxv\" (UID: \"7e669d18-1f20-432e-9939-9b51e0bfe1d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfrxv" Jul 10 03:45:28.574148 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:28.573952 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhdb9\" (UniqueName: \"kubernetes.io/projected/7e669d18-1f20-432e-9939-9b51e0bfe1d1-kube-api-access-nhdb9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfrxv\" (UID: \"7e669d18-1f20-432e-9939-9b51e0bfe1d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfrxv" Jul 10 03:45:28.574148 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:28.573973 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e669d18-1f20-432e-9939-9b51e0bfe1d1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfrxv\" (UID: \"7e669d18-1f20-432e-9939-9b51e0bfe1d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfrxv" Jul 10 03:45:28.574148 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:28.573990 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e669d18-1f20-432e-9939-9b51e0bfe1d1-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfrxv\" (UID: \"7e669d18-1f20-432e-9939-9b51e0bfe1d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfrxv" Jul 10 03:45:28.574148 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:28.574007 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e669d18-1f20-432e-9939-9b51e0bfe1d1-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfrxv\" (UID: \"7e669d18-1f20-432e-9939-9b51e0bfe1d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfrxv" Jul 10 03:45:28.574148 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:28.574104 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e669d18-1f20-432e-9939-9b51e0bfe1d1-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfrxv\" (UID: \"7e669d18-1f20-432e-9939-9b51e0bfe1d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfrxv" Jul 10 03:45:28.675122 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:28.675078 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhdb9\" (UniqueName: \"kubernetes.io/projected/7e669d18-1f20-432e-9939-9b51e0bfe1d1-kube-api-access-nhdb9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfrxv\" (UID: \"7e669d18-1f20-432e-9939-9b51e0bfe1d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfrxv" Jul 10 03:45:28.675122 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:28.675121 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e669d18-1f20-432e-9939-9b51e0bfe1d1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfrxv\" (UID: \"7e669d18-1f20-432e-9939-9b51e0bfe1d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfrxv" Jul 10 03:45:28.675310 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:28.675143 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e669d18-1f20-432e-9939-9b51e0bfe1d1-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfrxv\" (UID: \"7e669d18-1f20-432e-9939-9b51e0bfe1d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfrxv" Jul 10 03:45:28.675310 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:28.675189 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e669d18-1f20-432e-9939-9b51e0bfe1d1-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfrxv\" (UID: \"7e669d18-1f20-432e-9939-9b51e0bfe1d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfrxv" Jul 10 03:45:28.675310 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:28.675242 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e669d18-1f20-432e-9939-9b51e0bfe1d1-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfrxv\" (UID: \"7e669d18-1f20-432e-9939-9b51e0bfe1d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfrxv" Jul 10 03:45:28.675434 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:28.675417 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e669d18-1f20-432e-9939-9b51e0bfe1d1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfrxv\" (UID: \"7e669d18-1f20-432e-9939-9b51e0bfe1d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfrxv" Jul 10 03:45:28.675481 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:28.675448 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e669d18-1f20-432e-9939-9b51e0bfe1d1-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfrxv\" (UID: \"7e669d18-1f20-432e-9939-9b51e0bfe1d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfrxv" Jul 10 03:45:28.675554 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:28.675535 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e669d18-1f20-432e-9939-9b51e0bfe1d1-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfrxv\" (UID: \"7e669d18-1f20-432e-9939-9b51e0bfe1d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfrxv" Jul 10 03:45:28.675622 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:28.675603 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e669d18-1f20-432e-9939-9b51e0bfe1d1-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfrxv\" (UID: \"7e669d18-1f20-432e-9939-9b51e0bfe1d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfrxv" Jul 10 03:45:28.677570 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:28.677544 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e669d18-1f20-432e-9939-9b51e0bfe1d1-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfrxv\" (UID: \"7e669d18-1f20-432e-9939-9b51e0bfe1d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfrxv" Jul 10 03:45:28.677704 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:28.677688 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e669d18-1f20-432e-9939-9b51e0bfe1d1-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfrxv\" (UID: \"7e669d18-1f20-432e-9939-9b51e0bfe1d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfrxv" Jul 10 03:45:28.682954 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:28.682937 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhdb9\" (UniqueName: \"kubernetes.io/projected/7e669d18-1f20-432e-9939-9b51e0bfe1d1-kube-api-access-nhdb9\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-dfrxv\" (UID: \"7e669d18-1f20-432e-9939-9b51e0bfe1d1\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfrxv" Jul 10 03:45:28.788752 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:28.788720 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfrxv" Jul 10 03:45:28.919241 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:28.919214 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-dfrxv"] Jul 10 03:45:28.921752 ip-10-0-129-177 kubenswrapper[2582]: W0710 03:45:28.921728 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e669d18_1f20_432e_9939_9b51e0bfe1d1.slice/crio-cc9f930363c018099d1a88506c55bcfd47e98d065ef862070011739043dc4e8a WatchSource:0}: Error finding container cc9f930363c018099d1a88506c55bcfd47e98d065ef862070011739043dc4e8a: Status 404 returned error can't find the container with id cc9f930363c018099d1a88506c55bcfd47e98d065ef862070011739043dc4e8a Jul 10 03:45:29.026965 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:29.026936 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfrxv" event={"ID":"7e669d18-1f20-432e-9939-9b51e0bfe1d1","Type":"ContainerStarted","Data":"cc9f930363c018099d1a88506c55bcfd47e98d065ef862070011739043dc4e8a"} Jul 10 03:45:30.032999 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:30.032964 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfrxv" event={"ID":"7e669d18-1f20-432e-9939-9b51e0bfe1d1","Type":"ContainerStarted","Data":"2aa737174f2fc1a0069da48c3ddbae940a9236f12dfa99341e082730f56f0be1"} Jul 10 03:45:30.048718 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:30.048669 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfrxv" podStartSLOduration=1.868315592 podStartE2EDuration="2.048653484s" totalImagesPullingTime="180.337892ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 03:45:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 03:45:30.04738432 +0000 UTC m=+789.699195968" watchObservedRunningTime="2026-07-10 03:45:30.048653484 +0000 UTC m=+789.700465133" Jul 10 03:45:30.571987 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:30.571955 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:45:38.788971 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:38.788939 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfrxv" Jul 10 03:45:38.789396 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:38.789025 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfrxv" Jul 10 03:45:38.801521 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:38.801496 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfrxv" Jul 10 03:45:39.085494 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:39.085412 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-dfrxv" Jul 10 03:45:44.999715 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:45:44.999626 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:46:48.672678 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:46:48.672638 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:46:59.581227 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:46:59.581193 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:47:11.477184 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:47:11.477146 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:47:19.475439 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:47:19.475356 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:47:30.678827 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:47:30.678796 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:47:58.178051 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:47:58.178013 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:48:10.480073 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:48:10.480036 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:48:44.866741 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:48:44.866655 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:48:54.273180 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:48:54.273142 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:49:02.973258 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:49:02.973216 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:49:12.268076 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:49:12.268043 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:49:23.278890 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:49:23.278856 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:49:32.965993 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:49:32.965956 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:49:43.465791 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:49:43.465757 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:49:53.577435 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:49:53.577397 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:50:15.871959 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:50:15.871879 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:50:24.895762 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:50:24.895732 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:50:49.384824 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:50:49.384789 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:50:59.873045 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:50:59.873011 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:51:16.110464 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:51:16.110429 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:51:25.967570 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:51:25.967531 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:51:35.271611 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:51:35.271570 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:51:45.572236 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:51:45.572158 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:51:55.070133 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:51:55.070097 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:53:43.880690 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:53:43.880652 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:53:54.485235 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:53:54.485195 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:54:05.373615 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:54:05.373584 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:54:16.071345 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:54:16.071300 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:54:27.265455 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:54:27.265422 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:54:38.481944 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:54:38.481892 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:54:47.175878 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:54:47.175843 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:54:58.167766 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:54:58.167733 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:55:08.278760 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:55:08.278723 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:55:18.569369 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:55:18.569332 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:55:29.179249 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:55:29.179216 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:55:50.782947 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:55:50.782902 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:55:59.979622 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:55:59.979586 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:56:10.272551 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:56:10.272516 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:56:19.880388 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:56:19.880309 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:56:26.672257 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:56:26.672221 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:56:43.079318 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:56:43.079283 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:56:52.573929 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:56:52.573873 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:57:01.777606 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:57:01.777570 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:57:10.493214 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:57:10.493178 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:57:21.187763 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:57:21.187726 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:57:30.780126 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:57:30.780085 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:57:44.314962 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:57:44.314863 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:57:53.485838 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:57:53.485796 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:58:03.572857 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:58:03.572820 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:58:15.670646 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:58:15.670615 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:58:28.490830 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:58:28.490797 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:58:36.888025 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:58:36.887984 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:58:48.782999 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:58:48.782964 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:59:01.270322 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:59:01.270290 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:59:12.583899 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:59:12.583865 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:59:21.571438 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:59:21.571358 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:59:34.767365 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:59:34.767333 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:59:43.275847 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:59:43.275807 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 03:59:53.067373 ip-10-0-129-177 kubenswrapper[2582]: I0710 03:59:53.067335 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:00:57.667352 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:00:57.667268 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:01:13.973428 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:01:13.973396 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:02:19.772133 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:02:19.772099 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:02:41.573053 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:02:41.573018 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:03:51.677427 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:03:51.677387 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:05:26.177432 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:05:26.177355 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:05:34.867860 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:05:34.867826 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:05:47.683470 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:05:47.683437 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:06:07.776690 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:06:07.776653 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:06:49.272334 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:06:49.272253 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:06:58.777569 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:06:58.777531 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:07:06.070617 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:07:06.070587 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:07:25.374633 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:07:25.374598 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:08:21.584117 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:08:21.584030 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:08:35.679259 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:08:35.679223 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:09:23.385514 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:09:23.385477 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:09:37.072292 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:09:37.072260 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:09:47.777347 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:09:47.777268 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:10:13.977215 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:10:13.977175 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:10:40.070122 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:10:40.070081 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:10:53.781352 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:10:53.781318 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:11:17.572161 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:11:17.572076 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:11:38.579444 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:11:38.579411 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:11:49.281340 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:11:49.281306 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:12:10.173194 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:12:10.173163 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:12:33.905173 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:12:33.905137 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:12:55.065884 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:12:55.065805 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:13:05.974352 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:13:05.974314 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:13:21.780276 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:13:21.780238 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:13:53.372212 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:13:53.372175 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:14:07.673338 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:14:07.673304 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:14:26.678105 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:14:26.678024 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:14:44.074506 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:14:44.074470 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:15:03.671378 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:15:03.671341 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:15:18.674714 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:15:18.674678 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:15:33.470120 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:15:33.470088 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:15:52.269949 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:15:52.269854 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:16:10.472086 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:16:10.472048 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:16:49.380581 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:16:49.380545 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:17:09.620709 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:17:09.620674 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:17:29.278402 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:17:29.278327 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:17:47.079562 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:17:47.079532 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:17:58.970178 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:17:58.970143 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:18:18.085246 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:18:18.085212 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:18:45.876142 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:18:45.876056 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:18:59.568852 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:18:59.568818 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:19:14.177480 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:19:14.177437 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:19:39.669743 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:19:39.669705 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:20:06.573235 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:06.573140 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-xm6ch"] Jul 10 04:20:25.143972 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:25.143879 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d676bbf4b-2zcrr_30d60bf0-6f49-48fc-9a31-42d83fae2ea9/copy-manifests/0.log" Jul 10 04:20:25.151253 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:25.151230 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d676bbf4b-2zcrr_30d60bf0-6f49-48fc-9a31-42d83fae2ea9/manager/0.log" Jul 10 04:20:29.722818 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:29.722779 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-xm6ch_2eaad7db-ab26-4ad1-a5d2-8d4352cf85cd/limitador/0.log" Jul 10 04:20:30.329967 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:30.329934 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xljh4_e2537024-3dda-43d0-900d-0aab1fed2ed0/discovery/0.log" Jul 10 04:20:31.045147 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:31.045115 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c9b7b4644-bkzc2_6cf60a11-25ec-41eb-9683-f3fcdae52ea9/router/0.log" Jul 10 04:20:31.416277 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:31.416194 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-9h8q5_2191888e-0b18-4826-a04d-ce2a584db698/main/0.log" Jul 10 04:20:31.761384 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:31.761356 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbv5nmm_94785750-820c-4b62-af77-f6622db3f8fb/main/0.log" Jul 10 04:20:31.883022 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:31.882996 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-dfrxv_7e669d18-1f20-432e-9939-9b51e0bfe1d1/main/0.log" Jul 10 04:20:38.616341 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:38.616309 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jznf5_8ed54eed-0e8e-490d-acc6-56615ee5340b/global-pull-secret-syncer/0.log" Jul 10 04:20:38.781214 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:38.781182 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7g6b4_7d290639-b1dd-4145-a8bf-697a36a54819/konnectivity-agent/0.log" Jul 10 04:20:38.835648 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:38.835622 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-177.ec2.internal_b3bbcd29caffd89ad8909fd7d2acd9c9/haproxy/0.log" Jul 10 04:20:44.110746 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:44.110716 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-xm6ch_2eaad7db-ab26-4ad1-a5d2-8d4352cf85cd/limitador/0.log" Jul 10 04:20:45.747036 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:45.747011 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_85d00d25-f032-411d-83e5-1d846ec420a9/alertmanager/0.log" Jul 10 04:20:45.775671 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:45.775652 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_85d00d25-f032-411d-83e5-1d846ec420a9/config-reloader/0.log" Jul 10 04:20:45.808516 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:45.808494 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_85d00d25-f032-411d-83e5-1d846ec420a9/kube-rbac-proxy-web/0.log" Jul 10 04:20:45.829617 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:45.829600 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_85d00d25-f032-411d-83e5-1d846ec420a9/kube-rbac-proxy/0.log" Jul 10 04:20:45.851511 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:45.851314 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_85d00d25-f032-411d-83e5-1d846ec420a9/kube-rbac-proxy-metric/0.log" Jul 10 04:20:45.882292 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:45.882273 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_85d00d25-f032-411d-83e5-1d846ec420a9/prom-label-proxy/0.log" Jul 10 04:20:45.906702 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:45.906682 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_85d00d25-f032-411d-83e5-1d846ec420a9/init-config-reloader/0.log" Jul 10 04:20:45.954852 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:45.954828 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-dd799_573b4db4-bd46-49b9-9221-54ed2bf71644/cluster-monitoring-operator/0.log" Jul 10 04:20:45.980818 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:45.980798 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-4vtch_6180a5b2-24f4-47c5-87e8-463171c865cb/kube-state-metrics/0.log" Jul 10 04:20:46.016749 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:46.016697 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-4vtch_6180a5b2-24f4-47c5-87e8-463171c865cb/kube-rbac-proxy-main/0.log" Jul 10 04:20:46.045865 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:46.045844 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-4vtch_6180a5b2-24f4-47c5-87e8-463171c865cb/kube-rbac-proxy-self/0.log" Jul 10 04:20:46.143996 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:46.143974 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bxbc7_96f8d9dd-8c2b-4c75-99c1-f885a684d8de/node-exporter/0.log" Jul 10 04:20:46.163830 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:46.163810 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bxbc7_96f8d9dd-8c2b-4c75-99c1-f885a684d8de/kube-rbac-proxy/0.log" Jul 10 04:20:46.185985 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:46.185967 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bxbc7_96f8d9dd-8c2b-4c75-99c1-f885a684d8de/init-textfile/0.log" Jul 10 04:20:46.387587 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:46.387517 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-4rttv_2bcc5775-6fc0-4602-bee4-6d4ed5f6e96d/kube-rbac-proxy-main/0.log" Jul 10 04:20:46.410803 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:46.410783 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-4rttv_2bcc5775-6fc0-4602-bee4-6d4ed5f6e96d/kube-rbac-proxy-self/0.log" Jul 10 04:20:46.435332 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:46.435313 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-4rttv_2bcc5775-6fc0-4602-bee4-6d4ed5f6e96d/openshift-state-metrics/0.log" Jul 10 04:20:46.471842 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:46.471820 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92d7242c-e60b-485c-874a-e82a7b8f241b/prometheus/0.log" Jul 10 04:20:46.492359 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:46.492341 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92d7242c-e60b-485c-874a-e82a7b8f241b/config-reloader/0.log" Jul 10 04:20:46.515165 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:46.515140 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92d7242c-e60b-485c-874a-e82a7b8f241b/thanos-sidecar/0.log" Jul 10 04:20:46.540595 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:46.540566 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92d7242c-e60b-485c-874a-e82a7b8f241b/kube-rbac-proxy-web/0.log" Jul 10 04:20:46.565303 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:46.565267 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92d7242c-e60b-485c-874a-e82a7b8f241b/kube-rbac-proxy/0.log" Jul 10 04:20:46.589011 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:46.588989 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92d7242c-e60b-485c-874a-e82a7b8f241b/kube-rbac-proxy-thanos/0.log" Jul 10 04:20:46.614490 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:46.614470 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_92d7242c-e60b-485c-874a-e82a7b8f241b/init-config-reloader/0.log" Jul 10 04:20:46.696114 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:46.696042 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-4922m_a46e4490-589d-47d0-ab53-3547ddbc3b76/prometheus-operator-admission-webhook/0.log" Jul 10 04:20:49.363492 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:49.363458 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pg24g/perf-node-gather-daemonset-wfwq4"] Jul 10 04:20:49.367242 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:49.367220 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pg24g/perf-node-gather-daemonset-wfwq4" Jul 10 04:20:49.369314 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:49.369294 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pg24g\"/\"openshift-service-ca.crt\"" Jul 10 04:20:49.369401 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:49.369340 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pg24g\"/\"default-dockercfg-96jld\"" Jul 10 04:20:49.370152 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:49.370134 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pg24g\"/\"kube-root-ca.crt\"" Jul 10 04:20:49.375897 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:49.375876 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pg24g/perf-node-gather-daemonset-wfwq4"] Jul 10 04:20:49.445583 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:49.445558 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-knv67\" (UniqueName: \"kubernetes.io/projected/cc56353d-f337-4881-98d8-985e5abd7c06-kube-api-access-knv67\") pod \"perf-node-gather-daemonset-wfwq4\" (UID: \"cc56353d-f337-4881-98d8-985e5abd7c06\") " pod="openshift-must-gather-pg24g/perf-node-gather-daemonset-wfwq4" Jul 10 04:20:49.445713 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:49.445587 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc56353d-f337-4881-98d8-985e5abd7c06-lib-modules\") pod \"perf-node-gather-daemonset-wfwq4\" (UID: \"cc56353d-f337-4881-98d8-985e5abd7c06\") " pod="openshift-must-gather-pg24g/perf-node-gather-daemonset-wfwq4" Jul 10 04:20:49.445713 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:49.445621 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc56353d-f337-4881-98d8-985e5abd7c06-sys\") pod \"perf-node-gather-daemonset-wfwq4\" (UID: \"cc56353d-f337-4881-98d8-985e5abd7c06\") " pod="openshift-must-gather-pg24g/perf-node-gather-daemonset-wfwq4" Jul 10 04:20:49.445811 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:49.445724 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc56353d-f337-4881-98d8-985e5abd7c06-proc\") pod \"perf-node-gather-daemonset-wfwq4\" (UID: \"cc56353d-f337-4881-98d8-985e5abd7c06\") " pod="openshift-must-gather-pg24g/perf-node-gather-daemonset-wfwq4" Jul 10 04:20:49.445811 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:49.445763 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc56353d-f337-4881-98d8-985e5abd7c06-podres\") pod \"perf-node-gather-daemonset-wfwq4\" (UID: \"cc56353d-f337-4881-98d8-985e5abd7c06\") " pod="openshift-must-gather-pg24g/perf-node-gather-daemonset-wfwq4" Jul 10 04:20:49.546567 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:49.546539 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-knv67\" (UniqueName: \"kubernetes.io/projected/cc56353d-f337-4881-98d8-985e5abd7c06-kube-api-access-knv67\") pod \"perf-node-gather-daemonset-wfwq4\" (UID: \"cc56353d-f337-4881-98d8-985e5abd7c06\") " pod="openshift-must-gather-pg24g/perf-node-gather-daemonset-wfwq4" Jul 10 04:20:49.546567 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:49.546568 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc56353d-f337-4881-98d8-985e5abd7c06-lib-modules\") pod \"perf-node-gather-daemonset-wfwq4\" (UID: \"cc56353d-f337-4881-98d8-985e5abd7c06\") " pod="openshift-must-gather-pg24g/perf-node-gather-daemonset-wfwq4" Jul 10 04:20:49.546757 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:49.546595 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc56353d-f337-4881-98d8-985e5abd7c06-sys\") pod \"perf-node-gather-daemonset-wfwq4\" (UID: \"cc56353d-f337-4881-98d8-985e5abd7c06\") " pod="openshift-must-gather-pg24g/perf-node-gather-daemonset-wfwq4" Jul 10 04:20:49.546757 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:49.546615 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc56353d-f337-4881-98d8-985e5abd7c06-proc\") pod \"perf-node-gather-daemonset-wfwq4\" (UID: \"cc56353d-f337-4881-98d8-985e5abd7c06\") " pod="openshift-must-gather-pg24g/perf-node-gather-daemonset-wfwq4" Jul 10 04:20:49.546757 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:49.546640 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc56353d-f337-4881-98d8-985e5abd7c06-podres\") pod \"perf-node-gather-daemonset-wfwq4\" (UID: \"cc56353d-f337-4881-98d8-985e5abd7c06\") " pod="openshift-must-gather-pg24g/perf-node-gather-daemonset-wfwq4" Jul 10 04:20:49.546757 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:49.546695 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc56353d-f337-4881-98d8-985e5abd7c06-sys\") pod \"perf-node-gather-daemonset-wfwq4\" (UID: \"cc56353d-f337-4881-98d8-985e5abd7c06\") " pod="openshift-must-gather-pg24g/perf-node-gather-daemonset-wfwq4" Jul 10 04:20:49.546757 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:49.546696 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc56353d-f337-4881-98d8-985e5abd7c06-proc\") pod \"perf-node-gather-daemonset-wfwq4\" (UID: \"cc56353d-f337-4881-98d8-985e5abd7c06\") " pod="openshift-must-gather-pg24g/perf-node-gather-daemonset-wfwq4" Jul 10 04:20:49.546957 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:49.546752 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc56353d-f337-4881-98d8-985e5abd7c06-lib-modules\") pod \"perf-node-gather-daemonset-wfwq4\" (UID: \"cc56353d-f337-4881-98d8-985e5abd7c06\") " pod="openshift-must-gather-pg24g/perf-node-gather-daemonset-wfwq4" Jul 10 04:20:49.546957 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:49.546776 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc56353d-f337-4881-98d8-985e5abd7c06-podres\") pod \"perf-node-gather-daemonset-wfwq4\" (UID: \"cc56353d-f337-4881-98d8-985e5abd7c06\") " pod="openshift-must-gather-pg24g/perf-node-gather-daemonset-wfwq4" Jul 10 04:20:49.553952 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:49.553930 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-knv67\" (UniqueName: \"kubernetes.io/projected/cc56353d-f337-4881-98d8-985e5abd7c06-kube-api-access-knv67\") pod \"perf-node-gather-daemonset-wfwq4\" (UID: \"cc56353d-f337-4881-98d8-985e5abd7c06\") " pod="openshift-must-gather-pg24g/perf-node-gather-daemonset-wfwq4" Jul 10 04:20:49.678375 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:49.678308 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pg24g/perf-node-gather-daemonset-wfwq4" Jul 10 04:20:49.810093 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:49.810025 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pg24g/perf-node-gather-daemonset-wfwq4"] Jul 10 04:20:49.812405 ip-10-0-129-177 kubenswrapper[2582]: W0710 04:20:49.812372 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcc56353d_f337_4881_98d8_985e5abd7c06.slice/crio-ba6042e4cc216bacbd02317f1bd864e1ad3e891fe6b837bb8afde5a1d72437e6 WatchSource:0}: Error finding container ba6042e4cc216bacbd02317f1bd864e1ad3e891fe6b837bb8afde5a1d72437e6: Status 404 returned error can't find the container with id ba6042e4cc216bacbd02317f1bd864e1ad3e891fe6b837bb8afde5a1d72437e6 Jul 10 04:20:50.620020 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:50.619984 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pg24g/perf-node-gather-daemonset-wfwq4" event={"ID":"cc56353d-f337-4881-98d8-985e5abd7c06","Type":"ContainerStarted","Data":"cdbfbff4cff973d9ac86d842f87ed8c79681e5806fe083e2feb504ab507690ad"} Jul 10 04:20:50.620443 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:50.620046 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pg24g/perf-node-gather-daemonset-wfwq4" event={"ID":"cc56353d-f337-4881-98d8-985e5abd7c06","Type":"ContainerStarted","Data":"ba6042e4cc216bacbd02317f1bd864e1ad3e891fe6b837bb8afde5a1d72437e6"} Jul 10 04:20:50.620443 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:50.620074 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pg24g/perf-node-gather-daemonset-wfwq4" Jul 10 04:20:50.634196 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:50.634151 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pg24g/perf-node-gather-daemonset-wfwq4" podStartSLOduration=1.634132159 podStartE2EDuration="1.634132159s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 04:20:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 04:20:50.633201558 +0000 UTC m=+2910.285013206" watchObservedRunningTime="2026-07-10 04:20:50.634132159 +0000 UTC m=+2910.285943808" Jul 10 04:20:50.983361 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:50.983289 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-267rs_99ee7944-11db-4b68-bfe1-4cd910cf2ef2/dns/0.log" Jul 10 04:20:51.002730 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:51.002704 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-267rs_99ee7944-11db-4b68-bfe1-4cd910cf2ef2/kube-rbac-proxy/0.log" Jul 10 04:20:51.155489 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:51.155462 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n7lff_4a14a14c-8129-478b-a6b4-4e0f933ae323/dns-node-resolver/0.log" Jul 10 04:20:51.690535 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:51.690511 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7glzx_27c224f5-8cb1-4c4a-b9bf-27eaf5cf4dec/node-ca/0.log" Jul 10 04:20:52.730692 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:52.730658 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xljh4_e2537024-3dda-43d0-900d-0aab1fed2ed0/discovery/0.log" Jul 10 04:20:52.919941 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:52.919897 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c9b7b4644-bkzc2_6cf60a11-25ec-41eb-9683-f3fcdae52ea9/router/0.log" Jul 10 04:20:53.628154 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:53.628128 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-njp2r_d4e07574-8e12-4c22-9f6c-49c0bc88cd5f/serve-healthcheck-canary/0.log" Jul 10 04:20:54.219855 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:54.219827 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zzvjv_aff0e551-f1c9-47e8-869d-36f28cebb925/kube-rbac-proxy/0.log" Jul 10 04:20:54.239269 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:54.239243 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zzvjv_aff0e551-f1c9-47e8-869d-36f28cebb925/exporter/0.log" Jul 10 04:20:54.259212 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:54.259191 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zzvjv_aff0e551-f1c9-47e8-869d-36f28cebb925/extractor/0.log" Jul 10 04:20:56.633496 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:56.633469 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pg24g/perf-node-gather-daemonset-wfwq4" Jul 10 04:20:56.721322 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:56.721294 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d676bbf4b-2zcrr_30d60bf0-6f49-48fc-9a31-42d83fae2ea9/manager/0.log" Jul 10 04:20:56.739748 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:56.739724 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d676bbf4b-2zcrr_30d60bf0-6f49-48fc-9a31-42d83fae2ea9/copy-manifests/0.log" Jul 10 04:20:58.126522 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:58.126484 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6549b595fc-z2d44_2dca815b-cedc-4a7a-8afb-aa6c151b78f5/manager/0.log" Jul 10 04:20:58.152995 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:58.152974 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-thtqd_53026e9f-d3c7-48b2-a52b-9e0565254b3d/openshift-lws-operator/0.log" Jul 10 04:20:59.329410 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:59.329380 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xljh4_e2537024-3dda-43d0-900d-0aab1fed2ed0/discovery/0.log" Jul 10 04:20:59.459627 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:20:59.459601 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c9b7b4644-bkzc2_6cf60a11-25ec-41eb-9683-f3fcdae52ea9/router/0.log" Jul 10 04:21:00.780921 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:21:00.780877 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xljh4_e2537024-3dda-43d0-900d-0aab1fed2ed0/discovery/0.log" Jul 10 04:21:00.928188 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:21:00.928111 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-c9b7b4644-bkzc2_6cf60a11-25ec-41eb-9683-f3fcdae52ea9/router/0.log" Jul 10 04:21:04.775171 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:21:04.775143 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5c85h_e7780df5-f03a-4222-bb0c-38ed1c71ae2d/kube-multus-additional-cni-plugins/0.log" Jul 10 04:21:04.795071 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:21:04.795050 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5c85h_e7780df5-f03a-4222-bb0c-38ed1c71ae2d/egress-router-binary-copy/0.log" Jul 10 04:21:04.815762 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:21:04.815747 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5c85h_e7780df5-f03a-4222-bb0c-38ed1c71ae2d/cni-plugins/0.log" Jul 10 04:21:04.835823 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:21:04.835783 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5c85h_e7780df5-f03a-4222-bb0c-38ed1c71ae2d/bond-cni-plugin/0.log" Jul 10 04:21:04.855302 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:21:04.855283 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5c85h_e7780df5-f03a-4222-bb0c-38ed1c71ae2d/routeoverride-cni/0.log" Jul 10 04:21:04.874395 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:21:04.874374 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5c85h_e7780df5-f03a-4222-bb0c-38ed1c71ae2d/whereabouts-cni-bincopy/0.log" Jul 10 04:21:04.894813 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:21:04.894798 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5c85h_e7780df5-f03a-4222-bb0c-38ed1c71ae2d/whereabouts-cni/0.log" Jul 10 04:21:05.214935 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:21:05.214847 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-p7v8n_ddb8999f-5597-4cd9-81a7-401da2a185a5/kube-multus/0.log" Jul 10 04:21:05.283091 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:21:05.283061 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ddntq_b78bc3c1-3658-4cdd-ba93-30d686b78aa5/network-metrics-daemon/0.log" Jul 10 04:21:05.304138 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:21:05.304118 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ddntq_b78bc3c1-3658-4cdd-ba93-30d686b78aa5/kube-rbac-proxy/0.log" Jul 10 04:21:06.675681 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:21:06.675609 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pjnbc_ce3c8300-f70f-4ddc-9820-9d3234ab414c/ovn-controller/0.log" Jul 10 04:21:06.693954 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:21:06.693928 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pjnbc_ce3c8300-f70f-4ddc-9820-9d3234ab414c/ovn-acl-logging/0.log" Jul 10 04:21:06.719993 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:21:06.719970 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pjnbc_ce3c8300-f70f-4ddc-9820-9d3234ab414c/kube-rbac-proxy-node/0.log" Jul 10 04:21:06.742318 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:21:06.742291 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pjnbc_ce3c8300-f70f-4ddc-9820-9d3234ab414c/kube-rbac-proxy-ovn-metrics/0.log" Jul 10 04:21:06.759710 ip-10-0-129-177 kubenswrapper[2582]: I0710 04:21:06.759685 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pjnbc_ce3c8300-f70f-4ddc-9820-9d3234ab414c/northd/0.log"