Jul 23 18:04:34.615568 ip-10-0-135-200 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 23 18:04:34.615577 ip-10-0-135-200 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 23 18:04:34.615584 ip-10-0-135-200 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 23 18:04:34.615808 ip-10-0-135-200 systemd[1]: Failed to start Kubernetes Kubelet. Jul 23 18:04:44.785482 ip-10-0-135-200 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 23 18:04:44.785498 ip-10-0-135-200 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 48824e3d563b49c4b429740bed1cc210 -- Jul 23 18:06:17.948992 ip-10-0-135-200 systemd[1]: Starting Kubernetes Kubelet... Jul 23 18:06:18.719128 ip-10-0-135-200 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 18:06:18.719128 ip-10-0-135-200 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 23 18:06:18.719128 ip-10-0-135-200 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 18:06:18.719128 ip-10-0-135-200 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 23 18:06:18.719128 ip-10-0-135-200 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 23 18:06:18.719128 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.396769 2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 23 18:06:18.719128 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407509 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:06:18.719128 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407528 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:06:18.719128 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407534 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:06:18.719128 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407538 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:06:18.719128 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407541 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:06:18.719128 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407544 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:06:18.719128 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407547 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:06:18.491207 ip-10-0-135-200 systemd[1]: Started Kubernetes Kubelet. Jul 23 18:06:18.728923 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407550 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:06:18.728923 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407552 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:06:18.728923 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407555 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:06:18.728923 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407558 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:06:18.728923 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407561 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:06:18.728923 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407564 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:06:18.728923 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407567 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:06:18.728923 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407570 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:06:18.728923 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407572 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:06:18.728923 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407575 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:06:18.728923 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407578 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:06:18.728923 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407580 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:06:18.728923 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407583 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:06:18.728923 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407586 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:06:18.728923 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407589 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:06:18.728923 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407591 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:06:18.728923 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407594 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:06:18.728923 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407596 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:06:18.728923 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407599 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:06:18.728923 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407602 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:06:18.730083 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407607 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:06:18.730083 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407610 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:06:18.730083 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407613 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:06:18.730083 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407616 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:06:18.730083 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407618 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:06:18.730083 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407621 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:06:18.730083 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407623 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:06:18.730083 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407626 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:06:18.730083 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407629 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:06:18.730083 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407631 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:06:18.730083 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407634 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:06:18.730083 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407637 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:06:18.730083 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407640 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:06:18.730083 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407642 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:06:18.730083 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407645 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:06:18.730083 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407648 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:06:18.730083 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407650 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:06:18.730083 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407653 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:06:18.730083 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407655 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:06:18.730083 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407658 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:06:18.731092 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407660 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:06:18.731092 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407663 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:06:18.731092 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407667 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:06:18.731092 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407671 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:06:18.731092 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407690 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:06:18.731092 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407693 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:06:18.731092 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407695 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:06:18.731092 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407698 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:06:18.731092 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407701 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:06:18.731092 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407704 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:06:18.731092 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407707 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:06:18.731092 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407710 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:06:18.731092 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407713 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:06:18.731092 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407717 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:06:18.731092 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407721 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:06:18.731092 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407724 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:06:18.731092 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407727 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:06:18.731092 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407729 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:06:18.731092 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407732 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:06:18.731092 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407735 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:06:18.732113 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407737 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:06:18.732113 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407740 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:06:18.732113 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407743 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:06:18.732113 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407745 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:06:18.732113 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407749 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:06:18.732113 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407752 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:06:18.732113 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407756 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:06:18.732113 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407758 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:06:18.732113 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407761 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:06:18.732113 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407764 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:06:18.732113 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407766 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:06:18.732113 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407770 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:06:18.732113 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407772 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:06:18.732113 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407775 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:06:18.732113 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407777 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:06:18.732113 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407780 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:06:18.732113 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407787 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:06:18.732113 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407790 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:06:18.732113 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407792 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:06:18.732928 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407795 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:06:18.732928 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407797 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:06:18.732928 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407800 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:06:18.732928 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407803 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:06:18.732928 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407806 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:06:18.732928 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407808 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:06:18.732928 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407811 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:06:18.732928 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407813 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:06:18.732928 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407816 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:06:18.732928 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407819 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:06:18.732928 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407821 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:06:18.732928 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407824 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:06:18.732928 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.407826 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:06:18.732928 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408579 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:06:18.732928 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408585 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:06:18.732928 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408589 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:06:18.732928 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408592 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:06:18.732928 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408594 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:06:18.732928 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408597 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:06:18.733761 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408600 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:06:18.733761 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408602 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:06:18.733761 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408605 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:06:18.733761 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408608 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:06:18.733761 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408610 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:06:18.733761 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408614 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:06:18.733761 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408616 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:06:18.733761 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408619 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:06:18.733761 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408622 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:06:18.733761 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408625 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:06:18.733761 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408630 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:06:18.733761 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408633 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:06:18.733761 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408636 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:06:18.733761 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408639 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:06:18.733761 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408641 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:06:18.733761 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408644 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:06:18.733761 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408647 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:06:18.733761 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408649 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:06:18.733761 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408652 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:06:18.733761 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408655 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:06:18.734548 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408657 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:06:18.734548 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408660 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:06:18.734548 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408662 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:06:18.734548 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408664 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:06:18.734548 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408667 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:06:18.734548 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408670 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:06:18.734548 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408689 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:06:18.734548 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408693 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:06:18.734548 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408696 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:06:18.734548 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408698 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:06:18.734548 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408701 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:06:18.734548 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408704 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:06:18.734548 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408706 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:06:18.734548 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408709 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:06:18.734548 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408713 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:06:18.734548 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408716 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:06:18.734548 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408718 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:06:18.734548 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408721 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:06:18.734548 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408724 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:06:18.734548 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408727 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:06:18.735141 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408729 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:06:18.735141 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408732 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:06:18.735141 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408736 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:06:18.735141 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408738 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:06:18.735141 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408744 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:06:18.735141 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408748 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:06:18.735141 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408751 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:06:18.735141 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408753 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:06:18.735141 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408756 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:06:18.735141 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408759 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:06:18.735141 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408761 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:06:18.735141 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408764 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:06:18.735141 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408767 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:06:18.735141 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408770 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:06:18.735141 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408772 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:06:18.735141 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408775 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:06:18.735141 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408777 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:06:18.735141 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408780 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:06:18.735141 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408782 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:06:18.735141 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408785 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:06:18.735844 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408788 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:06:18.735844 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408790 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:06:18.735844 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408801 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:06:18.735844 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408805 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:06:18.735844 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408808 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:06:18.735844 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408811 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:06:18.735844 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408815 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:06:18.735844 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408817 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:06:18.735844 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408820 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:06:18.735844 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408823 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:06:18.735844 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408825 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:06:18.735844 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408827 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:06:18.735844 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408830 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:06:18.735844 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408835 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:06:18.735844 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408841 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:06:18.735844 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408844 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:06:18.735844 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408847 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:06:18.735844 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408851 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:06:18.735844 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408854 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:06:18.736413 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408857 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:06:18.736413 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408860 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:06:18.736413 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408863 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:06:18.736413 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408865 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:06:18.736413 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408868 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:06:18.736413 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408870 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:06:18.736413 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408873 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:06:18.736413 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408876 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:06:18.736413 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408878 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:06:18.736413 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408880 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:06:18.736413 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408883 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:06:18.736413 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408886 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:06:18.736413 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408888 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:06:18.736413 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.408891 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:06:18.736413 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409288 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:06:18.736413 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409292 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:06:18.736413 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409295 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:06:18.736413 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409298 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:06:18.736413 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409301 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:06:18.736413 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409305 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:06:18.737086 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409307 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:06:18.737086 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409310 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:06:18.737086 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409313 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:06:18.737086 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409317 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:06:18.737086 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409321 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:06:18.737086 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409324 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:06:18.737086 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409327 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:06:18.737086 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409332 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:06:18.737086 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409335 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:06:18.737086 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409338 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:06:18.737086 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409341 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:06:18.737086 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409344 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:06:18.737086 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409347 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:06:18.737086 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409351 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:06:18.737086 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409354 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:06:18.737086 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409357 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:06:18.737086 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409359 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:06:18.737086 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409362 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:06:18.737086 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409364 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:06:18.737630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409367 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:06:18.737630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409369 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:06:18.737630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409372 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:06:18.737630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409375 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:06:18.737630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409377 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:06:18.737630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409380 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:06:18.737630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409382 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:06:18.737630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409386 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:06:18.737630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409388 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:06:18.737630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409392 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:06:18.737630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409396 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:06:18.737630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409399 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:06:18.737630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409403 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:06:18.737630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409406 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:06:18.737630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409408 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:06:18.737630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409411 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:06:18.737630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409413 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:06:18.737630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409416 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:06:18.737630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409419 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:06:18.738239 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409421 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:06:18.738239 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409425 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:06:18.738239 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409428 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:06:18.738239 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409431 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:06:18.738239 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409434 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:06:18.738239 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409437 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:06:18.738239 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409440 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:06:18.738239 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409442 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:06:18.738239 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409445 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:06:18.738239 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409448 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:06:18.738239 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409450 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:06:18.738239 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409453 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:06:18.738239 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409455 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:06:18.738239 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409458 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:06:18.738239 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409460 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:06:18.738239 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409463 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:06:18.738239 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409465 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:06:18.738239 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409468 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:06:18.738239 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409471 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:06:18.738239 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409473 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:06:18.738839 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409476 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:06:18.738839 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409478 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:06:18.738839 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409481 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:06:18.738839 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409484 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:06:18.738839 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409487 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:06:18.738839 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409490 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:06:18.738839 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409493 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:06:18.738839 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409496 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:06:18.738839 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409498 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:06:18.738839 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409501 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:06:18.738839 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409503 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:06:18.738839 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409506 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:06:18.738839 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409508 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:06:18.738839 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409512 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:06:18.738839 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409515 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:06:18.738839 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409517 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:06:18.738839 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409520 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:06:18.738839 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409522 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:06:18.738839 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409525 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:06:18.738839 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409528 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:06:18.739397 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409531 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:06:18.739397 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409533 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:06:18.739397 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409536 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:06:18.739397 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409538 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:06:18.739397 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409541 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:06:18.739397 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409544 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:06:18.739397 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409546 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:06:18.739397 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409549 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:06:18.739397 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409551 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:06:18.739397 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409554 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:06:18.739397 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409558 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:06:18.739397 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409561 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:06:18.739397 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409564 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:06:18.739397 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409566 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:06:18.739397 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.409568 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:06:18.739397 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409638 2575 flags.go:64] FLAG: --address="0.0.0.0" Jul 23 18:06:18.739397 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409646 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 23 18:06:18.739397 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409655 2575 flags.go:64] FLAG: --anonymous-auth="true" Jul 23 18:06:18.739397 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409660 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 23 18:06:18.739397 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409664 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 23 18:06:18.739397 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409668 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 23 18:06:18.739987 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409672 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 23 18:06:18.739987 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409691 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 23 18:06:18.739987 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409695 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 23 18:06:18.739987 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409698 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 23 18:06:18.739987 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409703 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 23 18:06:18.739987 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409706 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 23 18:06:18.739987 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409709 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 23 18:06:18.739987 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409712 2575 flags.go:64] FLAG: --cgroup-root="" Jul 23 18:06:18.739987 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409715 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 23 18:06:18.739987 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409718 2575 flags.go:64] FLAG: --client-ca-file="" Jul 23 18:06:18.739987 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409723 2575 flags.go:64] FLAG: --cloud-provider="external" Jul 23 18:06:18.739987 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409726 2575 flags.go:64] FLAG: --cluster-dns="[]" Jul 23 18:06:18.739987 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409730 2575 flags.go:64] FLAG: --cluster-domain="" Jul 23 18:06:18.739987 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409733 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 23 18:06:18.739987 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409736 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 23 18:06:18.739987 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409739 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 23 18:06:18.739987 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409742 2575 flags.go:64] FLAG: --container-log-max-files="5" Jul 23 18:06:18.739987 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409746 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 23 18:06:18.739987 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409749 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 23 18:06:18.739987 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409752 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 23 18:06:18.739987 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409756 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 23 18:06:18.739987 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409759 2575 flags.go:64] FLAG: --contention-profiling="false" Jul 23 18:06:18.739987 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409762 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 23 18:06:18.739987 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409764 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 23 18:06:18.740631 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409767 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 23 18:06:18.740631 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409771 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 23 18:06:18.740631 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409775 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 23 18:06:18.740631 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409778 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 23 18:06:18.740631 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409782 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 23 18:06:18.740631 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409785 2575 flags.go:64] FLAG: --enable-load-reader="false" Jul 23 18:06:18.740631 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409788 2575 flags.go:64] FLAG: --enable-server="true" Jul 23 18:06:18.740631 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409791 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 23 18:06:18.740631 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409795 2575 flags.go:64] FLAG: --event-burst="100" Jul 23 18:06:18.740631 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409799 2575 flags.go:64] FLAG: --event-qps="50" Jul 23 18:06:18.740631 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409801 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 23 18:06:18.740631 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409805 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 23 18:06:18.740631 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409809 2575 flags.go:64] FLAG: --eviction-hard="" Jul 23 18:06:18.740631 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409813 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 23 18:06:18.740631 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409816 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 23 18:06:18.740631 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409819 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 23 18:06:18.740631 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409822 2575 flags.go:64] FLAG: --eviction-soft="" Jul 23 18:06:18.740631 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409825 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 23 18:06:18.740631 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409828 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 23 18:06:18.740631 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409831 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 23 18:06:18.740631 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409834 2575 flags.go:64] FLAG: --experimental-mounter-path="" Jul 23 18:06:18.740631 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409837 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 23 18:06:18.740631 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409840 2575 flags.go:64] FLAG: --fail-swap-on="true" Jul 23 18:06:18.740631 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409843 2575 flags.go:64] FLAG: --feature-gates="" Jul 23 18:06:18.740631 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409847 2575 flags.go:64] FLAG: --file-check-frequency="20s" Jul 23 18:06:18.741380 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409850 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 23 18:06:18.741380 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409853 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 23 18:06:18.741380 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409856 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 23 18:06:18.741380 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409859 2575 flags.go:64] FLAG: --healthz-port="10248" Jul 23 18:06:18.741380 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409862 2575 flags.go:64] FLAG: --help="false" Jul 23 18:06:18.741380 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409864 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-135-200.ec2.internal" Jul 23 18:06:18.741380 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409868 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 23 18:06:18.741380 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409870 2575 flags.go:64] FLAG: --http-check-frequency="20s" Jul 23 18:06:18.741380 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409873 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 23 18:06:18.741380 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409877 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 23 18:06:18.741380 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409880 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 23 18:06:18.741380 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409884 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 23 18:06:18.741380 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409887 2575 flags.go:64] FLAG: --image-service-endpoint="" Jul 23 18:06:18.741380 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409890 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 23 18:06:18.741380 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409893 2575 flags.go:64] FLAG: --kube-api-burst="100" Jul 23 18:06:18.741380 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409896 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 23 18:06:18.741380 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409899 2575 flags.go:64] FLAG: --kube-api-qps="50" Jul 23 18:06:18.741380 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409901 2575 flags.go:64] FLAG: --kube-reserved="" Jul 23 18:06:18.741380 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409904 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 23 18:06:18.741380 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409909 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 23 18:06:18.741380 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409912 2575 flags.go:64] FLAG: --kubelet-cgroups="" Jul 23 18:06:18.741380 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409915 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 23 18:06:18.741380 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409918 2575 flags.go:64] FLAG: --lock-file="" Jul 23 18:06:18.741380 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409920 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 23 18:06:18.742056 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409923 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 23 18:06:18.742056 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409926 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 23 18:06:18.742056 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409931 2575 flags.go:64] FLAG: --log-json-split-stream="false" Jul 23 18:06:18.742056 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409935 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 23 18:06:18.742056 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409938 2575 flags.go:64] FLAG: --log-text-split-stream="false" Jul 23 18:06:18.742056 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409941 2575 flags.go:64] FLAG: --logging-format="text" Jul 23 18:06:18.742056 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409944 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 23 18:06:18.742056 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409947 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 23 18:06:18.742056 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409950 2575 flags.go:64] FLAG: --manifest-url="" Jul 23 18:06:18.742056 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409953 2575 flags.go:64] FLAG: --manifest-url-header="" Jul 23 18:06:18.742056 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409957 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 23 18:06:18.742056 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409960 2575 flags.go:64] FLAG: --max-open-files="1000000" Jul 23 18:06:18.742056 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409964 2575 flags.go:64] FLAG: --max-pods="110" Jul 23 18:06:18.742056 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409967 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 23 18:06:18.742056 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409969 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 23 18:06:18.742056 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409972 2575 flags.go:64] FLAG: --memory-manager-policy="None" Jul 23 18:06:18.742056 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409975 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 23 18:06:18.742056 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409978 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 23 18:06:18.742056 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409981 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 23 18:06:18.742056 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409985 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 23 18:06:18.742056 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409993 2575 flags.go:64] FLAG: --node-status-max-images="50" Jul 23 18:06:18.742056 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409996 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 23 18:06:18.742056 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.409999 2575 flags.go:64] FLAG: --oom-score-adj="-999" Jul 23 18:06:18.742056 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410002 2575 flags.go:64] FLAG: --pod-cidr="" Jul 23 18:06:18.742984 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410004 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 23 18:06:18.742984 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410010 2575 flags.go:64] FLAG: --pod-manifest-path="" Jul 23 18:06:18.742984 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410013 2575 flags.go:64] FLAG: --pod-max-pids="-1" Jul 23 18:06:18.742984 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410016 2575 flags.go:64] FLAG: --pods-per-core="0" Jul 23 18:06:18.742984 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410020 2575 flags.go:64] FLAG: --port="10250" Jul 23 18:06:18.742984 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410023 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 23 18:06:18.742984 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410026 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cc35757670b4f5d6" Jul 23 18:06:18.742984 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410030 2575 flags.go:64] FLAG: --qos-reserved="" Jul 23 18:06:18.742984 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410033 2575 flags.go:64] FLAG: --read-only-port="10255" Jul 23 18:06:18.742984 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410036 2575 flags.go:64] FLAG: --register-node="true" Jul 23 18:06:18.742984 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410038 2575 flags.go:64] FLAG: --register-with-taints="" Jul 23 18:06:18.742984 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410042 2575 flags.go:64] FLAG: --registry-burst="10" Jul 23 18:06:18.742984 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410046 2575 flags.go:64] FLAG: --registry-qps="5" Jul 23 18:06:18.742984 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410049 2575 flags.go:64] FLAG: --reserved-cpus="" Jul 23 18:06:18.742984 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410052 2575 flags.go:64] FLAG: --reserved-memory="" Jul 23 18:06:18.742984 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410056 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 23 18:06:18.742984 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410059 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 23 18:06:18.742984 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410062 2575 flags.go:64] FLAG: --rotate-certificates="false" Jul 23 18:06:18.742984 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410065 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 23 18:06:18.742984 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410068 2575 flags.go:64] FLAG: --runonce="false" Jul 23 18:06:18.742984 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410071 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 23 18:06:18.742984 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410074 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 23 18:06:18.742984 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410077 2575 flags.go:64] FLAG: --seccomp-default="false" Jul 23 18:06:18.742984 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410080 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 23 18:06:18.742984 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410083 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 23 18:06:18.743671 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410086 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 23 18:06:18.743671 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410088 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 23 18:06:18.743671 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410093 2575 flags.go:64] FLAG: --storage-driver-password="root" Jul 23 18:06:18.743671 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410095 2575 flags.go:64] FLAG: --storage-driver-secure="false" Jul 23 18:06:18.743671 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410098 2575 flags.go:64] FLAG: --storage-driver-table="stats" Jul 23 18:06:18.743671 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410101 2575 flags.go:64] FLAG: --storage-driver-user="root" Jul 23 18:06:18.743671 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410104 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 23 18:06:18.743671 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410107 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 23 18:06:18.743671 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410110 2575 flags.go:64] FLAG: --system-cgroups="" Jul 23 18:06:18.743671 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410113 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 23 18:06:18.743671 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410118 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 23 18:06:18.743671 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410122 2575 flags.go:64] FLAG: --tls-cert-file="" Jul 23 18:06:18.743671 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410125 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 23 18:06:18.743671 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410129 2575 flags.go:64] FLAG: --tls-min-version="" Jul 23 18:06:18.743671 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410132 2575 flags.go:64] FLAG: --tls-private-key-file="" Jul 23 18:06:18.743671 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410135 2575 flags.go:64] FLAG: --topology-manager-policy="none" Jul 23 18:06:18.743671 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410138 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 23 18:06:18.743671 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410141 2575 flags.go:64] FLAG: --topology-manager-scope="container" Jul 23 18:06:18.743671 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410143 2575 flags.go:64] FLAG: --v="2" Jul 23 18:06:18.743671 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410154 2575 flags.go:64] FLAG: --version="false" Jul 23 18:06:18.743671 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410165 2575 flags.go:64] FLAG: --vmodule="" Jul 23 18:06:18.743671 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410173 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 23 18:06:18.743671 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.410176 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 23 18:06:18.743671 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410291 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:06:18.743671 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410294 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:06:18.863330 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410297 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:06:18.863330 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410299 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:06:18.863330 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410302 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:06:18.863330 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410305 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:06:18.863330 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410307 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:06:18.863330 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410310 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:06:18.863330 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410313 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:06:18.863330 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410315 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:06:18.863330 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410318 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:06:18.863330 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410322 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:06:18.863330 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410324 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:06:18.863330 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410327 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:06:18.863330 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410329 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:06:18.863330 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410332 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:06:18.863330 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410335 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:06:18.863330 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410337 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:06:18.863330 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410341 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:06:18.863330 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410345 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:06:18.863330 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410351 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:06:18.864056 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410354 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:06:18.864056 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410358 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:06:18.864056 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410361 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:06:18.864056 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410364 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:06:18.864056 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410367 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:06:18.864056 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410370 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:06:18.864056 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410373 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:06:18.864056 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410376 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:06:18.864056 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410379 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:06:18.864056 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410382 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:06:18.864056 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410385 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:06:18.864056 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410387 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:06:18.864056 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410390 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:06:18.864056 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410393 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:06:18.864056 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410396 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:06:18.864056 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410398 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:06:18.864056 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410401 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:06:18.864056 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410403 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:06:18.864056 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410406 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:06:18.864560 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410408 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:06:18.864560 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410411 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:06:18.864560 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410414 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:06:18.864560 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410418 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:06:18.864560 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410420 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:06:18.864560 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410423 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:06:18.864560 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410425 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:06:18.864560 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410428 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:06:18.864560 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410431 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:06:18.864560 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410433 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:06:18.864560 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410436 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:06:18.864560 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410439 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:06:18.864560 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410442 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:06:18.864560 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410445 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:06:18.864560 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410448 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:06:18.864560 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410450 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:06:18.864560 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410452 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:06:18.864560 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410455 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:06:18.864560 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410458 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:06:18.864560 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410460 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:06:18.865166 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410463 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:06:18.865166 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410466 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:06:18.865166 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410468 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:06:18.865166 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410472 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:06:18.865166 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410474 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:06:18.865166 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410477 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:06:18.865166 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410479 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:06:18.865166 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410482 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:06:18.865166 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410484 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:06:18.865166 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410487 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:06:18.865166 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410489 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:06:18.865166 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410492 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:06:18.865166 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410494 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:06:18.865166 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410497 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:06:18.865166 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410499 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:06:18.865166 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410504 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:06:18.865166 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410506 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:06:18.865166 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410509 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:06:18.865166 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410511 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:06:18.865166 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410514 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:06:18.865702 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410517 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:06:18.865702 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410519 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:06:18.865702 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410522 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:06:18.865702 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410524 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:06:18.865702 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410528 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:06:18.865702 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410531 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:06:18.865702 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410533 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:06:18.865702 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410536 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:06:18.865702 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410538 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:06:18.865702 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410541 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:06:18.865702 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410543 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:06:18.865702 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410546 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:06:18.865702 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410549 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:06:18.865702 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410551 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:06:18.865702 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410554 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:06:18.865702 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410556 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:06:18.865702 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410559 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:06:18.865702 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410562 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:06:18.865702 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.410564 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:06:18.866232 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.411331 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 18:06:18.866232 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.418811 2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 23 18:06:18.866232 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.418830 2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 23 18:06:18.866232 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.418844 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 23 18:06:18.866232 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.418850 2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 23 18:06:18.866232 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.418906 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:06:18.866232 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.418911 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:06:18.866232 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.418914 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:06:18.866232 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.418917 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:06:18.866232 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.418920 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:06:18.866232 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.418923 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:06:18.866232 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.418926 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:06:18.866232 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.418928 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:06:18.866232 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.418931 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:06:18.866630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.418934 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:06:18.866630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.418937 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:06:18.866630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.418939 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:06:18.866630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.418942 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:06:18.866630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.418945 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:06:18.866630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.418948 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:06:18.866630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.418951 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:06:18.866630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.418953 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:06:18.866630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.418956 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:06:18.866630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.418960 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:06:18.866630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.418964 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:06:18.866630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.418967 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:06:18.866630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.418970 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:06:18.866630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.418973 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:06:18.866630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.418976 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:06:18.866630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.418978 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:06:18.866630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.418981 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:06:18.866630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.418984 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:06:18.866630 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.418987 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:06:18.867179 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.418989 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:06:18.867179 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.418993 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:06:18.867179 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.418996 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:06:18.867179 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.418999 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:06:18.867179 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419001 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:06:18.867179 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419004 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:06:18.867179 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419006 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:06:18.867179 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419009 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:06:18.867179 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419011 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:06:18.867179 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419014 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:06:18.867179 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419017 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:06:18.867179 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419019 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:06:18.867179 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419022 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:06:18.867179 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419024 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:06:18.867179 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419027 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:06:18.867179 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419030 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:06:18.867179 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419032 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:06:18.867179 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419035 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:06:18.867179 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419037 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:06:18.867179 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419040 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:06:18.867720 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419042 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:06:18.867720 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419045 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:06:18.867720 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419048 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:06:18.867720 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419050 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:06:18.867720 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419053 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:06:18.867720 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419057 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:06:18.867720 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419059 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:06:18.867720 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419062 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:06:18.867720 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419064 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:06:18.867720 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419067 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:06:18.867720 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419070 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:06:18.867720 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419072 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:06:18.867720 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419075 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:06:18.867720 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419078 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:06:18.867720 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419081 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:06:18.867720 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419085 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:06:18.867720 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419089 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:06:18.867720 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419091 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:06:18.867720 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419094 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:06:18.867720 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419097 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:06:18.868284 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419099 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:06:18.868284 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419102 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:06:18.868284 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419104 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:06:18.868284 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419107 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:06:18.868284 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419109 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:06:18.868284 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419112 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:06:18.868284 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419115 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:06:18.868284 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419117 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:06:18.868284 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419120 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:06:18.868284 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419123 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:06:18.868284 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419125 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:06:18.868284 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419128 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:06:18.868284 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419130 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:06:18.868284 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419133 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:06:18.868284 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419135 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:06:18.868284 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419138 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:06:18.868284 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419140 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:06:18.868284 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419143 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:06:18.868284 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419145 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:06:18.868284 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419148 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:06:18.868846 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419150 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:06:18.868846 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419153 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:06:18.868846 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419157 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:06:18.868846 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419160 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:06:18.868846 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419164 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:06:18.868846 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419167 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:06:18.868846 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419170 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:06:18.868846 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419174 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:06:18.868846 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419176 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:06:18.868846 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419179 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:06:18.868846 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419182 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:06:18.868846 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.419187 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 18:06:18.868846 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419320 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 23 18:06:18.868846 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419325 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 23 18:06:18.868846 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419328 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 23 18:06:18.869339 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419331 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 23 18:06:18.869339 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419334 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 23 18:06:18.869339 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419337 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 23 18:06:18.869339 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419340 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 23 18:06:18.869339 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419342 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 23 18:06:18.869339 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419345 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 23 18:06:18.869339 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419348 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 23 18:06:18.869339 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419350 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 23 18:06:18.869339 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419353 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 23 18:06:18.869339 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419356 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 23 18:06:18.869339 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419358 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 23 18:06:18.869339 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419361 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 23 18:06:18.869339 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419363 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 23 18:06:18.869339 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419366 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 23 18:06:18.869339 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419369 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 23 18:06:18.869339 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419372 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 23 18:06:18.869339 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419374 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 23 18:06:18.869339 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419377 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 23 18:06:18.869339 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419379 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 23 18:06:18.869339 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419382 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 23 18:06:18.869897 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419384 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 23 18:06:18.869897 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419387 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 23 18:06:18.869897 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419390 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 23 18:06:18.869897 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419392 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 23 18:06:18.869897 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419394 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 23 18:06:18.869897 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419397 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 23 18:06:18.869897 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419400 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 23 18:06:18.869897 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419402 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 23 18:06:18.869897 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419405 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 23 18:06:18.869897 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419407 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 23 18:06:18.869897 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419410 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 23 18:06:18.869897 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419412 2575 feature_gate.go:328] unrecognized feature gate: Example Jul 23 18:06:18.869897 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419415 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 23 18:06:18.869897 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419418 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 23 18:06:18.869897 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419420 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 23 18:06:18.869897 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419423 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 23 18:06:18.869897 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419426 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 23 18:06:18.869897 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419428 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 23 18:06:18.869897 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419431 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 23 18:06:18.869897 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419433 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 23 18:06:18.870467 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419436 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 23 18:06:18.870467 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419438 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 23 18:06:18.870467 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419441 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 23 18:06:18.870467 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419443 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 23 18:06:18.870467 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419448 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 23 18:06:18.870467 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419452 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 23 18:06:18.870467 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419454 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 23 18:06:18.870467 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419457 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 23 18:06:18.870467 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419460 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 23 18:06:18.870467 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419462 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 23 18:06:18.870467 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419464 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 23 18:06:18.870467 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419467 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 23 18:06:18.870467 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419470 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 23 18:06:18.870467 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419473 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 23 18:06:18.870467 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419476 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 23 18:06:18.870467 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419479 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 23 18:06:18.870467 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419481 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 23 18:06:18.870467 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419484 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 23 18:06:18.870467 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419487 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jul 23 18:06:18.870467 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419489 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 23 18:06:18.871003 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419492 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 23 18:06:18.871003 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419494 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 23 18:06:18.871003 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419496 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 23 18:06:18.871003 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419499 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 23 18:06:18.871003 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419501 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 23 18:06:18.871003 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419504 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 23 18:06:18.871003 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419506 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 23 18:06:18.871003 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419509 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 23 18:06:18.871003 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419511 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 23 18:06:18.871003 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419514 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 23 18:06:18.871003 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419516 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 23 18:06:18.871003 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419519 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 23 18:06:18.871003 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419521 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 23 18:06:18.871003 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419524 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 23 18:06:18.871003 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419526 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 23 18:06:18.871003 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419529 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 23 18:06:18.871003 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419533 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 23 18:06:18.871003 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419537 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 23 18:06:18.871003 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419541 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 23 18:06:18.871528 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419544 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 23 18:06:18.871528 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419548 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 23 18:06:18.871528 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419550 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 23 18:06:18.871528 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419553 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 23 18:06:18.871528 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419556 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 23 18:06:18.871528 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419560 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 23 18:06:18.871528 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419563 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 23 18:06:18.871528 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419566 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 23 18:06:18.871528 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419568 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 23 18:06:18.871528 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419571 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 23 18:06:18.871528 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419574 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 23 18:06:18.871528 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419577 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 23 18:06:18.871528 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419581 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 23 18:06:18.871528 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419584 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 23 18:06:18.871528 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419587 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 23 18:06:18.871528 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419590 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 23 18:06:18.871528 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:18.419592 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 23 18:06:18.871991 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.419597 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 23 18:06:18.871991 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.419729 2575 server.go:962] "Client rotation is on, will bootstrap in background" Jul 23 18:06:18.871991 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.422152 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 23 18:06:18.871991 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.423899 2575 server.go:1019] "Starting client certificate rotation" Jul 23 18:06:18.871991 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.423998 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 18:06:18.871991 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.424038 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 23 18:06:18.871991 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.426604 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 18:06:18.871991 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.432831 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 23 18:06:18.871991 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.450974 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 18:06:18.871991 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.451358 2575 log.go:25] "Validated CRI v1 runtime API" Jul 23 18:06:18.871991 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.455714 2575 log.go:25] "Validated CRI v1 image API" Jul 23 18:06:18.871991 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.456458 2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 23 18:06:18.872364 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.459084 2575 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c12b4fb9-e9f2-4d10-b009-e9727e8db29a:/dev/nvme0n1p4 dd44915b-83d1-48cc-bdd6-588cccb5c53f:/dev/nvme0n1p3] Jul 23 18:06:18.872364 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.459101 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 23 18:06:18.872586 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.465116 2575 manager.go:216] Machine: {Timestamp:2026-07-23 18:06:18.463660721 +0000 UTC m=+0.381250434 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3089902 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25ed6fc30dceb4d2c61e3477b85625 SystemUUID:ec25ed6f-c30d-ceb4-d2c6-1e3477b85625 BootID:48824e3d-563b-49c4-b429-740bed1cc210 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5d:9e:7e:3e:3b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5d:9e:7e:3e:3b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:a4:ba:bb:de:f0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 23 18:06:18.872586 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.465231 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 23 18:06:18.872586 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.465316 2575 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 23 18:06:18.872586 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.468978 2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 23 18:06:18.872586 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.469008 2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-200.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 23 18:06:18.872586 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.469862 2575 topology_manager.go:138] "Creating topology manager with none policy" Jul 23 18:06:18.872586 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.469873 2575 container_manager_linux.go:309] "Creating device plugin manager" Jul 23 18:06:18.872586 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.469881 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 18:06:18.872586 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.469896 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 23 18:06:18.872586 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.471921 2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 23 18:06:18.872586 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.476790 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 23 18:06:18.872586 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.476914 2575 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 23 18:06:18.872586 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.476942 2575 kubelet.go:486] "Attempting to sync node with API server" Jul 23 18:06:18.872586 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.476958 2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 23 18:06:18.872586 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.476975 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 23 18:06:18.872586 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.476986 2575 kubelet.go:398] "Adding apiserver pod source" Jul 23 18:06:18.872586 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.476999 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 23 18:06:18.872586 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.477414 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.477430 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.479823 2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.482419 2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.482447 2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.483853 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.483868 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.483873 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.483879 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.483887 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.483892 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.483900 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.483906 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.483913 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.483919 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.483936 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.483941 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.484783 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.484790 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.488500 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-200.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.488766 2575 server.go:1268] "Started kubelet" Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.489604 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:18.489661 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:18.489580 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-200.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.489942 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.490137 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.492273 2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.493133 2575 server.go:310] "Adding debug handlers to kubelet server" Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:18.496627 2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:18.498230 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-200.ec2.internal.18c4fd68b449dc23 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-200.ec2.internal,UID:ip-10-0-135-200.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-200.ec2.internal,},FirstTimestamp:2026-07-23 18:06:18.488724515 +0000 UTC m=+0.406314209,LastTimestamp:2026-07-23 18:06:18.488724515 +0000 UTC m=+0.406314209,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-200.ec2.internal,}" Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.503104 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.503103 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:18.503183 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-200.ec2.internal\" not found" Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.503983 2575 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.503991 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.503999 2575 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.504055 2575 factory.go:55] Registering systemd factory Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.504068 2575 reconstruct.go:97] "Volume reconstruction finished" Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.504077 2575 reconciler.go:29] "Reconciler: start to sync state" Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.504091 2575 factory.go:223] Registration of the systemd container factory successfully Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.504304 2575 factory.go:153] Registering CRI-O factory Jul 23 18:06:18.876635 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.504319 2575 factory.go:223] Registration of the crio container factory successfully Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.504371 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.504395 2575 factory.go:103] Registering Raw factory Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.504408 2575 manager.go:1196] Started watching for new ooms in manager Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.504886 2575 manager.go:349] Starting recovery of all containers Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.511094 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4tbbx" Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:18.517106 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:18.517232 2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-200.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.519077 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4tbbx" Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.519501 2575 manager.go:354] Recovery completed Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.524243 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.526356 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.526383 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.526396 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.526944 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.526954 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.526951 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.526974 2575 state_mem.go:36] "Initialized new in-memory state store" Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.527722 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.527762 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.527773 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:18.528855 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-200.ec2.internal.18c4fd68b6883d28 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-200.ec2.internal,UID:ip-10-0-135-200.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-200.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-200.ec2.internal,},FirstTimestamp:2026-07-23 18:06:18.526367016 +0000 UTC m=+0.443956709,LastTimestamp:2026-07-23 18:06:18.526367016 +0000 UTC m=+0.443956709,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-200.ec2.internal,}" Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.529939 2575 policy_none.go:49] "None policy: Start" Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.529959 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.529974 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.534314 2575 policy_none.go:47] "Start" Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.588215 2575 manager.go:337] "Starting Device Plugin manager" Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:18.588247 2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.588258 2575 server.go:87] "Starting device plugin registration server" Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.588574 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.588592 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.588663 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.588758 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.588766 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:18.590481 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:18.590539 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-200.ec2.internal\" not found" Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.612767 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.613970 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.614004 2575 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 23 18:06:19.021855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.614025 2575 kubelet.go:2448] "Starting kubelet main sync loop" Jul 23 18:06:19.024253 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:18.614064 2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 23 18:06:19.024253 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.615836 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 18:06:19.024253 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.688696 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:06:19.024253 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.689707 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:06:19.024253 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.689736 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:06:19.024253 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.689750 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:06:19.024253 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.689778 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-200.ec2.internal" Jul 23 18:06:19.024253 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.696169 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-200.ec2.internal" Jul 23 18:06:19.024253 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:18.696189 2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-200.ec2.internal\": node \"ip-10-0-135-200.ec2.internal\" not found" Jul 23 18:06:19.024253 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.714701 2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-200.ec2.internal"] Jul 23 18:06:19.024253 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.714764 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:06:19.024253 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.717202 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:06:19.024253 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.717249 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:06:19.024253 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.717273 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:06:19.024253 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.719887 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:06:19.024253 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.720018 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" Jul 23 18:06:19.024253 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.720047 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:06:19.024253 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.720699 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:06:19.024253 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.720730 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:06:19.024253 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.720741 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:06:19.024253 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.720701 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:06:19.024253 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.720812 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:06:19.024253 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.720826 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:06:19.024253 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.723291 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-200.ec2.internal" Jul 23 18:06:19.024253 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.723324 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 23 18:06:19.024253 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.724111 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasSufficientMemory" Jul 23 18:06:19.024253 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.724139 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasNoDiskPressure" Jul 23 18:06:19.024253 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.724155 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeHasSufficientPID" Jul 23 18:06:19.024253 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:18.725785 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-200.ec2.internal\" not found" Jul 23 18:06:19.024253 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:18.756900 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-200.ec2.internal\" not found" node="ip-10-0-135-200.ec2.internal" Jul 23 18:06:19.024253 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:18.761629 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-200.ec2.internal\" not found" node="ip-10-0-135-200.ec2.internal" Jul 23 18:06:19.024253 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.804966 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/87c58bfe3b1f43bc115912c50bda5b58-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal\" (UID: \"87c58bfe3b1f43bc115912c50bda5b58\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" Jul 23 18:06:19.024253 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.805002 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87c58bfe3b1f43bc115912c50bda5b58-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal\" (UID: \"87c58bfe3b1f43bc115912c50bda5b58\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" Jul 23 18:06:19.025196 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.805019 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2a94965afd49ccda17885f2b9c0f7cb3-config\") pod \"kube-apiserver-proxy-ip-10-0-135-200.ec2.internal\" (UID: \"2a94965afd49ccda17885f2b9c0f7cb3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-200.ec2.internal" Jul 23 18:06:19.025196 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:18.825833 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-200.ec2.internal\" not found" Jul 23 18:06:19.025196 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.905241 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87c58bfe3b1f43bc115912c50bda5b58-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal\" (UID: \"87c58bfe3b1f43bc115912c50bda5b58\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" Jul 23 18:06:19.025196 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.905277 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2a94965afd49ccda17885f2b9c0f7cb3-config\") pod \"kube-apiserver-proxy-ip-10-0-135-200.ec2.internal\" (UID: \"2a94965afd49ccda17885f2b9c0f7cb3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-200.ec2.internal" Jul 23 18:06:19.025196 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.905301 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/87c58bfe3b1f43bc115912c50bda5b58-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal\" (UID: \"87c58bfe3b1f43bc115912c50bda5b58\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" Jul 23 18:06:19.025196 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.905347 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87c58bfe3b1f43bc115912c50bda5b58-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal\" (UID: \"87c58bfe3b1f43bc115912c50bda5b58\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" Jul 23 18:06:19.025196 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.905377 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2a94965afd49ccda17885f2b9c0f7cb3-config\") pod \"kube-apiserver-proxy-ip-10-0-135-200.ec2.internal\" (UID: \"2a94965afd49ccda17885f2b9c0f7cb3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-200.ec2.internal" Jul 23 18:06:19.025196 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:18.905347 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/87c58bfe3b1f43bc115912c50bda5b58-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal\" (UID: \"87c58bfe3b1f43bc115912c50bda5b58\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" Jul 23 18:06:19.025196 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:18.926353 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-200.ec2.internal\" not found" Jul 23 18:06:19.113285 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:19.027120 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-200.ec2.internal\" not found" Jul 23 18:06:19.113285 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:19.060300 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" Jul 23 18:06:19.113285 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:19.063910 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-200.ec2.internal" Jul 23 18:06:19.234903 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:19.127966 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-200.ec2.internal\" not found" Jul 23 18:06:19.234903 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:19.228418 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-200.ec2.internal\" not found" Jul 23 18:06:19.358810 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:19.318121 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 18:06:19.358810 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:19.328875 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-200.ec2.internal\" not found" Jul 23 18:06:19.501881 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:19.423325 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 23 18:06:19.501881 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:19.423472 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 18:06:19.501881 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:19.423472 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 23 18:06:19.501881 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:19.429616 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-200.ec2.internal\" not found" Jul 23 18:06:19.616522 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:19.525133 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-22 18:01:19 +0000 UTC" deadline="2028-01-14 13:32:04.547161319 +0000 UTC" Jul 23 18:06:19.616522 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:19.525179 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12955h25m45.021986395s" Jul 23 18:06:19.616522 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:19.530273 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-200.ec2.internal\" not found" Jul 23 18:06:19.739736 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:19.631209 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-200.ec2.internal\" not found" Jul 23 18:06:19.739736 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:19.732049 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-200.ec2.internal\" not found" Jul 23 18:06:19.879565 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:19.753011 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 18:06:19.879565 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:19.790175 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 18:06:19.879565 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:19.803427 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a94965afd49ccda17885f2b9c0f7cb3.slice/crio-e28d4faac02d4546393638ef05107c7f3ed1d25fb42e10d96d1c8b4ff595f0a9 WatchSource:0}: Error finding container e28d4faac02d4546393638ef05107c7f3ed1d25fb42e10d96d1c8b4ff595f0a9: Status 404 returned error can't find the container with id e28d4faac02d4546393638ef05107c7f3ed1d25fb42e10d96d1c8b4ff595f0a9 Jul 23 18:06:19.879565 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:19.803444 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-200.ec2.internal" Jul 23 18:06:19.879565 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:19.809148 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 18:06:19.879565 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:19.813632 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87c58bfe3b1f43bc115912c50bda5b58.slice/crio-cc74e15c0199ca25e13c1420f726bf0315ee57179508009b25da2eff4eb75e41 WatchSource:0}: Error finding container cc74e15c0199ca25e13c1420f726bf0315ee57179508009b25da2eff4eb75e41: Status 404 returned error can't find the container with id cc74e15c0199ca25e13c1420f726bf0315ee57179508009b25da2eff4eb75e41 Jul 23 18:06:19.879565 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:19.816024 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 18:06:19.879565 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:19.817312 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" Jul 23 18:06:19.879565 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:19.829599 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 23 18:06:20.507162 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.452655 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 18:06:20.507162 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.478620 2575 apiserver.go:52] "Watching apiserver" Jul 23 18:06:20.507162 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.488406 2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 23 18:06:20.507162 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.490915 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-rlbzs","openshift-multus/network-metrics-daemon-rpldf","openshift-network-diagnostics/network-check-target-rxckm","openshift-network-operator/iptables-alerter-nwp4l","kube-system/global-pull-secret-syncer-v4vxx","openshift-cluster-node-tuning-operator/tuned-299wk","openshift-dns/node-resolver-l4hls","openshift-image-registry/node-ca-29thx","openshift-multus/multus-additional-cni-plugins-fps7b","openshift-ovn-kubernetes/ovnkube-node-s2l8h","kube-system/konnectivity-agent-gbpfx","kube-system/kube-apiserver-proxy-ip-10-0-135-200.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xj2dq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal"] Jul 23 18:06:20.507162 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.493753 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l4hls" Jul 23 18:06:20.507162 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.497999 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 23 18:06:20.507162 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.498051 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 23 18:06:20.507162 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.498247 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xj2dq" Jul 23 18:06:20.507162 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.498305 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v6b6s\"" Jul 23 18:06:20.507162 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.500407 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxckm" Jul 23 18:06:20.507162 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:20.500483 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxckm" podUID="11c5ec1b-2dbf-49cf-9f93-fef53f4007e2" Jul 23 18:06:20.507162 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.500788 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 23 18:06:20.507162 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.500929 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 23 18:06:20.507162 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.501003 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-z4jgn\"" Jul 23 18:06:20.507162 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.501133 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 23 18:06:20.507162 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.502884 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nwp4l" Jul 23 18:06:20.507162 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.504273 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 23 18:06:20.507162 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.505235 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:06:20.507162 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:20.505318 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4vxx" podUID="3ec5e15a-5e12-4225-becb-4590f3039255" Jul 23 18:06:20.507162 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.505447 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 23 18:06:20.507162 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.505558 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dxzmz\"" Jul 23 18:06:20.507162 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.505572 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 23 18:06:20.507162 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.505866 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 23 18:06:20.508769 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.507671 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.511897 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.510337 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fps7b" Jul 23 18:06:20.511897 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.511392 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tf7r6\"" Jul 23 18:06:20.521688 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.513666 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 23 18:06:20.521688 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.513872 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 23 18:06:20.521688 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.514051 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.521688 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.515570 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 23 18:06:20.521688 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.515843 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 23 18:06:20.521688 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.515859 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 23 18:06:20.521688 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.515976 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 23 18:06:20.521688 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.516055 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xndfs\"" Jul 23 18:06:20.521688 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.516438 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:06:20.521688 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:20.516516 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpldf" podUID="0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b" Jul 23 18:06:20.521688 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.516802 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 23 18:06:20.521688 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.517321 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-chnk8\"" Jul 23 18:06:20.521688 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.517590 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 23 18:06:20.521688 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.520659 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.521688 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.520871 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3ec5e15a-5e12-4225-becb-4590f3039255-kubelet-config\") pod \"global-pull-secret-syncer-v4vxx\" (UID: \"3ec5e15a-5e12-4225-becb-4590f3039255\") " pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:06:20.521688 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.520914 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ec5e15a-5e12-4225-becb-4590f3039255-original-pull-secret\") pod \"global-pull-secret-syncer-v4vxx\" (UID: \"3ec5e15a-5e12-4225-becb-4590f3039255\") " pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:06:20.521688 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.520944 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/89ab6665-15e8-4c0c-9fab-2002482c8ac7-socket-dir\") pod \"aws-ebs-csi-driver-node-xj2dq\" (UID: \"89ab6665-15e8-4c0c-9fab-2002482c8ac7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xj2dq" Jul 23 18:06:20.521688 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.520972 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/89ab6665-15e8-4c0c-9fab-2002482c8ac7-device-dir\") pod \"aws-ebs-csi-driver-node-xj2dq\" (UID: \"89ab6665-15e8-4c0c-9fab-2002482c8ac7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xj2dq" Jul 23 18:06:20.521688 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.521002 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6g5p\" (UniqueName: \"kubernetes.io/projected/11c5ec1b-2dbf-49cf-9f93-fef53f4007e2-kube-api-access-l6g5p\") pod \"network-check-target-rxckm\" (UID: \"11c5ec1b-2dbf-49cf-9f93-fef53f4007e2\") " pod="openshift-network-diagnostics/network-check-target-rxckm" Jul 23 18:06:20.521688 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.521036 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/89ab6665-15e8-4c0c-9fab-2002482c8ac7-sys-fs\") pod \"aws-ebs-csi-driver-node-xj2dq\" (UID: \"89ab6665-15e8-4c0c-9fab-2002482c8ac7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xj2dq" Jul 23 18:06:20.521688 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.521064 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b44a91e6-fc2b-4a02-ab9d-80eb66a9aed9-iptables-alerter-script\") pod \"iptables-alerter-nwp4l\" (UID: \"b44a91e6-fc2b-4a02-ab9d-80eb66a9aed9\") " pod="openshift-network-operator/iptables-alerter-nwp4l" Jul 23 18:06:20.521688 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.521088 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3ec5e15a-5e12-4225-becb-4590f3039255-dbus\") pod \"global-pull-secret-syncer-v4vxx\" (UID: \"3ec5e15a-5e12-4225-becb-4590f3039255\") " pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:06:20.521688 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.521121 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/81fdcc97-775f-49ca-bdea-b6ce801091bc-hosts-file\") pod \"node-resolver-l4hls\" (UID: \"81fdcc97-775f-49ca-bdea-b6ce801091bc\") " pod="openshift-dns/node-resolver-l4hls" Jul 23 18:06:20.532948 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.521148 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d65hp\" (UniqueName: \"kubernetes.io/projected/81fdcc97-775f-49ca-bdea-b6ce801091bc-kube-api-access-d65hp\") pod \"node-resolver-l4hls\" (UID: \"81fdcc97-775f-49ca-bdea-b6ce801091bc\") " pod="openshift-dns/node-resolver-l4hls" Jul 23 18:06:20.532948 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.521172 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/89ab6665-15e8-4c0c-9fab-2002482c8ac7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xj2dq\" (UID: \"89ab6665-15e8-4c0c-9fab-2002482c8ac7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xj2dq" Jul 23 18:06:20.532948 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.521194 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/89ab6665-15e8-4c0c-9fab-2002482c8ac7-etc-selinux\") pod \"aws-ebs-csi-driver-node-xj2dq\" (UID: \"89ab6665-15e8-4c0c-9fab-2002482c8ac7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xj2dq" Jul 23 18:06:20.532948 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.521217 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7kkd\" (UniqueName: \"kubernetes.io/projected/89ab6665-15e8-4c0c-9fab-2002482c8ac7-kube-api-access-t7kkd\") pod \"aws-ebs-csi-driver-node-xj2dq\" (UID: \"89ab6665-15e8-4c0c-9fab-2002482c8ac7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xj2dq" Jul 23 18:06:20.532948 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.521241 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b44a91e6-fc2b-4a02-ab9d-80eb66a9aed9-host-slash\") pod \"iptables-alerter-nwp4l\" (UID: \"b44a91e6-fc2b-4a02-ab9d-80eb66a9aed9\") " pod="openshift-network-operator/iptables-alerter-nwp4l" Jul 23 18:06:20.532948 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.521267 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svjsd\" (UniqueName: \"kubernetes.io/projected/b44a91e6-fc2b-4a02-ab9d-80eb66a9aed9-kube-api-access-svjsd\") pod \"iptables-alerter-nwp4l\" (UID: \"b44a91e6-fc2b-4a02-ab9d-80eb66a9aed9\") " pod="openshift-network-operator/iptables-alerter-nwp4l" Jul 23 18:06:20.532948 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.521306 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81fdcc97-775f-49ca-bdea-b6ce801091bc-tmp-dir\") pod \"node-resolver-l4hls\" (UID: \"81fdcc97-775f-49ca-bdea-b6ce801091bc\") " pod="openshift-dns/node-resolver-l4hls" Jul 23 18:06:20.532948 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.521335 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/89ab6665-15e8-4c0c-9fab-2002482c8ac7-registration-dir\") pod \"aws-ebs-csi-driver-node-xj2dq\" (UID: \"89ab6665-15e8-4c0c-9fab-2002482c8ac7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xj2dq" Jul 23 18:06:20.532948 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.521839 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 23 18:06:20.532948 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.523470 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gbpfx" Jul 23 18:06:20.532948 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.524554 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b464f\"" Jul 23 18:06:20.532948 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.524747 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 23 18:06:20.532948 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.525167 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 23 18:06:20.532948 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.525379 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 23 18:06:20.532948 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.525676 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 23 18:06:20.532948 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.525905 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 23 18:06:20.532948 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.526098 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 23 18:06:20.532948 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.526318 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 23 18:06:20.532948 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.526520 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 23 18:06:20.532948 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.526878 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8zbnz\"" Jul 23 18:06:20.532948 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.526975 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-29thx" Jul 23 18:06:20.532948 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.532745 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 23 18:06:20.532948 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.532783 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 23 18:06:20.532948 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.532913 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 23 18:06:20.534326 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.532968 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vcvgv\"" Jul 23 18:06:20.627573 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.565456 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-h5475" Jul 23 18:06:20.627573 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.575476 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-h5475" Jul 23 18:06:20.627573 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.608174 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 23 18:06:20.627573 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.620285 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" event={"ID":"87c58bfe3b1f43bc115912c50bda5b58","Type":"ContainerStarted","Data":"cc74e15c0199ca25e13c1420f726bf0315ee57179508009b25da2eff4eb75e41"} Jul 23 18:06:20.627573 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.621630 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/82dbe848-f82c-4ff9-a7cc-7c97ee5e37c9-serviceca\") pod \"node-ca-29thx\" (UID: \"82dbe848-f82c-4ff9-a7cc-7c97ee5e37c9\") " pod="openshift-image-registry/node-ca-29thx" Jul 23 18:06:20.627573 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.621685 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mggjn\" (UniqueName: \"kubernetes.io/projected/82dbe848-f82c-4ff9-a7cc-7c97ee5e37c9-kube-api-access-mggjn\") pod \"node-ca-29thx\" (UID: \"82dbe848-f82c-4ff9-a7cc-7c97ee5e37c9\") " pod="openshift-image-registry/node-ca-29thx" Jul 23 18:06:20.627573 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.621730 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d65hp\" (UniqueName: \"kubernetes.io/projected/81fdcc97-775f-49ca-bdea-b6ce801091bc-kube-api-access-d65hp\") pod \"node-resolver-l4hls\" (UID: \"81fdcc97-775f-49ca-bdea-b6ce801091bc\") " pod="openshift-dns/node-resolver-l4hls" Jul 23 18:06:20.627573 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.621751 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7kkd\" (UniqueName: \"kubernetes.io/projected/89ab6665-15e8-4c0c-9fab-2002482c8ac7-kube-api-access-t7kkd\") pod \"aws-ebs-csi-driver-node-xj2dq\" (UID: \"89ab6665-15e8-4c0c-9fab-2002482c8ac7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xj2dq" Jul 23 18:06:20.627573 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.621775 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-var-lib-kubelet\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.627573 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.621799 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-etc-tuned\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.627573 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.621823 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-649b4\" (UniqueName: \"kubernetes.io/projected/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-kube-api-access-649b4\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.627573 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.621854 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-system-cni-dir\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.627573 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.621872 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-host-var-lib-cni-multus\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.627573 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.621895 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e5fe41d-ada3-4ef4-8a18-facdc8037fec-cnibin\") pod \"multus-additional-cni-plugins-fps7b\" (UID: \"7e5fe41d-ada3-4ef4-8a18-facdc8037fec\") " pod="openshift-multus/multus-additional-cni-plugins-fps7b" Jul 23 18:06:20.627573 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.621921 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81fdcc97-775f-49ca-bdea-b6ce801091bc-tmp-dir\") pod \"node-resolver-l4hls\" (UID: \"81fdcc97-775f-49ca-bdea-b6ce801091bc\") " pod="openshift-dns/node-resolver-l4hls" Jul 23 18:06:20.627573 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.621940 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/89ab6665-15e8-4c0c-9fab-2002482c8ac7-registration-dir\") pod \"aws-ebs-csi-driver-node-xj2dq\" (UID: \"89ab6665-15e8-4c0c-9fab-2002482c8ac7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xj2dq" Jul 23 18:06:20.627573 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622000 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/65f9df7d-8a39-4000-b505-92cb839f2d94-ovnkube-script-lib\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.627573 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622030 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82dbe848-f82c-4ff9-a7cc-7c97ee5e37c9-host\") pod \"node-ca-29thx\" (UID: \"82dbe848-f82c-4ff9-a7cc-7c97ee5e37c9\") " pod="openshift-image-registry/node-ca-29thx" Jul 23 18:06:20.627573 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622053 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-etc-kubernetes\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.636797 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622076 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/65f9df7d-8a39-4000-b505-92cb839f2d94-ovnkube-config\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.636797 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622103 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3ec5e15a-5e12-4225-becb-4590f3039255-dbus\") pod \"global-pull-secret-syncer-v4vxx\" (UID: \"3ec5e15a-5e12-4225-becb-4590f3039255\") " pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:06:20.636797 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622132 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-etc-systemd\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.636797 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622157 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4l8k\" (UniqueName: \"kubernetes.io/projected/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-kube-api-access-l4l8k\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.636797 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622193 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e5fe41d-ada3-4ef4-8a18-facdc8037fec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fps7b\" (UID: \"7e5fe41d-ada3-4ef4-8a18-facdc8037fec\") " pod="openshift-multus/multus-additional-cni-plugins-fps7b" Jul 23 18:06:20.636797 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622220 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-run-ovn\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.636797 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622249 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/65f9df7d-8a39-4000-b505-92cb839f2d94-env-overrides\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.636797 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622277 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/81fdcc97-775f-49ca-bdea-b6ce801091bc-hosts-file\") pod \"node-resolver-l4hls\" (UID: \"81fdcc97-775f-49ca-bdea-b6ce801091bc\") " pod="openshift-dns/node-resolver-l4hls" Jul 23 18:06:20.636797 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622306 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svjsd\" (UniqueName: \"kubernetes.io/projected/b44a91e6-fc2b-4a02-ab9d-80eb66a9aed9-kube-api-access-svjsd\") pod \"iptables-alerter-nwp4l\" (UID: \"b44a91e6-fc2b-4a02-ab9d-80eb66a9aed9\") " pod="openshift-network-operator/iptables-alerter-nwp4l" Jul 23 18:06:20.636797 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622334 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ec5e15a-5e12-4225-becb-4590f3039255-original-pull-secret\") pod \"global-pull-secret-syncer-v4vxx\" (UID: \"3ec5e15a-5e12-4225-becb-4590f3039255\") " pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:06:20.636797 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622362 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-host\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.636797 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622383 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-hostroot\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.636797 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622413 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-host-run-ovn-kubernetes\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.636797 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622485 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-host-cni-bin\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.636797 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622507 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-lib-modules\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.636797 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622530 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-host-var-lib-cni-bin\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.636797 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622560 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/65f9df7d-8a39-4000-b505-92cb839f2d94-ovn-node-metrics-cert\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.640295 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622583 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6g5p\" (UniqueName: \"kubernetes.io/projected/11c5ec1b-2dbf-49cf-9f93-fef53f4007e2-kube-api-access-l6g5p\") pod \"network-check-target-rxckm\" (UID: \"11c5ec1b-2dbf-49cf-9f93-fef53f4007e2\") " pod="openshift-network-diagnostics/network-check-target-rxckm" Jul 23 18:06:20.640295 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622616 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-etc-kubernetes\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.640295 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622645 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-host-slash\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.640295 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622674 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-host-run-k8s-cni-cncf-io\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.640295 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622717 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-host-var-lib-kubelet\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.640295 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622749 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b44a91e6-fc2b-4a02-ab9d-80eb66a9aed9-iptables-alerter-script\") pod \"iptables-alerter-nwp4l\" (UID: \"b44a91e6-fc2b-4a02-ab9d-80eb66a9aed9\") " pod="openshift-network-operator/iptables-alerter-nwp4l" Jul 23 18:06:20.640295 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622778 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-etc-sysctl-d\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.640295 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622803 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-tmp\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.640295 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622822 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-multus-cni-dir\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.640295 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622841 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-cni-binary-copy\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.640295 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622860 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/89ab6665-15e8-4c0c-9fab-2002482c8ac7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xj2dq\" (UID: \"89ab6665-15e8-4c0c-9fab-2002482c8ac7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xj2dq" Jul 23 18:06:20.640295 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622885 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/89ab6665-15e8-4c0c-9fab-2002482c8ac7-etc-selinux\") pod \"aws-ebs-csi-driver-node-xj2dq\" (UID: \"89ab6665-15e8-4c0c-9fab-2002482c8ac7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xj2dq" Jul 23 18:06:20.640295 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622932 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b44a91e6-fc2b-4a02-ab9d-80eb66a9aed9-host-slash\") pod \"iptables-alerter-nwp4l\" (UID: \"b44a91e6-fc2b-4a02-ab9d-80eb66a9aed9\") " pod="openshift-network-operator/iptables-alerter-nwp4l" Jul 23 18:06:20.640295 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622958 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-multus-daemon-config\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.640295 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.622981 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-run-systemd\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.640295 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.623006 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-etc-sysconfig\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.640295 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.623027 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-etc-sysctl-conf\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.641205 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.623050 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-host-run-netns\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.641205 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.623078 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e5fe41d-ada3-4ef4-8a18-facdc8037fec-system-cni-dir\") pod \"multus-additional-cni-plugins-fps7b\" (UID: \"7e5fe41d-ada3-4ef4-8a18-facdc8037fec\") " pod="openshift-multus/multus-additional-cni-plugins-fps7b" Jul 23 18:06:20.641205 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.623097 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.641205 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.623122 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctrz5\" (UniqueName: \"kubernetes.io/projected/65f9df7d-8a39-4000-b505-92cb839f2d94-kube-api-access-ctrz5\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.641205 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.623157 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/89ab6665-15e8-4c0c-9fab-2002482c8ac7-socket-dir\") pod \"aws-ebs-csi-driver-node-xj2dq\" (UID: \"89ab6665-15e8-4c0c-9fab-2002482c8ac7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xj2dq" Jul 23 18:06:20.641205 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.623184 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/89ab6665-15e8-4c0c-9fab-2002482c8ac7-device-dir\") pod \"aws-ebs-csi-driver-node-xj2dq\" (UID: \"89ab6665-15e8-4c0c-9fab-2002482c8ac7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xj2dq" Jul 23 18:06:20.641205 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.623209 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-multus-conf-dir\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.641205 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.623234 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7e5fe41d-ada3-4ef4-8a18-facdc8037fec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fps7b\" (UID: \"7e5fe41d-ada3-4ef4-8a18-facdc8037fec\") " pod="openshift-multus/multus-additional-cni-plugins-fps7b" Jul 23 18:06:20.641205 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.623265 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-var-lib-openvswitch\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.641205 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.623288 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-node-log\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.641205 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.623304 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-log-socket\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.641205 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.623360 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-run\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.641205 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.623384 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-cnibin\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.641205 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.623409 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7e5fe41d-ada3-4ef4-8a18-facdc8037fec-os-release\") pod \"multus-additional-cni-plugins-fps7b\" (UID: \"7e5fe41d-ada3-4ef4-8a18-facdc8037fec\") " pod="openshift-multus/multus-additional-cni-plugins-fps7b" Jul 23 18:06:20.641205 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.623443 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e5fe41d-ada3-4ef4-8a18-facdc8037fec-cni-binary-copy\") pod \"multus-additional-cni-plugins-fps7b\" (UID: \"7e5fe41d-ada3-4ef4-8a18-facdc8037fec\") " pod="openshift-multus/multus-additional-cni-plugins-fps7b" Jul 23 18:06:20.641205 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.623469 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7e5fe41d-ada3-4ef4-8a18-facdc8037fec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fps7b\" (UID: \"7e5fe41d-ada3-4ef4-8a18-facdc8037fec\") " pod="openshift-multus/multus-additional-cni-plugins-fps7b" Jul 23 18:06:20.643513 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.623500 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4c9b\" (UniqueName: \"kubernetes.io/projected/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-kube-api-access-x4c9b\") pod \"network-metrics-daemon-rpldf\" (UID: \"0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b\") " pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:06:20.643513 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.623524 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-host-cni-netd\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.643513 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.623556 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3ec5e15a-5e12-4225-becb-4590f3039255-kubelet-config\") pod \"global-pull-secret-syncer-v4vxx\" (UID: \"3ec5e15a-5e12-4225-becb-4590f3039255\") " pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:06:20.643513 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.623597 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-etc-modprobe-d\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.643513 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.623654 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-sys\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.643513 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.623705 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-host-run-multus-certs\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.643513 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.623778 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9b95f1a4-e3e4-416b-a987-7d6aae5ac214-konnectivity-ca\") pod \"konnectivity-agent-gbpfx\" (UID: \"9b95f1a4-e3e4-416b-a987-7d6aae5ac214\") " pod="kube-system/konnectivity-agent-gbpfx" Jul 23 18:06:20.643513 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.623841 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-run-openvswitch\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.643513 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.623900 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9b95f1a4-e3e4-416b-a987-7d6aae5ac214-agent-certs\") pod \"konnectivity-agent-gbpfx\" (UID: \"9b95f1a4-e3e4-416b-a987-7d6aae5ac214\") " pod="kube-system/konnectivity-agent-gbpfx" Jul 23 18:06:20.643513 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.623963 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-metrics-certs\") pod \"network-metrics-daemon-rpldf\" (UID: \"0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b\") " pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:06:20.643513 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.623996 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-host-kubelet\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.643513 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.624527 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/89ab6665-15e8-4c0c-9fab-2002482c8ac7-device-dir\") pod \"aws-ebs-csi-driver-node-xj2dq\" (UID: \"89ab6665-15e8-4c0c-9fab-2002482c8ac7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xj2dq" Jul 23 18:06:20.643513 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.626542 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/89ab6665-15e8-4c0c-9fab-2002482c8ac7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xj2dq\" (UID: \"89ab6665-15e8-4c0c-9fab-2002482c8ac7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xj2dq" Jul 23 18:06:20.643513 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.626824 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/89ab6665-15e8-4c0c-9fab-2002482c8ac7-etc-selinux\") pod \"aws-ebs-csi-driver-node-xj2dq\" (UID: \"89ab6665-15e8-4c0c-9fab-2002482c8ac7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xj2dq" Jul 23 18:06:20.643513 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.627050 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b44a91e6-fc2b-4a02-ab9d-80eb66a9aed9-iptables-alerter-script\") pod \"iptables-alerter-nwp4l\" (UID: \"b44a91e6-fc2b-4a02-ab9d-80eb66a9aed9\") " pod="openshift-network-operator/iptables-alerter-nwp4l" Jul 23 18:06:20.643513 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.627614 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/81fdcc97-775f-49ca-bdea-b6ce801091bc-tmp-dir\") pod \"node-resolver-l4hls\" (UID: \"81fdcc97-775f-49ca-bdea-b6ce801091bc\") " pod="openshift-dns/node-resolver-l4hls" Jul 23 18:06:20.643513 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.627718 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3ec5e15a-5e12-4225-becb-4590f3039255-dbus\") pod \"global-pull-secret-syncer-v4vxx\" (UID: \"3ec5e15a-5e12-4225-becb-4590f3039255\") " pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:06:20.644932 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.627800 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/81fdcc97-775f-49ca-bdea-b6ce801091bc-hosts-file\") pod \"node-resolver-l4hls\" (UID: \"81fdcc97-775f-49ca-bdea-b6ce801091bc\") " pod="openshift-dns/node-resolver-l4hls" Jul 23 18:06:20.644932 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.627801 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3ec5e15a-5e12-4225-becb-4590f3039255-kubelet-config\") pod \"global-pull-secret-syncer-v4vxx\" (UID: \"3ec5e15a-5e12-4225-becb-4590f3039255\") " pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:06:20.644932 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.627848 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b44a91e6-fc2b-4a02-ab9d-80eb66a9aed9-host-slash\") pod \"iptables-alerter-nwp4l\" (UID: \"b44a91e6-fc2b-4a02-ab9d-80eb66a9aed9\") " pod="openshift-network-operator/iptables-alerter-nwp4l" Jul 23 18:06:20.644932 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.627939 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/89ab6665-15e8-4c0c-9fab-2002482c8ac7-registration-dir\") pod \"aws-ebs-csi-driver-node-xj2dq\" (UID: \"89ab6665-15e8-4c0c-9fab-2002482c8ac7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xj2dq" Jul 23 18:06:20.644932 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:20.628054 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:06:20.644932 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.628051 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-200.ec2.internal" event={"ID":"2a94965afd49ccda17885f2b9c0f7cb3","Type":"ContainerStarted","Data":"e28d4faac02d4546393638ef05107c7f3ed1d25fb42e10d96d1c8b4ff595f0a9"} Jul 23 18:06:20.644932 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.624047 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-systemd-units\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.644932 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.628141 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-os-release\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.644932 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:20.628222 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ec5e15a-5e12-4225-becb-4590f3039255-original-pull-secret podName:3ec5e15a-5e12-4225-becb-4590f3039255 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:21.128194508 +0000 UTC m=+3.045784196 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ec5e15a-5e12-4225-becb-4590f3039255-original-pull-secret") pod "global-pull-secret-syncer-v4vxx" (UID: "3ec5e15a-5e12-4225-becb-4590f3039255") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:06:20.644932 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.628249 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/89ab6665-15e8-4c0c-9fab-2002482c8ac7-socket-dir\") pod \"aws-ebs-csi-driver-node-xj2dq\" (UID: \"89ab6665-15e8-4c0c-9fab-2002482c8ac7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xj2dq" Jul 23 18:06:20.644932 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.628258 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-etc-openvswitch\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.644932 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.628980 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/89ab6665-15e8-4c0c-9fab-2002482c8ac7-sys-fs\") pod \"aws-ebs-csi-driver-node-xj2dq\" (UID: \"89ab6665-15e8-4c0c-9fab-2002482c8ac7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xj2dq" Jul 23 18:06:20.644932 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.629040 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-multus-socket-dir-parent\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.644932 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.629116 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d558\" (UniqueName: \"kubernetes.io/projected/7e5fe41d-ada3-4ef4-8a18-facdc8037fec-kube-api-access-5d558\") pod \"multus-additional-cni-plugins-fps7b\" (UID: \"7e5fe41d-ada3-4ef4-8a18-facdc8037fec\") " pod="openshift-multus/multus-additional-cni-plugins-fps7b" Jul 23 18:06:20.644932 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.629153 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-host-run-netns\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.644932 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.629271 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/89ab6665-15e8-4c0c-9fab-2002482c8ac7-sys-fs\") pod \"aws-ebs-csi-driver-node-xj2dq\" (UID: \"89ab6665-15e8-4c0c-9fab-2002482c8ac7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xj2dq" Jul 23 18:06:20.644932 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.634609 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 23 18:06:20.646739 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:20.635812 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:06:20.646739 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:20.635846 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:06:20.646739 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:20.635860 2575 projected.go:196] Error preparing data for projected volume kube-api-access-l6g5p for pod openshift-network-diagnostics/network-check-target-rxckm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:06:20.646739 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:20.636983 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11c5ec1b-2dbf-49cf-9f93-fef53f4007e2-kube-api-access-l6g5p podName:11c5ec1b-2dbf-49cf-9f93-fef53f4007e2 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:21.136349224 +0000 UTC m=+3.053938903 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-l6g5p" (UniqueName: "kubernetes.io/projected/11c5ec1b-2dbf-49cf-9f93-fef53f4007e2-kube-api-access-l6g5p") pod "network-check-target-rxckm" (UID: "11c5ec1b-2dbf-49cf-9f93-fef53f4007e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:06:20.646739 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.639964 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d65hp\" (UniqueName: \"kubernetes.io/projected/81fdcc97-775f-49ca-bdea-b6ce801091bc-kube-api-access-d65hp\") pod \"node-resolver-l4hls\" (UID: \"81fdcc97-775f-49ca-bdea-b6ce801091bc\") " pod="openshift-dns/node-resolver-l4hls" Jul 23 18:06:20.646739 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.640424 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7kkd\" (UniqueName: \"kubernetes.io/projected/89ab6665-15e8-4c0c-9fab-2002482c8ac7-kube-api-access-t7kkd\") pod \"aws-ebs-csi-driver-node-xj2dq\" (UID: \"89ab6665-15e8-4c0c-9fab-2002482c8ac7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xj2dq" Jul 23 18:06:20.646739 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.642017 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svjsd\" (UniqueName: \"kubernetes.io/projected/b44a91e6-fc2b-4a02-ab9d-80eb66a9aed9-kube-api-access-svjsd\") pod \"iptables-alerter-nwp4l\" (UID: \"b44a91e6-fc2b-4a02-ab9d-80eb66a9aed9\") " pod="openshift-network-operator/iptables-alerter-nwp4l" Jul 23 18:06:20.731005 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.730068 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-etc-kubernetes\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.731005 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.730126 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/65f9df7d-8a39-4000-b505-92cb839f2d94-ovnkube-config\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.731005 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.730159 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-etc-systemd\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.731005 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.730165 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-etc-kubernetes\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.731005 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.730187 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4l8k\" (UniqueName: \"kubernetes.io/projected/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-kube-api-access-l4l8k\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.731005 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.730235 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e5fe41d-ada3-4ef4-8a18-facdc8037fec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fps7b\" (UID: \"7e5fe41d-ada3-4ef4-8a18-facdc8037fec\") " pod="openshift-multus/multus-additional-cni-plugins-fps7b" Jul 23 18:06:20.731005 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.730262 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-run-ovn\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.731005 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.730288 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/65f9df7d-8a39-4000-b505-92cb839f2d94-env-overrides\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.731005 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.730330 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-host\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.731005 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.730351 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-hostroot\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.731005 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.730377 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-host-run-ovn-kubernetes\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.731005 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.730400 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-host-cni-bin\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.731005 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.730422 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-lib-modules\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.731005 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.730446 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-host-var-lib-cni-bin\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.731005 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.730477 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/65f9df7d-8a39-4000-b505-92cb839f2d94-ovn-node-metrics-cert\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.731005 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.730507 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-etc-systemd\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.731005 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.730512 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-etc-kubernetes\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.731005 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.730537 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-host-slash\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.732193 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.730556 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-host-run-k8s-cni-cncf-io\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.732193 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.730572 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-etc-kubernetes\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.732193 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.730600 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-host-slash\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.732193 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.730614 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-host-var-lib-kubelet\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.732193 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.730627 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-host-run-k8s-cni-cncf-io\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.732193 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.730691 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-host-run-ovn-kubernetes\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.732193 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.730714 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-run-ovn\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.732193 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.730786 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7e5fe41d-ada3-4ef4-8a18-facdc8037fec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fps7b\" (UID: \"7e5fe41d-ada3-4ef4-8a18-facdc8037fec\") " pod="openshift-multus/multus-additional-cni-plugins-fps7b" Jul 23 18:06:20.732193 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.730829 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-host-cni-bin\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.732193 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.730828 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/65f9df7d-8a39-4000-b505-92cb839f2d94-ovnkube-config\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.732193 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.730951 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-lib-modules\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.732193 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.730573 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-host-var-lib-kubelet\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.732193 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.730989 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-etc-sysctl-d\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.732193 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731014 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-tmp\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.732193 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731040 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-multus-cni-dir\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.732193 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731042 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/65f9df7d-8a39-4000-b505-92cb839f2d94-env-overrides\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.732193 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731075 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-cni-binary-copy\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.732193 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731130 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-host\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.733164 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731130 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-multus-daemon-config\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.733164 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731167 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-run-systemd\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.733164 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731190 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-etc-sysconfig\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.733164 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731198 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-host-var-lib-cni-bin\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.733164 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731213 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-etc-sysctl-conf\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.733164 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731255 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-host-run-netns\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.733164 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731269 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-run-systemd\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.733164 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731283 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e5fe41d-ada3-4ef4-8a18-facdc8037fec-system-cni-dir\") pod \"multus-additional-cni-plugins-fps7b\" (UID: \"7e5fe41d-ada3-4ef4-8a18-facdc8037fec\") " pod="openshift-multus/multus-additional-cni-plugins-fps7b" Jul 23 18:06:20.733164 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731308 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.733164 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731333 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctrz5\" (UniqueName: \"kubernetes.io/projected/65f9df7d-8a39-4000-b505-92cb839f2d94-kube-api-access-ctrz5\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.733164 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731362 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-multus-conf-dir\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.733164 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731386 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7e5fe41d-ada3-4ef4-8a18-facdc8037fec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fps7b\" (UID: \"7e5fe41d-ada3-4ef4-8a18-facdc8037fec\") " pod="openshift-multus/multus-additional-cni-plugins-fps7b" Jul 23 18:06:20.733164 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731394 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-etc-sysctl-d\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.733164 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731411 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-var-lib-openvswitch\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.733164 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731437 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-node-log\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.733164 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731459 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-log-socket\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.733164 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731494 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-run\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.734041 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731515 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-cnibin\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.734041 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731537 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7e5fe41d-ada3-4ef4-8a18-facdc8037fec-os-release\") pod \"multus-additional-cni-plugins-fps7b\" (UID: \"7e5fe41d-ada3-4ef4-8a18-facdc8037fec\") " pod="openshift-multus/multus-additional-cni-plugins-fps7b" Jul 23 18:06:20.734041 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731559 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e5fe41d-ada3-4ef4-8a18-facdc8037fec-cni-binary-copy\") pod \"multus-additional-cni-plugins-fps7b\" (UID: \"7e5fe41d-ada3-4ef4-8a18-facdc8037fec\") " pod="openshift-multus/multus-additional-cni-plugins-fps7b" Jul 23 18:06:20.734041 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731587 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7e5fe41d-ada3-4ef4-8a18-facdc8037fec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fps7b\" (UID: \"7e5fe41d-ada3-4ef4-8a18-facdc8037fec\") " pod="openshift-multus/multus-additional-cni-plugins-fps7b" Jul 23 18:06:20.734041 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731612 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4c9b\" (UniqueName: \"kubernetes.io/projected/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-kube-api-access-x4c9b\") pod \"network-metrics-daemon-rpldf\" (UID: \"0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b\") " pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:06:20.734041 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731645 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-host-cni-netd\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.734041 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731669 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-etc-modprobe-d\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.734041 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731699 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-sys\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.734041 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731724 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-host-run-multus-certs\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.734041 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731769 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9b95f1a4-e3e4-416b-a987-7d6aae5ac214-konnectivity-ca\") pod \"konnectivity-agent-gbpfx\" (UID: \"9b95f1a4-e3e4-416b-a987-7d6aae5ac214\") " pod="kube-system/konnectivity-agent-gbpfx" Jul 23 18:06:20.734041 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731770 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-cni-binary-copy\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.734041 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731779 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-multus-cni-dir\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.734041 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731796 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-run-openvswitch\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.734041 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731797 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-var-lib-openvswitch\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.734041 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731170 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-hostroot\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.734041 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731838 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-run-openvswitch\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.734041 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731863 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-etc-sysconfig\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.734925 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731840 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9b95f1a4-e3e4-416b-a987-7d6aae5ac214-agent-certs\") pod \"konnectivity-agent-gbpfx\" (UID: \"9b95f1a4-e3e4-416b-a987-7d6aae5ac214\") " pod="kube-system/konnectivity-agent-gbpfx" Jul 23 18:06:20.734925 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731885 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7e5fe41d-ada3-4ef4-8a18-facdc8037fec-system-cni-dir\") pod \"multus-additional-cni-plugins-fps7b\" (UID: \"7e5fe41d-ada3-4ef4-8a18-facdc8037fec\") " pod="openshift-multus/multus-additional-cni-plugins-fps7b" Jul 23 18:06:20.734925 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731912 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-log-socket\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.734925 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731916 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-metrics-certs\") pod \"network-metrics-daemon-rpldf\" (UID: \"0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b\") " pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:06:20.734925 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731946 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-host-kubelet\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.734925 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731960 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-run\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.734925 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731976 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-systemd-units\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.734925 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.732003 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-os-release\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.734925 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.732009 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-cnibin\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.734925 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.732030 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-etc-openvswitch\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.734925 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.732060 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-multus-socket-dir-parent\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.734925 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.732066 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7e5fe41d-ada3-4ef4-8a18-facdc8037fec-os-release\") pod \"multus-additional-cni-plugins-fps7b\" (UID: \"7e5fe41d-ada3-4ef4-8a18-facdc8037fec\") " pod="openshift-multus/multus-additional-cni-plugins-fps7b" Jul 23 18:06:20.734925 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.732089 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5d558\" (UniqueName: \"kubernetes.io/projected/7e5fe41d-ada3-4ef4-8a18-facdc8037fec-kube-api-access-5d558\") pod \"multus-additional-cni-plugins-fps7b\" (UID: \"7e5fe41d-ada3-4ef4-8a18-facdc8037fec\") " pod="openshift-multus/multus-additional-cni-plugins-fps7b" Jul 23 18:06:20.734925 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.732136 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-host-run-netns\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.734925 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.732172 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/82dbe848-f82c-4ff9-a7cc-7c97ee5e37c9-serviceca\") pod \"node-ca-29thx\" (UID: \"82dbe848-f82c-4ff9-a7cc-7c97ee5e37c9\") " pod="openshift-image-registry/node-ca-29thx" Jul 23 18:06:20.734925 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.732186 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.734925 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.732197 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mggjn\" (UniqueName: \"kubernetes.io/projected/82dbe848-f82c-4ff9-a7cc-7c97ee5e37c9-kube-api-access-mggjn\") pod \"node-ca-29thx\" (UID: \"82dbe848-f82c-4ff9-a7cc-7c97ee5e37c9\") " pod="openshift-image-registry/node-ca-29thx" Jul 23 18:06:20.735779 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.732234 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-var-lib-kubelet\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.735779 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.732258 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-etc-tuned\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.735779 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.732284 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-649b4\" (UniqueName: \"kubernetes.io/projected/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-kube-api-access-649b4\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.735779 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.732310 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-system-cni-dir\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.735779 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.732335 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-host-var-lib-cni-multus\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.735779 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.732363 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e5fe41d-ada3-4ef4-8a18-facdc8037fec-cnibin\") pod \"multus-additional-cni-plugins-fps7b\" (UID: \"7e5fe41d-ada3-4ef4-8a18-facdc8037fec\") " pod="openshift-multus/multus-additional-cni-plugins-fps7b" Jul 23 18:06:20.735779 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.732397 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/65f9df7d-8a39-4000-b505-92cb839f2d94-ovnkube-script-lib\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.735779 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.732402 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-multus-daemon-config\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.735779 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.732423 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82dbe848-f82c-4ff9-a7cc-7c97ee5e37c9-host\") pod \"node-ca-29thx\" (UID: \"82dbe848-f82c-4ff9-a7cc-7c97ee5e37c9\") " pod="openshift-image-registry/node-ca-29thx" Jul 23 18:06:20.735779 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.732458 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-host-run-netns\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.735779 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.732514 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/82dbe848-f82c-4ff9-a7cc-7c97ee5e37c9-host\") pod \"node-ca-29thx\" (UID: \"82dbe848-f82c-4ff9-a7cc-7c97ee5e37c9\") " pod="openshift-image-registry/node-ca-29thx" Jul 23 18:06:20.735779 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.732611 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-etc-modprobe-d\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.735779 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.732616 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7e5fe41d-ada3-4ef4-8a18-facdc8037fec-cni-binary-copy\") pod \"multus-additional-cni-plugins-fps7b\" (UID: \"7e5fe41d-ada3-4ef4-8a18-facdc8037fec\") " pod="openshift-multus/multus-additional-cni-plugins-fps7b" Jul 23 18:06:20.735779 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.732672 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-host-cni-netd\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.735779 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.732693 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-sys\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.735779 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.732766 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/7e5fe41d-ada3-4ef4-8a18-facdc8037fec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fps7b\" (UID: \"7e5fe41d-ada3-4ef4-8a18-facdc8037fec\") " pod="openshift-multus/multus-additional-cni-plugins-fps7b" Jul 23 18:06:20.735779 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.732736 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-host-run-multus-certs\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.735779 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.731882 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-node-log\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.736523 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.733299 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-etc-sysctl-conf\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.736523 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.733290 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/7e5fe41d-ada3-4ef4-8a18-facdc8037fec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fps7b\" (UID: \"7e5fe41d-ada3-4ef4-8a18-facdc8037fec\") " pod="openshift-multus/multus-additional-cni-plugins-fps7b" Jul 23 18:06:20.736523 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.733325 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9b95f1a4-e3e4-416b-a987-7d6aae5ac214-konnectivity-ca\") pod \"konnectivity-agent-gbpfx\" (UID: \"9b95f1a4-e3e4-416b-a987-7d6aae5ac214\") " pod="kube-system/konnectivity-agent-gbpfx" Jul 23 18:06:20.736523 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.733345 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-systemd-units\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.736523 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.733379 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-os-release\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.736523 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.733387 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-etc-openvswitch\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.736523 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.733423 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-host-kubelet\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.736523 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:20.733430 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:06:20.736523 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.733474 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-multus-socket-dir-parent\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.736523 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:20.733537 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-metrics-certs podName:0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b nodeName:}" failed. No retries permitted until 2026-07-23 18:06:21.233517315 +0000 UTC m=+3.151106996 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-metrics-certs") pod "network-metrics-daemon-rpldf" (UID: "0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:06:20.736523 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.733792 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-host-var-lib-cni-multus\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.736523 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.733914 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/82dbe848-f82c-4ff9-a7cc-7c97ee5e37c9-serviceca\") pod \"node-ca-29thx\" (UID: \"82dbe848-f82c-4ff9-a7cc-7c97ee5e37c9\") " pod="openshift-image-registry/node-ca-29thx" Jul 23 18:06:20.736523 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.733969 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/65f9df7d-8a39-4000-b505-92cb839f2d94-host-run-netns\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.736523 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.734059 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-system-cni-dir\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.736523 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.734218 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7e5fe41d-ada3-4ef4-8a18-facdc8037fec-cnibin\") pod \"multus-additional-cni-plugins-fps7b\" (UID: \"7e5fe41d-ada3-4ef4-8a18-facdc8037fec\") " pod="openshift-multus/multus-additional-cni-plugins-fps7b" Jul 23 18:06:20.736523 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.734278 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-var-lib-kubelet\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.736523 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.734467 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-multus-conf-dir\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.737312 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.734794 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/65f9df7d-8a39-4000-b505-92cb839f2d94-ovnkube-script-lib\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.737312 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.737105 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-tmp\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.737312 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.737257 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9b95f1a4-e3e4-416b-a987-7d6aae5ac214-agent-certs\") pod \"konnectivity-agent-gbpfx\" (UID: \"9b95f1a4-e3e4-416b-a987-7d6aae5ac214\") " pod="kube-system/konnectivity-agent-gbpfx" Jul 23 18:06:20.741123 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.741095 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-etc-tuned\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.741792 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.741403 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/65f9df7d-8a39-4000-b505-92cb839f2d94-ovn-node-metrics-cert\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.747988 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.746768 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4l8k\" (UniqueName: \"kubernetes.io/projected/26dc96fe-1cc5-4c06-9a9f-856592e4b9b1-kube-api-access-l4l8k\") pod \"multus-rlbzs\" (UID: \"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1\") " pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.747988 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.746806 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctrz5\" (UniqueName: \"kubernetes.io/projected/65f9df7d-8a39-4000-b505-92cb839f2d94-kube-api-access-ctrz5\") pod \"ovnkube-node-s2l8h\" (UID: \"65f9df7d-8a39-4000-b505-92cb839f2d94\") " pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.748656 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.748632 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-649b4\" (UniqueName: \"kubernetes.io/projected/c4ae62d1-1f58-4490-bb0c-5bf4074452dd-kube-api-access-649b4\") pod \"tuned-299wk\" (UID: \"c4ae62d1-1f58-4490-bb0c-5bf4074452dd\") " pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.748864 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.748630 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mggjn\" (UniqueName: \"kubernetes.io/projected/82dbe848-f82c-4ff9-a7cc-7c97ee5e37c9-kube-api-access-mggjn\") pod \"node-ca-29thx\" (UID: \"82dbe848-f82c-4ff9-a7cc-7c97ee5e37c9\") " pod="openshift-image-registry/node-ca-29thx" Jul 23 18:06:20.749106 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.749043 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d558\" (UniqueName: \"kubernetes.io/projected/7e5fe41d-ada3-4ef4-8a18-facdc8037fec-kube-api-access-5d558\") pod \"multus-additional-cni-plugins-fps7b\" (UID: \"7e5fe41d-ada3-4ef4-8a18-facdc8037fec\") " pod="openshift-multus/multus-additional-cni-plugins-fps7b" Jul 23 18:06:20.749743 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.749710 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4c9b\" (UniqueName: \"kubernetes.io/projected/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-kube-api-access-x4c9b\") pod \"network-metrics-daemon-rpldf\" (UID: \"0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b\") " pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:06:20.807333 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.807238 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-l4hls" Jul 23 18:06:20.816497 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.816470 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xj2dq" Jul 23 18:06:20.822435 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:20.822392 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81fdcc97_775f_49ca_bdea_b6ce801091bc.slice/crio-7de4e918a80b58c93187443be3a0dcb4e6ca9818c9de4ea22ddf5ea50a5993fe WatchSource:0}: Error finding container 7de4e918a80b58c93187443be3a0dcb4e6ca9818c9de4ea22ddf5ea50a5993fe: Status 404 returned error can't find the container with id 7de4e918a80b58c93187443be3a0dcb4e6ca9818c9de4ea22ddf5ea50a5993fe Jul 23 18:06:20.829040 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:20.829013 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89ab6665_15e8_4c0c_9fab_2002482c8ac7.slice/crio-590275b2e08fa73ec360a330f46d0afaf0883b18bb8917071aac9b8d9a1b5039 WatchSource:0}: Error finding container 590275b2e08fa73ec360a330f46d0afaf0883b18bb8917071aac9b8d9a1b5039: Status 404 returned error can't find the container with id 590275b2e08fa73ec360a330f46d0afaf0883b18bb8917071aac9b8d9a1b5039 Jul 23 18:06:20.853648 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.853600 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nwp4l" Jul 23 18:06:20.861416 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.861390 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-299wk" Jul 23 18:06:20.867966 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:20.867916 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb44a91e6_fc2b_4a02_ab9d_80eb66a9aed9.slice/crio-1953202b20694aba136d530f8f87fabe99e9651df96e6db66d00989282bf45af WatchSource:0}: Error finding container 1953202b20694aba136d530f8f87fabe99e9651df96e6db66d00989282bf45af: Status 404 returned error can't find the container with id 1953202b20694aba136d530f8f87fabe99e9651df96e6db66d00989282bf45af Jul 23 18:06:20.870067 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.869858 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fps7b" Jul 23 18:06:20.874558 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:20.874527 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4ae62d1_1f58_4490_bb0c_5bf4074452dd.slice/crio-5ea97c15214c6d05c03935a531af08901f3340bc7496d5b106a7709041f59647 WatchSource:0}: Error finding container 5ea97c15214c6d05c03935a531af08901f3340bc7496d5b106a7709041f59647: Status 404 returned error can't find the container with id 5ea97c15214c6d05c03935a531af08901f3340bc7496d5b106a7709041f59647 Jul 23 18:06:20.882541 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:20.882512 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e5fe41d_ada3_4ef4_8a18_facdc8037fec.slice/crio-489af2b6f58e9c137de90f641289a8bbf5f9220546060acd30d0ea19c583348e WatchSource:0}: Error finding container 489af2b6f58e9c137de90f641289a8bbf5f9220546060acd30d0ea19c583348e: Status 404 returned error can't find the container with id 489af2b6f58e9c137de90f641289a8bbf5f9220546060acd30d0ea19c583348e Jul 23 18:06:20.886274 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.886068 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rlbzs" Jul 23 18:06:20.897606 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.897582 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:20.897761 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:20.897729 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26dc96fe_1cc5_4c06_9a9f_856592e4b9b1.slice/crio-f6c7eb26f053c59e22599cdf959d98d2ba9408e249dbf41e5efcce4f5bd4eff4 WatchSource:0}: Error finding container f6c7eb26f053c59e22599cdf959d98d2ba9408e249dbf41e5efcce4f5bd4eff4: Status 404 returned error can't find the container with id f6c7eb26f053c59e22599cdf959d98d2ba9408e249dbf41e5efcce4f5bd4eff4 Jul 23 18:06:20.909626 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.908366 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gbpfx" Jul 23 18:06:20.909626 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:20.908611 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65f9df7d_8a39_4000_b505_92cb839f2d94.slice/crio-b8719f769706480680b5a6e61e9c3925dd0f5b9f4d7f979490aba7636ef86237 WatchSource:0}: Error finding container b8719f769706480680b5a6e61e9c3925dd0f5b9f4d7f979490aba7636ef86237: Status 404 returned error can't find the container with id b8719f769706480680b5a6e61e9c3925dd0f5b9f4d7f979490aba7636ef86237 Jul 23 18:06:20.915398 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:20.915333 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-29thx" Jul 23 18:06:20.931440 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:20.931390 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82dbe848_f82c_4ff9_a7cc_7c97ee5e37c9.slice/crio-0c550cb0326a22b116128743cd58ece30ef6ba2da2e11d9f864c34bdffb997b1 WatchSource:0}: Error finding container 0c550cb0326a22b116128743cd58ece30ef6ba2da2e11d9f864c34bdffb997b1: Status 404 returned error can't find the container with id 0c550cb0326a22b116128743cd58ece30ef6ba2da2e11d9f864c34bdffb997b1 Jul 23 18:06:21.136045 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:21.135944 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ec5e15a-5e12-4225-becb-4590f3039255-original-pull-secret\") pod \"global-pull-secret-syncer-v4vxx\" (UID: \"3ec5e15a-5e12-4225-becb-4590f3039255\") " pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:06:21.136214 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:21.136135 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:06:21.136274 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:21.136222 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ec5e15a-5e12-4225-becb-4590f3039255-original-pull-secret podName:3ec5e15a-5e12-4225-becb-4590f3039255 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:22.136199974 +0000 UTC m=+4.053789668 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ec5e15a-5e12-4225-becb-4590f3039255-original-pull-secret") pod "global-pull-secret-syncer-v4vxx" (UID: "3ec5e15a-5e12-4225-becb-4590f3039255") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:06:21.236396 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:21.236356 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-metrics-certs\") pod \"network-metrics-daemon-rpldf\" (UID: \"0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b\") " pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:06:21.236578 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:21.236438 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6g5p\" (UniqueName: \"kubernetes.io/projected/11c5ec1b-2dbf-49cf-9f93-fef53f4007e2-kube-api-access-l6g5p\") pod \"network-check-target-rxckm\" (UID: \"11c5ec1b-2dbf-49cf-9f93-fef53f4007e2\") " pod="openshift-network-diagnostics/network-check-target-rxckm" Jul 23 18:06:21.236578 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:21.236540 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:06:21.236578 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:21.236568 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:06:21.236864 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:21.236589 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:06:21.236864 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:21.236605 2575 projected.go:196] Error preparing data for projected volume kube-api-access-l6g5p for pod openshift-network-diagnostics/network-check-target-rxckm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:06:21.236864 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:21.236629 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-metrics-certs podName:0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b nodeName:}" failed. No retries permitted until 2026-07-23 18:06:22.23660519 +0000 UTC m=+4.154194884 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-metrics-certs") pod "network-metrics-daemon-rpldf" (UID: "0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:06:21.236864 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:21.236652 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11c5ec1b-2dbf-49cf-9f93-fef53f4007e2-kube-api-access-l6g5p podName:11c5ec1b-2dbf-49cf-9f93-fef53f4007e2 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:22.236637634 +0000 UTC m=+4.154227315 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6g5p" (UniqueName: "kubernetes.io/projected/11c5ec1b-2dbf-49cf-9f93-fef53f4007e2-kube-api-access-l6g5p") pod "network-check-target-rxckm" (UID: "11c5ec1b-2dbf-49cf-9f93-fef53f4007e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:06:21.581925 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:21.581741 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 18:01:21 +0000 UTC" deadline="2028-03-08 20:52:15.298870828 +0000 UTC" Jul 23 18:06:21.581925 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:21.581821 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14258h45m53.717054234s" Jul 23 18:06:21.614423 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:21.614383 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:06:21.614586 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:21.614525 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpldf" podUID="0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b" Jul 23 18:06:21.629390 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:21.629349 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" event={"ID":"65f9df7d-8a39-4000-b505-92cb839f2d94","Type":"ContainerStarted","Data":"b8719f769706480680b5a6e61e9c3925dd0f5b9f4d7f979490aba7636ef86237"} Jul 23 18:06:21.630745 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:21.630709 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rlbzs" event={"ID":"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1","Type":"ContainerStarted","Data":"f6c7eb26f053c59e22599cdf959d98d2ba9408e249dbf41e5efcce4f5bd4eff4"} Jul 23 18:06:21.632298 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:21.632270 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nwp4l" event={"ID":"b44a91e6-fc2b-4a02-ab9d-80eb66a9aed9","Type":"ContainerStarted","Data":"1953202b20694aba136d530f8f87fabe99e9651df96e6db66d00989282bf45af"} Jul 23 18:06:21.633856 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:21.633793 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fps7b" event={"ID":"7e5fe41d-ada3-4ef4-8a18-facdc8037fec","Type":"ContainerStarted","Data":"489af2b6f58e9c137de90f641289a8bbf5f9220546060acd30d0ea19c583348e"} Jul 23 18:06:21.635193 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:21.635144 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-299wk" event={"ID":"c4ae62d1-1f58-4490-bb0c-5bf4074452dd","Type":"ContainerStarted","Data":"5ea97c15214c6d05c03935a531af08901f3340bc7496d5b106a7709041f59647"} Jul 23 18:06:21.636576 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:21.636533 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xj2dq" event={"ID":"89ab6665-15e8-4c0c-9fab-2002482c8ac7","Type":"ContainerStarted","Data":"590275b2e08fa73ec360a330f46d0afaf0883b18bb8917071aac9b8d9a1b5039"} Jul 23 18:06:21.638098 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:21.638071 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l4hls" event={"ID":"81fdcc97-775f-49ca-bdea-b6ce801091bc","Type":"ContainerStarted","Data":"7de4e918a80b58c93187443be3a0dcb4e6ca9818c9de4ea22ddf5ea50a5993fe"} Jul 23 18:06:21.640034 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:21.640007 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-29thx" event={"ID":"82dbe848-f82c-4ff9-a7cc-7c97ee5e37c9","Type":"ContainerStarted","Data":"0c550cb0326a22b116128743cd58ece30ef6ba2da2e11d9f864c34bdffb997b1"} Jul 23 18:06:21.641944 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:21.641919 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gbpfx" event={"ID":"9b95f1a4-e3e4-416b-a987-7d6aae5ac214","Type":"ContainerStarted","Data":"02a04681cb058c4ec8b7d4f1ee9d3f38e7c3723874324d510dfd4820c32f82a8"} Jul 23 18:06:21.820126 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:21.819725 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 23 18:06:22.144298 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:22.144173 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ec5e15a-5e12-4225-becb-4590f3039255-original-pull-secret\") pod \"global-pull-secret-syncer-v4vxx\" (UID: \"3ec5e15a-5e12-4225-becb-4590f3039255\") " pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:06:22.144504 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:22.144411 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:06:22.144504 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:22.144501 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ec5e15a-5e12-4225-becb-4590f3039255-original-pull-secret podName:3ec5e15a-5e12-4225-becb-4590f3039255 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:24.14447931 +0000 UTC m=+6.062069004 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ec5e15a-5e12-4225-becb-4590f3039255-original-pull-secret") pod "global-pull-secret-syncer-v4vxx" (UID: "3ec5e15a-5e12-4225-becb-4590f3039255") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:06:22.245536 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:22.245486 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6g5p\" (UniqueName: \"kubernetes.io/projected/11c5ec1b-2dbf-49cf-9f93-fef53f4007e2-kube-api-access-l6g5p\") pod \"network-check-target-rxckm\" (UID: \"11c5ec1b-2dbf-49cf-9f93-fef53f4007e2\") " pod="openshift-network-diagnostics/network-check-target-rxckm" Jul 23 18:06:22.245760 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:22.245572 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-metrics-certs\") pod \"network-metrics-daemon-rpldf\" (UID: \"0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b\") " pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:06:22.245760 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:22.245712 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:06:22.245884 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:22.245798 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-metrics-certs podName:0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b nodeName:}" failed. No retries permitted until 2026-07-23 18:06:24.245778598 +0000 UTC m=+6.163368293 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-metrics-certs") pod "network-metrics-daemon-rpldf" (UID: "0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:06:22.245965 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:22.245878 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:06:22.245965 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:22.245909 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:06:22.245965 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:22.245927 2575 projected.go:196] Error preparing data for projected volume kube-api-access-l6g5p for pod openshift-network-diagnostics/network-check-target-rxckm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:06:22.246120 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:22.246000 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11c5ec1b-2dbf-49cf-9f93-fef53f4007e2-kube-api-access-l6g5p podName:11c5ec1b-2dbf-49cf-9f93-fef53f4007e2 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:24.245981235 +0000 UTC m=+6.163570931 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6g5p" (UniqueName: "kubernetes.io/projected/11c5ec1b-2dbf-49cf-9f93-fef53f4007e2-kube-api-access-l6g5p") pod "network-check-target-rxckm" (UID: "11c5ec1b-2dbf-49cf-9f93-fef53f4007e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:06:22.583244 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:22.582868 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-22 18:01:21 +0000 UTC" deadline="2028-01-27 21:52:25.650826703 +0000 UTC" Jul 23 18:06:22.583244 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:22.583151 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13275h46m3.067684847s" Jul 23 18:06:22.621734 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:22.620589 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:06:22.621734 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:22.620726 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4vxx" podUID="3ec5e15a-5e12-4225-becb-4590f3039255" Jul 23 18:06:22.621734 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:22.620930 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxckm" Jul 23 18:06:22.621734 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:22.621045 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxckm" podUID="11c5ec1b-2dbf-49cf-9f93-fef53f4007e2" Jul 23 18:06:22.658279 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:22.657291 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-200.ec2.internal" event={"ID":"2a94965afd49ccda17885f2b9c0f7cb3","Type":"ContainerStarted","Data":"1fe4a4b63d736fb2d87663e2f595d9453bb246f72f5313efb2f3692029f986b4"} Jul 23 18:06:22.676225 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:22.675920 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-200.ec2.internal" podStartSLOduration=2.6758969 podStartE2EDuration="2.6758969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:06:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:22.675389793 +0000 UTC m=+4.592979510" watchObservedRunningTime="2026-07-23 18:06:22.6758969 +0000 UTC m=+4.593486605" Jul 23 18:06:23.614273 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:23.614233 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:06:23.614781 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:23.614397 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpldf" podUID="0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b" Jul 23 18:06:23.670942 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:23.670810 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" event={"ID":"87c58bfe3b1f43bc115912c50bda5b58","Type":"ContainerStarted","Data":"cf71f32398e57f8a39a4bbb21caab2d51e6fbf90cd46f26eeb862cd1c1ec4569"} Jul 23 18:06:24.163225 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:24.163180 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ec5e15a-5e12-4225-becb-4590f3039255-original-pull-secret\") pod \"global-pull-secret-syncer-v4vxx\" (UID: \"3ec5e15a-5e12-4225-becb-4590f3039255\") " pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:06:24.163462 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:24.163366 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:06:24.163462 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:24.163433 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ec5e15a-5e12-4225-becb-4590f3039255-original-pull-secret podName:3ec5e15a-5e12-4225-becb-4590f3039255 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:28.163413758 +0000 UTC m=+10.081003459 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ec5e15a-5e12-4225-becb-4590f3039255-original-pull-secret") pod "global-pull-secret-syncer-v4vxx" (UID: "3ec5e15a-5e12-4225-becb-4590f3039255") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:06:24.264642 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:24.264552 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-metrics-certs\") pod \"network-metrics-daemon-rpldf\" (UID: \"0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b\") " pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:06:24.264867 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:24.264643 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6g5p\" (UniqueName: \"kubernetes.io/projected/11c5ec1b-2dbf-49cf-9f93-fef53f4007e2-kube-api-access-l6g5p\") pod \"network-check-target-rxckm\" (UID: \"11c5ec1b-2dbf-49cf-9f93-fef53f4007e2\") " pod="openshift-network-diagnostics/network-check-target-rxckm" Jul 23 18:06:24.264867 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:24.264831 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:06:24.264867 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:24.264851 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:06:24.264867 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:24.264865 2575 projected.go:196] Error preparing data for projected volume kube-api-access-l6g5p for pod openshift-network-diagnostics/network-check-target-rxckm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:06:24.265100 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:24.264928 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11c5ec1b-2dbf-49cf-9f93-fef53f4007e2-kube-api-access-l6g5p podName:11c5ec1b-2dbf-49cf-9f93-fef53f4007e2 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:28.264909343 +0000 UTC m=+10.182499039 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6g5p" (UniqueName: "kubernetes.io/projected/11c5ec1b-2dbf-49cf-9f93-fef53f4007e2-kube-api-access-l6g5p") pod "network-check-target-rxckm" (UID: "11c5ec1b-2dbf-49cf-9f93-fef53f4007e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:06:24.265404 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:24.265362 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:06:24.265504 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:24.265433 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-metrics-certs podName:0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b nodeName:}" failed. No retries permitted until 2026-07-23 18:06:28.265412615 +0000 UTC m=+10.183002310 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-metrics-certs") pod "network-metrics-daemon-rpldf" (UID: "0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:06:24.617696 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:24.615842 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxckm" Jul 23 18:06:24.617696 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:24.615856 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:06:24.617696 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:24.615987 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxckm" podUID="11c5ec1b-2dbf-49cf-9f93-fef53f4007e2" Jul 23 18:06:24.617696 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:24.616083 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4vxx" podUID="3ec5e15a-5e12-4225-becb-4590f3039255" Jul 23 18:06:25.614853 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:25.614819 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:06:25.615125 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:25.614956 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpldf" podUID="0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b" Jul 23 18:06:25.679735 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:25.679693 2575 generic.go:356] "Generic (PLEG): container finished" podID="87c58bfe3b1f43bc115912c50bda5b58" containerID="cf71f32398e57f8a39a4bbb21caab2d51e6fbf90cd46f26eeb862cd1c1ec4569" exitCode=0 Jul 23 18:06:25.680219 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:25.679773 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" event={"ID":"87c58bfe3b1f43bc115912c50bda5b58","Type":"ContainerDied","Data":"cf71f32398e57f8a39a4bbb21caab2d51e6fbf90cd46f26eeb862cd1c1ec4569"} Jul 23 18:06:26.614854 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:26.614730 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxckm" Jul 23 18:06:26.615055 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:26.614919 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxckm" podUID="11c5ec1b-2dbf-49cf-9f93-fef53f4007e2" Jul 23 18:06:26.615463 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:26.615431 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:06:26.615620 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:26.615549 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4vxx" podUID="3ec5e15a-5e12-4225-becb-4590f3039255" Jul 23 18:06:27.614393 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:27.614352 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:06:27.614910 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:27.614521 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpldf" podUID="0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b" Jul 23 18:06:28.199630 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:28.199586 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ec5e15a-5e12-4225-becb-4590f3039255-original-pull-secret\") pod \"global-pull-secret-syncer-v4vxx\" (UID: \"3ec5e15a-5e12-4225-becb-4590f3039255\") " pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:06:28.199847 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:28.199767 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:06:28.199847 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:28.199840 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ec5e15a-5e12-4225-becb-4590f3039255-original-pull-secret podName:3ec5e15a-5e12-4225-becb-4590f3039255 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:36.199817162 +0000 UTC m=+18.117406848 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ec5e15a-5e12-4225-becb-4590f3039255-original-pull-secret") pod "global-pull-secret-syncer-v4vxx" (UID: "3ec5e15a-5e12-4225-becb-4590f3039255") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:06:28.300016 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:28.299972 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6g5p\" (UniqueName: \"kubernetes.io/projected/11c5ec1b-2dbf-49cf-9f93-fef53f4007e2-kube-api-access-l6g5p\") pod \"network-check-target-rxckm\" (UID: \"11c5ec1b-2dbf-49cf-9f93-fef53f4007e2\") " pod="openshift-network-diagnostics/network-check-target-rxckm" Jul 23 18:06:28.300223 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:28.300058 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-metrics-certs\") pod \"network-metrics-daemon-rpldf\" (UID: \"0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b\") " pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:06:28.300223 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:28.300090 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:06:28.300223 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:28.300120 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:06:28.300223 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:28.300138 2575 projected.go:196] Error preparing data for projected volume kube-api-access-l6g5p for pod openshift-network-diagnostics/network-check-target-rxckm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:06:28.300223 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:28.300190 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:06:28.300223 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:28.300210 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11c5ec1b-2dbf-49cf-9f93-fef53f4007e2-kube-api-access-l6g5p podName:11c5ec1b-2dbf-49cf-9f93-fef53f4007e2 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:36.300188262 +0000 UTC m=+18.217778013 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6g5p" (UniqueName: "kubernetes.io/projected/11c5ec1b-2dbf-49cf-9f93-fef53f4007e2-kube-api-access-l6g5p") pod "network-check-target-rxckm" (UID: "11c5ec1b-2dbf-49cf-9f93-fef53f4007e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:06:28.300535 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:28.300249 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-metrics-certs podName:0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b nodeName:}" failed. No retries permitted until 2026-07-23 18:06:36.300231786 +0000 UTC m=+18.217821473 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-metrics-certs") pod "network-metrics-daemon-rpldf" (UID: "0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:06:28.616392 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:28.615746 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:06:28.616392 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:28.615910 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4vxx" podUID="3ec5e15a-5e12-4225-becb-4590f3039255" Jul 23 18:06:28.616392 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:28.615750 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxckm" Jul 23 18:06:28.616392 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:28.616196 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxckm" podUID="11c5ec1b-2dbf-49cf-9f93-fef53f4007e2" Jul 23 18:06:29.614398 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:29.614302 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:06:29.614670 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:29.614636 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpldf" podUID="0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b" Jul 23 18:06:30.615244 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:30.615210 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxckm" Jul 23 18:06:30.615727 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:30.615333 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxckm" podUID="11c5ec1b-2dbf-49cf-9f93-fef53f4007e2" Jul 23 18:06:30.615727 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:30.615430 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:06:30.615727 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:30.615547 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4vxx" podUID="3ec5e15a-5e12-4225-becb-4590f3039255" Jul 23 18:06:31.614406 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:31.614369 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:06:31.614590 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:31.614515 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpldf" podUID="0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b" Jul 23 18:06:32.615035 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:32.615001 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxckm" Jul 23 18:06:32.615364 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:32.615115 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxckm" podUID="11c5ec1b-2dbf-49cf-9f93-fef53f4007e2" Jul 23 18:06:32.615364 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:32.615169 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:06:32.615364 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:32.615267 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4vxx" podUID="3ec5e15a-5e12-4225-becb-4590f3039255" Jul 23 18:06:33.614339 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:33.614303 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:06:33.614540 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:33.614430 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpldf" podUID="0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b" Jul 23 18:06:34.614375 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:34.614338 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:06:34.614805 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:34.614385 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxckm" Jul 23 18:06:34.614805 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:34.614485 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4vxx" podUID="3ec5e15a-5e12-4225-becb-4590f3039255" Jul 23 18:06:34.614805 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:34.614606 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxckm" podUID="11c5ec1b-2dbf-49cf-9f93-fef53f4007e2" Jul 23 18:06:35.614976 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:35.614944 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:06:35.615540 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:35.615086 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpldf" podUID="0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b" Jul 23 18:06:36.266846 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:36.266807 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ec5e15a-5e12-4225-becb-4590f3039255-original-pull-secret\") pod \"global-pull-secret-syncer-v4vxx\" (UID: \"3ec5e15a-5e12-4225-becb-4590f3039255\") " pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:06:36.267039 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:36.267013 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:06:36.267115 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:36.267105 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ec5e15a-5e12-4225-becb-4590f3039255-original-pull-secret podName:3ec5e15a-5e12-4225-becb-4590f3039255 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:52.267082874 +0000 UTC m=+34.184672553 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ec5e15a-5e12-4225-becb-4590f3039255-original-pull-secret") pod "global-pull-secret-syncer-v4vxx" (UID: "3ec5e15a-5e12-4225-becb-4590f3039255") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:06:36.367871 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:36.367827 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6g5p\" (UniqueName: \"kubernetes.io/projected/11c5ec1b-2dbf-49cf-9f93-fef53f4007e2-kube-api-access-l6g5p\") pod \"network-check-target-rxckm\" (UID: \"11c5ec1b-2dbf-49cf-9f93-fef53f4007e2\") " pod="openshift-network-diagnostics/network-check-target-rxckm" Jul 23 18:06:36.368067 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:36.367902 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-metrics-certs\") pod \"network-metrics-daemon-rpldf\" (UID: \"0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b\") " pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:06:36.368067 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:36.368022 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:06:36.368067 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:36.368026 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:06:36.368067 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:36.368050 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:06:36.368067 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:36.368063 2575 projected.go:196] Error preparing data for projected volume kube-api-access-l6g5p for pod openshift-network-diagnostics/network-check-target-rxckm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:06:36.368301 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:36.368090 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-metrics-certs podName:0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b nodeName:}" failed. No retries permitted until 2026-07-23 18:06:52.368070449 +0000 UTC m=+34.285660134 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-metrics-certs") pod "network-metrics-daemon-rpldf" (UID: "0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:06:36.368301 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:36.368116 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11c5ec1b-2dbf-49cf-9f93-fef53f4007e2-kube-api-access-l6g5p podName:11c5ec1b-2dbf-49cf-9f93-fef53f4007e2 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:52.368098863 +0000 UTC m=+34.285688559 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6g5p" (UniqueName: "kubernetes.io/projected/11c5ec1b-2dbf-49cf-9f93-fef53f4007e2-kube-api-access-l6g5p") pod "network-check-target-rxckm" (UID: "11c5ec1b-2dbf-49cf-9f93-fef53f4007e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:06:36.615166 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:36.615093 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxckm" Jul 23 18:06:36.615568 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:36.615098 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:06:36.615568 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:36.615200 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxckm" podUID="11c5ec1b-2dbf-49cf-9f93-fef53f4007e2" Jul 23 18:06:36.615568 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:36.615285 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4vxx" podUID="3ec5e15a-5e12-4225-becb-4590f3039255" Jul 23 18:06:37.614985 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:37.614942 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:06:37.615166 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:37.615081 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpldf" podUID="0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b" Jul 23 18:06:38.615097 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:38.615057 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxckm" Jul 23 18:06:38.615097 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:38.615084 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:06:38.615639 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:38.615167 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxckm" podUID="11c5ec1b-2dbf-49cf-9f93-fef53f4007e2" Jul 23 18:06:38.615639 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:38.615311 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4vxx" podUID="3ec5e15a-5e12-4225-becb-4590f3039255" Jul 23 18:06:39.614514 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:39.614471 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:06:39.614694 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:39.614615 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpldf" podUID="0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b" Jul 23 18:06:40.614744 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:40.614704 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxckm" Jul 23 18:06:40.615340 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:40.614707 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:06:40.615340 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:40.614849 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxckm" podUID="11c5ec1b-2dbf-49cf-9f93-fef53f4007e2" Jul 23 18:06:40.615340 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:40.614908 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4vxx" podUID="3ec5e15a-5e12-4225-becb-4590f3039255" Jul 23 18:06:41.614730 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:41.614536 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:06:41.614854 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:41.614815 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpldf" podUID="0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b" Jul 23 18:06:41.711521 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:41.711488 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-29thx" event={"ID":"82dbe848-f82c-4ff9-a7cc-7c97ee5e37c9","Type":"ContainerStarted","Data":"805f14decf42947a863bfdf551a3f84640511bad4ce3631045ea531512665197"} Jul 23 18:06:41.712732 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:41.712704 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gbpfx" event={"ID":"9b95f1a4-e3e4-416b-a987-7d6aae5ac214","Type":"ContainerStarted","Data":"be8fca03eb3484627b5901ca53a4c8e7552e7274816e6c3b57ceab2ecd2b9401"} Jul 23 18:06:41.715414 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:41.715391 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" event={"ID":"65f9df7d-8a39-4000-b505-92cb839f2d94","Type":"ContainerStarted","Data":"82b7448adcf759d107450e099cf4559a51d70ed4dc0f6f048c299d9673887774"} Jul 23 18:06:41.715518 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:41.715450 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" event={"ID":"65f9df7d-8a39-4000-b505-92cb839f2d94","Type":"ContainerStarted","Data":"b7abac4a3d686a94041ff29c63b5a0c3f08e576340d331c61e8fc3cc60745b0c"} Jul 23 18:06:41.715518 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:41.715488 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" event={"ID":"65f9df7d-8a39-4000-b505-92cb839f2d94","Type":"ContainerStarted","Data":"cb724254de057e4b55abe652b0fb6f1f552321f7282d7520dafe920dd4304d41"} Jul 23 18:06:41.715620 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:41.715523 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" event={"ID":"65f9df7d-8a39-4000-b505-92cb839f2d94","Type":"ContainerStarted","Data":"d3a1afe47c5e2631775ad91102457fe074ea586dbd65a9d85e38c950393a5e0a"} Jul 23 18:06:41.715620 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:41.715559 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" event={"ID":"65f9df7d-8a39-4000-b505-92cb839f2d94","Type":"ContainerStarted","Data":"0facf2f61403e572e2d5111c6a9174804a5e5d58ed472f0bcb6b5aea19ee8e29"} Jul 23 18:06:41.715620 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:41.715602 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" event={"ID":"65f9df7d-8a39-4000-b505-92cb839f2d94","Type":"ContainerStarted","Data":"bc9a223d0f7e7f59af0376fe512935c901f10ea1498595daaddc4e8fcf3d162a"} Jul 23 18:06:41.716754 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:41.716731 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rlbzs" event={"ID":"26dc96fe-1cc5-4c06-9a9f-856592e4b9b1","Type":"ContainerStarted","Data":"1614026ea10ea6588a24146341addde6e0ba216ac0eacfc76927a6e4c51bf94f"} Jul 23 18:06:41.718443 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:41.718420 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" event={"ID":"87c58bfe3b1f43bc115912c50bda5b58","Type":"ContainerStarted","Data":"57fc4cb433ee8c74fc889cbfccf486ffa41a4d3f8108ed53a49261e49a3de900"} Jul 23 18:06:41.719985 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:41.719960 2575 generic.go:356] "Generic (PLEG): container finished" podID="7e5fe41d-ada3-4ef4-8a18-facdc8037fec" containerID="3036779ef8ffd2d9e484eddefa38b4d3a1e77df30ac2e041fb6cbc350320296a" exitCode=0 Jul 23 18:06:41.720082 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:41.720042 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fps7b" event={"ID":"7e5fe41d-ada3-4ef4-8a18-facdc8037fec","Type":"ContainerDied","Data":"3036779ef8ffd2d9e484eddefa38b4d3a1e77df30ac2e041fb6cbc350320296a"} Jul 23 18:06:41.724454 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:41.723821 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-299wk" event={"ID":"c4ae62d1-1f58-4490-bb0c-5bf4074452dd","Type":"ContainerStarted","Data":"03254aa74bc3bbbe7ca14ff4e72392c8c8a4c84635f3238e47a6abe69f8202eb"} Jul 23 18:06:41.726157 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:41.726109 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-29thx" podStartSLOduration=2.659547458 podStartE2EDuration="22.726094101s" totalImagesPullingTime="20.066546643s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:41.72591712 +0000 UTC m=+23.643506821" watchObservedRunningTime="2026-07-23 18:06:41.726094101 +0000 UTC m=+23.643683806" Jul 23 18:06:41.726659 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:41.726634 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xj2dq" event={"ID":"89ab6665-15e8-4c0c-9fab-2002482c8ac7","Type":"ContainerStarted","Data":"6fd455ed8b03040c9c44cae7c8c3c665d2c5b1bd004bd9caf43768ccc1ece883"} Jul 23 18:06:41.728086 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:41.728066 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-l4hls" event={"ID":"81fdcc97-775f-49ca-bdea-b6ce801091bc","Type":"ContainerStarted","Data":"81ab4b3aa4deb6bfba17f01c01bdf0fc0986d0e2a142be2b08768c01a4213dc2"} Jul 23 18:06:41.764274 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:41.764220 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rlbzs" podStartSLOduration=2.588700291 podStartE2EDuration="22.764202188s" totalImagesPullingTime="20.175501897s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:41.763800709 +0000 UTC m=+23.681390411" watchObservedRunningTime="2026-07-23 18:06:41.764202188 +0000 UTC m=+23.681791888" Jul 23 18:06:41.778837 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:41.778760 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gbpfx" podStartSLOduration=2.707430279 podStartE2EDuration="22.778744207s" totalImagesPullingTime="20.071313928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:41.77813914 +0000 UTC m=+23.695728840" watchObservedRunningTime="2026-07-23 18:06:41.778744207 +0000 UTC m=+23.696333932" Jul 23 18:06:41.794769 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:41.794719 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-299wk" podStartSLOduration=2.667445811 podStartE2EDuration="22.794703745s" totalImagesPullingTime="20.127257934s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:41.794483846 +0000 UTC m=+23.712073546" watchObservedRunningTime="2026-07-23 18:06:41.794703745 +0000 UTC m=+23.712293439" Jul 23 18:06:41.809443 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:41.809400 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-200.ec2.internal" podStartSLOduration=21.809386046 podStartE2EDuration="21.809386046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:06:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:41.809064634 +0000 UTC m=+23.726654333" watchObservedRunningTime="2026-07-23 18:06:41.809386046 +0000 UTC m=+23.726975745" Jul 23 18:06:41.837247 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:41.837199 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-l4hls" podStartSLOduration=2.665462873 podStartE2EDuration="22.837184721s" totalImagesPullingTime="20.171721848s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:41.837084783 +0000 UTC m=+23.754674482" watchObservedRunningTime="2026-07-23 18:06:41.837184721 +0000 UTC m=+23.754774422" Jul 23 18:06:42.618027 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:42.617955 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:06:42.618479 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:42.617959 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxckm" Jul 23 18:06:42.618479 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:42.618073 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4vxx" podUID="3ec5e15a-5e12-4225-becb-4590f3039255" Jul 23 18:06:42.618479 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:42.618144 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxckm" podUID="11c5ec1b-2dbf-49cf-9f93-fef53f4007e2" Jul 23 18:06:42.733377 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:42.733311 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nwp4l" event={"ID":"b44a91e6-fc2b-4a02-ab9d-80eb66a9aed9","Type":"ContainerStarted","Data":"db5fcc5daea2a25f2b6c914045d57a9a7195192fd4264b0ebadad5becc836e29"} Jul 23 18:06:42.749432 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:42.749370 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nwp4l" podStartSLOduration=3.622811755 podStartE2EDuration="23.749347198s" totalImagesPullingTime="20.126535443s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:42.748860129 +0000 UTC m=+24.666449850" watchObservedRunningTime="2026-07-23 18:06:42.749347198 +0000 UTC m=+24.666936897" Jul 23 18:06:43.253450 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:43.253419 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 23 18:06:43.602647 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:43.602510 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-23T18:06:43.253443461Z","UUID":"09f0bbaa-3b7a-4636-b1e4-b83562ed5376","Handler":null,"Name":"","Endpoint":""} Jul 23 18:06:43.604123 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:43.604102 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 23 18:06:43.604246 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:43.604142 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 23 18:06:43.614200 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:43.614176 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:06:43.614879 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:43.614837 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpldf" podUID="0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b" Jul 23 18:06:43.738220 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:43.738153 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xj2dq" event={"ID":"89ab6665-15e8-4c0c-9fab-2002482c8ac7","Type":"ContainerStarted","Data":"65b581260a7534feb4be1bd0eea620f21add9ce6424aa943a39f0d439ad089a6"} Jul 23 18:06:44.618342 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:44.618310 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:06:44.618524 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:44.618432 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4vxx" podUID="3ec5e15a-5e12-4225-becb-4590f3039255" Jul 23 18:06:44.618524 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:44.618481 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxckm" Jul 23 18:06:44.618647 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:44.618584 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxckm" podUID="11c5ec1b-2dbf-49cf-9f93-fef53f4007e2" Jul 23 18:06:44.744023 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:44.743972 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" event={"ID":"65f9df7d-8a39-4000-b505-92cb839f2d94","Type":"ContainerStarted","Data":"0c559abb720004e19091c133c81bd9f371473725a6a3d2c63e1f94d15851f59b"} Jul 23 18:06:45.615355 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:45.615097 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:06:45.615525 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:45.615472 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpldf" podUID="0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b" Jul 23 18:06:46.500736 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:46.500670 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gbpfx" Jul 23 18:06:46.501667 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:46.501647 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gbpfx" Jul 23 18:06:46.614600 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:46.614567 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxckm" Jul 23 18:06:46.614783 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:46.614672 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxckm" podUID="11c5ec1b-2dbf-49cf-9f93-fef53f4007e2" Jul 23 18:06:46.614783 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:46.614738 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:06:46.614909 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:46.614852 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4vxx" podUID="3ec5e15a-5e12-4225-becb-4590f3039255" Jul 23 18:06:46.749576 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:46.749535 2575 generic.go:356] "Generic (PLEG): container finished" podID="7e5fe41d-ada3-4ef4-8a18-facdc8037fec" containerID="426decae5702f936b2ca1a6d5a588469a1ba09bd0b2b0222b7a5bd1989fe38ab" exitCode=0 Jul 23 18:06:46.749752 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:46.749596 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fps7b" event={"ID":"7e5fe41d-ada3-4ef4-8a18-facdc8037fec","Type":"ContainerDied","Data":"426decae5702f936b2ca1a6d5a588469a1ba09bd0b2b0222b7a5bd1989fe38ab"} Jul 23 18:06:46.751842 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:46.751814 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xj2dq" event={"ID":"89ab6665-15e8-4c0c-9fab-2002482c8ac7","Type":"ContainerStarted","Data":"ee65f081fc27a024f60d8e64fc0f8898eb0e41c749f2ff2d3422f9f8e46612e1"} Jul 23 18:06:46.758284 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:46.758254 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" event={"ID":"65f9df7d-8a39-4000-b505-92cb839f2d94","Type":"ContainerStarted","Data":"cdae88416763a6d4510acb1491c011e49aef8f8b001ad61b1550b507a29e3d06"} Jul 23 18:06:46.758503 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:46.758485 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gbpfx" Jul 23 18:06:46.758953 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:46.758936 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gbpfx" Jul 23 18:06:46.789391 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:46.789343 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xj2dq" podStartSLOduration=3.05413596 podStartE2EDuration="27.78932806s" totalImagesPullingTime="24.7351921s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:06:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:46.78889907 +0000 UTC m=+28.706488769" watchObservedRunningTime="2026-07-23 18:06:46.78932806 +0000 UTC m=+28.706917771" Jul 23 18:06:47.614653 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:47.614467 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:06:47.615074 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:47.614774 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpldf" podUID="0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b" Jul 23 18:06:47.761254 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:47.761225 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:47.761445 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:47.761426 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:47.761581 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:47.761481 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:47.776252 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:47.776226 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:47.776393 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:47.776335 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:06:47.803721 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:47.803654 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" podStartSLOduration=8.645673003 podStartE2EDuration="28.803633924s" totalImagesPullingTime="20.157960921s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:46.838088117 +0000 UTC m=+28.755677816" watchObservedRunningTime="2026-07-23 18:06:47.803633924 +0000 UTC m=+29.721223618" Jul 23 18:06:48.258330 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:48.258252 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rxckm"] Jul 23 18:06:48.258457 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:48.258399 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxckm" Jul 23 18:06:48.258495 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:48.258478 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxckm" podUID="11c5ec1b-2dbf-49cf-9f93-fef53f4007e2" Jul 23 18:06:48.261446 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:48.261419 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rpldf"] Jul 23 18:06:48.261544 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:48.261525 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:06:48.261620 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:48.261604 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpldf" podUID="0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b" Jul 23 18:06:48.273868 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:48.273844 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v4vxx"] Jul 23 18:06:48.273983 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:48.273948 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:06:48.274037 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:48.274022 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4vxx" podUID="3ec5e15a-5e12-4225-becb-4590f3039255" Jul 23 18:06:48.764709 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:48.764663 2575 generic.go:356] "Generic (PLEG): container finished" podID="7e5fe41d-ada3-4ef4-8a18-facdc8037fec" containerID="34fa269636d31ef9e79bc965d61139fff847848e8c92734e63c993a39359752b" exitCode=0 Jul 23 18:06:48.765061 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:48.764708 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fps7b" event={"ID":"7e5fe41d-ada3-4ef4-8a18-facdc8037fec","Type":"ContainerDied","Data":"34fa269636d31ef9e79bc965d61139fff847848e8c92734e63c993a39359752b"} Jul 23 18:06:49.614431 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:49.614395 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:06:49.614431 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:49.614436 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:06:49.614634 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:49.614511 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxckm" Jul 23 18:06:49.614634 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:49.614515 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4vxx" podUID="3ec5e15a-5e12-4225-becb-4590f3039255" Jul 23 18:06:49.614634 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:49.614589 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxckm" podUID="11c5ec1b-2dbf-49cf-9f93-fef53f4007e2" Jul 23 18:06:49.614812 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:49.614671 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpldf" podUID="0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b" Jul 23 18:06:50.771921 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:50.771758 2575 generic.go:356] "Generic (PLEG): container finished" podID="7e5fe41d-ada3-4ef4-8a18-facdc8037fec" containerID="2d7942553669c6466363e652ab6d2abc6cc79aaa0bb9de70d989ca01795082c8" exitCode=0 Jul 23 18:06:50.772281 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:50.771833 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fps7b" event={"ID":"7e5fe41d-ada3-4ef4-8a18-facdc8037fec","Type":"ContainerDied","Data":"2d7942553669c6466363e652ab6d2abc6cc79aaa0bb9de70d989ca01795082c8"} Jul 23 18:06:51.614510 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:51.614478 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxckm" Jul 23 18:06:51.614797 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:51.614569 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:06:51.614797 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:51.614570 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxckm" podUID="11c5ec1b-2dbf-49cf-9f93-fef53f4007e2" Jul 23 18:06:51.614797 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:51.614575 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:06:51.614797 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:51.614694 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4vxx" podUID="3ec5e15a-5e12-4225-becb-4590f3039255" Jul 23 18:06:51.614948 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:51.614797 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpldf" podUID="0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b" Jul 23 18:06:52.289536 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:52.289501 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ec5e15a-5e12-4225-becb-4590f3039255-original-pull-secret\") pod \"global-pull-secret-syncer-v4vxx\" (UID: \"3ec5e15a-5e12-4225-becb-4590f3039255\") " pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:06:52.290027 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:52.289652 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 23 18:06:52.290027 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:52.289736 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ec5e15a-5e12-4225-becb-4590f3039255-original-pull-secret podName:3ec5e15a-5e12-4225-becb-4590f3039255 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:24.289710541 +0000 UTC m=+66.207300237 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ec5e15a-5e12-4225-becb-4590f3039255-original-pull-secret") pod "global-pull-secret-syncer-v4vxx" (UID: "3ec5e15a-5e12-4225-becb-4590f3039255") : object "kube-system"/"original-pull-secret" not registered Jul 23 18:06:52.390286 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:52.390247 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6g5p\" (UniqueName: \"kubernetes.io/projected/11c5ec1b-2dbf-49cf-9f93-fef53f4007e2-kube-api-access-l6g5p\") pod \"network-check-target-rxckm\" (UID: \"11c5ec1b-2dbf-49cf-9f93-fef53f4007e2\") " pod="openshift-network-diagnostics/network-check-target-rxckm" Jul 23 18:06:52.390437 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:52.390323 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-metrics-certs\") pod \"network-metrics-daemon-rpldf\" (UID: \"0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b\") " pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:06:52.390507 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:52.390432 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 23 18:06:52.390507 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:52.390449 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:06:52.390507 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:52.390459 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 23 18:06:52.390507 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:52.390474 2575 projected.go:196] Error preparing data for projected volume kube-api-access-l6g5p for pod openshift-network-diagnostics/network-check-target-rxckm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:06:52.390712 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:52.390515 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-metrics-certs podName:0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b nodeName:}" failed. No retries permitted until 2026-07-23 18:07:24.390495258 +0000 UTC m=+66.308084948 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-metrics-certs") pod "network-metrics-daemon-rpldf" (UID: "0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 23 18:06:52.390712 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:52.390537 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/11c5ec1b-2dbf-49cf-9f93-fef53f4007e2-kube-api-access-l6g5p podName:11c5ec1b-2dbf-49cf-9f93-fef53f4007e2 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:24.390524762 +0000 UTC m=+66.308114443 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6g5p" (UniqueName: "kubernetes.io/projected/11c5ec1b-2dbf-49cf-9f93-fef53f4007e2-kube-api-access-l6g5p") pod "network-check-target-rxckm" (UID: "11c5ec1b-2dbf-49cf-9f93-fef53f4007e2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 23 18:06:53.615051 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:53.615013 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:06:53.615465 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:53.615061 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxckm" Jul 23 18:06:53.615465 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:53.615059 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:06:53.615465 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:53.615147 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-v4vxx" podUID="3ec5e15a-5e12-4225-becb-4590f3039255" Jul 23 18:06:53.615465 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:53.615177 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rxckm" podUID="11c5ec1b-2dbf-49cf-9f93-fef53f4007e2" Jul 23 18:06:53.615465 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:53.615278 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rpldf" podUID="0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b" Jul 23 18:06:53.869220 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:53.869146 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-200.ec2.internal" event="NodeReady" Jul 23 18:06:53.869368 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:53.869318 2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 23 18:06:53.903997 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:53.903966 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-dsjsx"] Jul 23 18:06:53.921725 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:53.921695 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7fcff6cc5-fwvfb"] Jul 23 18:06:53.921883 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:53.921782 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dsjsx" Jul 23 18:06:53.924568 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:53.924544 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-75dl5\"" Jul 23 18:06:53.924568 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:53.924553 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 23 18:06:53.924752 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:53.924591 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 23 18:06:53.946089 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:53.946069 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-dsjsx"] Jul 23 18:06:53.946212 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:53.946097 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6qdgb"] Jul 23 18:06:53.946212 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:53.946194 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:06:53.949067 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:53.949047 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 23 18:06:53.949320 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:53.949305 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 23 18:06:53.949405 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:53.949321 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 23 18:06:53.949568 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:53.949553 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qzjmk\"" Jul 23 18:06:53.955123 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:53.955104 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 23 18:06:53.968209 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:53.968192 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-q5hj8"] Jul 23 18:06:53.968321 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:53.968305 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6qdgb" Jul 23 18:06:53.970809 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:53.970793 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 23 18:06:53.970901 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:53.970819 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 23 18:06:53.970901 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:53.970849 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6k4rc\"" Jul 23 18:06:53.990331 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:53.990312 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6qdgb"] Jul 23 18:06:53.990418 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:53.990344 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fcff6cc5-fwvfb"] Jul 23 18:06:53.990418 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:53.990362 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-q5hj8"] Jul 23 18:06:53.990488 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:53.990439 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-q5hj8" Jul 23 18:06:53.994438 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:53.993773 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 23 18:06:53.994438 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:53.993832 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ktbk2\"" Jul 23 18:06:53.994438 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:53.994100 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 23 18:06:53.996284 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:53.994725 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 23 18:06:54.085026 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.084989 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:06:54.105823 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.105792 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/98381009-83a2-4c5c-9e31-267ab47e7edc-metrics-tls\") pod \"dns-default-6qdgb\" (UID: \"98381009-83a2-4c5c-9e31-267ab47e7edc\") " pod="openshift-dns/dns-default-6qdgb" Jul 23 18:06:54.105823 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.105827 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98381009-83a2-4c5c-9e31-267ab47e7edc-tmp-dir\") pod \"dns-default-6qdgb\" (UID: \"98381009-83a2-4c5c-9e31-267ab47e7edc\") " pod="openshift-dns/dns-default-6qdgb" Jul 23 18:06:54.106031 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.105870 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf99n\" (UniqueName: \"kubernetes.io/projected/9fe94bdd-cbb4-479a-896f-a221bc54a40c-kube-api-access-nf99n\") pod \"ingress-canary-q5hj8\" (UID: \"9fe94bdd-cbb4-479a-896f-a221bc54a40c\") " pod="openshift-ingress-canary/ingress-canary-q5hj8" Jul 23 18:06:54.106031 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.105895 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dffca2c1-6cb2-46ec-9842-5c20982d1581-trusted-ca\") pod \"image-registry-7fcff6cc5-fwvfb\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:06:54.106031 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.105912 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9kr6\" (UniqueName: \"kubernetes.io/projected/98381009-83a2-4c5c-9e31-267ab47e7edc-kube-api-access-k9kr6\") pod \"dns-default-6qdgb\" (UID: \"98381009-83a2-4c5c-9e31-267ab47e7edc\") " pod="openshift-dns/dns-default-6qdgb" Jul 23 18:06:54.106031 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.105931 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-certificates\") pod \"image-registry-7fcff6cc5-fwvfb\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:06:54.106031 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.105961 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dffca2c1-6cb2-46ec-9842-5c20982d1581-image-registry-private-configuration\") pod \"image-registry-7fcff6cc5-fwvfb\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:06:54.106333 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.106030 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9fe94bdd-cbb4-479a-896f-a221bc54a40c-cert\") pod \"ingress-canary-q5hj8\" (UID: \"9fe94bdd-cbb4-479a-896f-a221bc54a40c\") " pod="openshift-ingress-canary/ingress-canary-q5hj8" Jul 23 18:06:54.106333 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.106086 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dffca2c1-6cb2-46ec-9842-5c20982d1581-ca-trust-extracted\") pod \"image-registry-7fcff6cc5-fwvfb\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:06:54.106333 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.106134 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/720bc518-628e-4cc4-a1cb-b626cfad39dc-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-dsjsx\" (UID: \"720bc518-628e-4cc4-a1cb-b626cfad39dc\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dsjsx" Jul 23 18:06:54.106333 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.106167 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/720bc518-628e-4cc4-a1cb-b626cfad39dc-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dsjsx\" (UID: \"720bc518-628e-4cc4-a1cb-b626cfad39dc\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dsjsx" Jul 23 18:06:54.106333 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.106192 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dffca2c1-6cb2-46ec-9842-5c20982d1581-installation-pull-secrets\") pod \"image-registry-7fcff6cc5-fwvfb\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:06:54.106333 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.106207 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-bound-sa-token\") pod \"image-registry-7fcff6cc5-fwvfb\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:06:54.106333 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.106268 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/98381009-83a2-4c5c-9e31-267ab47e7edc-config-volume\") pod \"dns-default-6qdgb\" (UID: \"98381009-83a2-4c5c-9e31-267ab47e7edc\") " pod="openshift-dns/dns-default-6qdgb" Jul 23 18:06:54.106333 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.106290 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-tls\") pod \"image-registry-7fcff6cc5-fwvfb\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:06:54.106333 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.106316 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6g6b\" (UniqueName: \"kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-kube-api-access-q6g6b\") pod \"image-registry-7fcff6cc5-fwvfb\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:06:54.189161 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.189077 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:06:54.206855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.206831 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6g6b\" (UniqueName: \"kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-kube-api-access-q6g6b\") pod \"image-registry-7fcff6cc5-fwvfb\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:06:54.206987 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.206866 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/98381009-83a2-4c5c-9e31-267ab47e7edc-metrics-tls\") pod \"dns-default-6qdgb\" (UID: \"98381009-83a2-4c5c-9e31-267ab47e7edc\") " pod="openshift-dns/dns-default-6qdgb" Jul 23 18:06:54.206987 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.206897 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98381009-83a2-4c5c-9e31-267ab47e7edc-tmp-dir\") pod \"dns-default-6qdgb\" (UID: \"98381009-83a2-4c5c-9e31-267ab47e7edc\") " pod="openshift-dns/dns-default-6qdgb" Jul 23 18:06:54.206987 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.206945 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf99n\" (UniqueName: \"kubernetes.io/projected/9fe94bdd-cbb4-479a-896f-a221bc54a40c-kube-api-access-nf99n\") pod \"ingress-canary-q5hj8\" (UID: \"9fe94bdd-cbb4-479a-896f-a221bc54a40c\") " pod="openshift-ingress-canary/ingress-canary-q5hj8" Jul 23 18:06:54.207119 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:54.207009 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:06:54.207119 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.207065 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dffca2c1-6cb2-46ec-9842-5c20982d1581-trusted-ca\") pod \"image-registry-7fcff6cc5-fwvfb\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:06:54.207119 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:54.207081 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98381009-83a2-4c5c-9e31-267ab47e7edc-metrics-tls podName:98381009-83a2-4c5c-9e31-267ab47e7edc nodeName:}" failed. No retries permitted until 2026-07-23 18:06:54.70706266 +0000 UTC m=+36.624652341 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/98381009-83a2-4c5c-9e31-267ab47e7edc-metrics-tls") pod "dns-default-6qdgb" (UID: "98381009-83a2-4c5c-9e31-267ab47e7edc") : secret "dns-default-metrics-tls" not found Jul 23 18:06:54.207298 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.207119 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9kr6\" (UniqueName: \"kubernetes.io/projected/98381009-83a2-4c5c-9e31-267ab47e7edc-kube-api-access-k9kr6\") pod \"dns-default-6qdgb\" (UID: \"98381009-83a2-4c5c-9e31-267ab47e7edc\") " pod="openshift-dns/dns-default-6qdgb" Jul 23 18:06:54.207298 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.207155 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-certificates\") pod \"image-registry-7fcff6cc5-fwvfb\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:06:54.207298 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.207191 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dffca2c1-6cb2-46ec-9842-5c20982d1581-image-registry-private-configuration\") pod \"image-registry-7fcff6cc5-fwvfb\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:06:54.207298 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.207212 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/98381009-83a2-4c5c-9e31-267ab47e7edc-tmp-dir\") pod \"dns-default-6qdgb\" (UID: \"98381009-83a2-4c5c-9e31-267ab47e7edc\") " pod="openshift-dns/dns-default-6qdgb" Jul 23 18:06:54.207298 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.207216 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9fe94bdd-cbb4-479a-896f-a221bc54a40c-cert\") pod \"ingress-canary-q5hj8\" (UID: \"9fe94bdd-cbb4-479a-896f-a221bc54a40c\") " pod="openshift-ingress-canary/ingress-canary-q5hj8" Jul 23 18:06:54.207298 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.207254 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dffca2c1-6cb2-46ec-9842-5c20982d1581-ca-trust-extracted\") pod \"image-registry-7fcff6cc5-fwvfb\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:06:54.207298 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.207295 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/720bc518-628e-4cc4-a1cb-b626cfad39dc-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-dsjsx\" (UID: \"720bc518-628e-4cc4-a1cb-b626cfad39dc\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dsjsx" Jul 23 18:06:54.207670 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.207314 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/720bc518-628e-4cc4-a1cb-b626cfad39dc-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dsjsx\" (UID: \"720bc518-628e-4cc4-a1cb-b626cfad39dc\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dsjsx" Jul 23 18:06:54.207670 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.207331 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dffca2c1-6cb2-46ec-9842-5c20982d1581-installation-pull-secrets\") pod \"image-registry-7fcff6cc5-fwvfb\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:06:54.207670 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.207354 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-bound-sa-token\") pod \"image-registry-7fcff6cc5-fwvfb\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:06:54.207670 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.207392 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/98381009-83a2-4c5c-9e31-267ab47e7edc-config-volume\") pod \"dns-default-6qdgb\" (UID: \"98381009-83a2-4c5c-9e31-267ab47e7edc\") " pod="openshift-dns/dns-default-6qdgb" Jul 23 18:06:54.207670 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.207408 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-tls\") pod \"image-registry-7fcff6cc5-fwvfb\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:06:54.207670 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:54.207487 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 18:06:54.207670 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:54.207497 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fcff6cc5-fwvfb: secret "image-registry-tls" not found Jul 23 18:06:54.207670 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:54.207543 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-tls podName:dffca2c1-6cb2-46ec-9842-5c20982d1581 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:54.707530813 +0000 UTC m=+36.625120491 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-tls") pod "image-registry-7fcff6cc5-fwvfb" (UID: "dffca2c1-6cb2-46ec-9842-5c20982d1581") : secret "image-registry-tls" not found Jul 23 18:06:54.207670 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:54.207584 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 18:06:54.207670 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:54.207613 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/720bc518-628e-4cc4-a1cb-b626cfad39dc-networking-console-plugin-cert podName:720bc518-628e-4cc4-a1cb-b626cfad39dc nodeName:}" failed. No retries permitted until 2026-07-23 18:06:54.707602461 +0000 UTC m=+36.625192154 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/720bc518-628e-4cc4-a1cb-b626cfad39dc-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dsjsx" (UID: "720bc518-628e-4cc4-a1cb-b626cfad39dc") : secret "networking-console-plugin-cert" not found Jul 23 18:06:54.207670 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.207617 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dffca2c1-6cb2-46ec-9842-5c20982d1581-ca-trust-extracted\") pod \"image-registry-7fcff6cc5-fwvfb\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:06:54.208200 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.207722 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-certificates\") pod \"image-registry-7fcff6cc5-fwvfb\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:06:54.208200 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.208071 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dffca2c1-6cb2-46ec-9842-5c20982d1581-trusted-ca\") pod \"image-registry-7fcff6cc5-fwvfb\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:06:54.208375 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.208317 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/720bc518-628e-4cc4-a1cb-b626cfad39dc-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-dsjsx\" (UID: \"720bc518-628e-4cc4-a1cb-b626cfad39dc\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dsjsx" Jul 23 18:06:54.208458 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.208390 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/98381009-83a2-4c5c-9e31-267ab47e7edc-config-volume\") pod \"dns-default-6qdgb\" (UID: \"98381009-83a2-4c5c-9e31-267ab47e7edc\") " pod="openshift-dns/dns-default-6qdgb" Jul 23 18:06:54.212162 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.212132 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dffca2c1-6cb2-46ec-9842-5c20982d1581-installation-pull-secrets\") pod \"image-registry-7fcff6cc5-fwvfb\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:06:54.212162 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.212151 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dffca2c1-6cb2-46ec-9842-5c20982d1581-image-registry-private-configuration\") pod \"image-registry-7fcff6cc5-fwvfb\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:06:54.212327 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.212136 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9fe94bdd-cbb4-479a-896f-a221bc54a40c-cert\") pod \"ingress-canary-q5hj8\" (UID: \"9fe94bdd-cbb4-479a-896f-a221bc54a40c\") " pod="openshift-ingress-canary/ingress-canary-q5hj8" Jul 23 18:06:54.216856 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.216834 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf99n\" (UniqueName: \"kubernetes.io/projected/9fe94bdd-cbb4-479a-896f-a221bc54a40c-kube-api-access-nf99n\") pod \"ingress-canary-q5hj8\" (UID: \"9fe94bdd-cbb4-479a-896f-a221bc54a40c\") " pod="openshift-ingress-canary/ingress-canary-q5hj8" Jul 23 18:06:54.216856 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.216844 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-bound-sa-token\") pod \"image-registry-7fcff6cc5-fwvfb\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:06:54.217323 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.217304 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6g6b\" (UniqueName: \"kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-kube-api-access-q6g6b\") pod \"image-registry-7fcff6cc5-fwvfb\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:06:54.217385 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.217343 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9kr6\" (UniqueName: \"kubernetes.io/projected/98381009-83a2-4c5c-9e31-267ab47e7edc-kube-api-access-k9kr6\") pod \"dns-default-6qdgb\" (UID: \"98381009-83a2-4c5c-9e31-267ab47e7edc\") " pod="openshift-dns/dns-default-6qdgb" Jul 23 18:06:54.300413 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.300377 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-q5hj8" Jul 23 18:06:54.712277 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.712246 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/720bc518-628e-4cc4-a1cb-b626cfad39dc-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dsjsx\" (UID: \"720bc518-628e-4cc4-a1cb-b626cfad39dc\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dsjsx" Jul 23 18:06:54.713037 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.712298 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-tls\") pod \"image-registry-7fcff6cc5-fwvfb\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:06:54.713037 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:54.712327 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/98381009-83a2-4c5c-9e31-267ab47e7edc-metrics-tls\") pod \"dns-default-6qdgb\" (UID: \"98381009-83a2-4c5c-9e31-267ab47e7edc\") " pod="openshift-dns/dns-default-6qdgb" Jul 23 18:06:54.713037 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:54.712428 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 18:06:54.713037 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:54.712449 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:06:54.713037 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:54.712469 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 18:06:54.713037 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:54.712489 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fcff6cc5-fwvfb: secret "image-registry-tls" not found Jul 23 18:06:54.713037 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:54.712503 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98381009-83a2-4c5c-9e31-267ab47e7edc-metrics-tls podName:98381009-83a2-4c5c-9e31-267ab47e7edc nodeName:}" failed. No retries permitted until 2026-07-23 18:06:55.712485341 +0000 UTC m=+37.630075033 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/98381009-83a2-4c5c-9e31-267ab47e7edc-metrics-tls") pod "dns-default-6qdgb" (UID: "98381009-83a2-4c5c-9e31-267ab47e7edc") : secret "dns-default-metrics-tls" not found Jul 23 18:06:54.713037 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:54.712520 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/720bc518-628e-4cc4-a1cb-b626cfad39dc-networking-console-plugin-cert podName:720bc518-628e-4cc4-a1cb-b626cfad39dc nodeName:}" failed. No retries permitted until 2026-07-23 18:06:55.712512241 +0000 UTC m=+37.630101920 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/720bc518-628e-4cc4-a1cb-b626cfad39dc-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dsjsx" (UID: "720bc518-628e-4cc4-a1cb-b626cfad39dc") : secret "networking-console-plugin-cert" not found Jul 23 18:06:54.713037 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:54.712540 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-tls podName:dffca2c1-6cb2-46ec-9842-5c20982d1581 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:55.712527352 +0000 UTC m=+37.630117030 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-tls") pod "image-registry-7fcff6cc5-fwvfb" (UID: "dffca2c1-6cb2-46ec-9842-5c20982d1581") : secret "image-registry-tls" not found Jul 23 18:06:55.614562 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:55.614529 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:06:55.614562 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:55.614552 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxckm" Jul 23 18:06:55.614756 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:55.614541 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:06:55.620296 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:55.619552 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 18:06:55.620296 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:55.619830 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 18:06:55.620296 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:55.620052 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cdqn6\"" Jul 23 18:06:55.620296 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:55.620089 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hffp8\"" Jul 23 18:06:55.620296 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:55.620114 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 18:06:55.620296 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:55.620225 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 18:06:55.684794 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:55.684581 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-q5hj8"] Jul 23 18:06:55.719712 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:55.719684 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/98381009-83a2-4c5c-9e31-267ab47e7edc-metrics-tls\") pod \"dns-default-6qdgb\" (UID: \"98381009-83a2-4c5c-9e31-267ab47e7edc\") " pod="openshift-dns/dns-default-6qdgb" Jul 23 18:06:55.720095 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:55.719762 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/720bc518-628e-4cc4-a1cb-b626cfad39dc-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dsjsx\" (UID: \"720bc518-628e-4cc4-a1cb-b626cfad39dc\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dsjsx" Jul 23 18:06:55.720095 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:55.719797 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-tls\") pod \"image-registry-7fcff6cc5-fwvfb\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:06:55.720095 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:55.719835 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:06:55.720095 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:55.719881 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 18:06:55.720095 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:55.719884 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 18:06:55.720095 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:55.719900 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98381009-83a2-4c5c-9e31-267ab47e7edc-metrics-tls podName:98381009-83a2-4c5c-9e31-267ab47e7edc nodeName:}" failed. No retries permitted until 2026-07-23 18:06:57.719885046 +0000 UTC m=+39.637474960 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/98381009-83a2-4c5c-9e31-267ab47e7edc-metrics-tls") pod "dns-default-6qdgb" (UID: "98381009-83a2-4c5c-9e31-267ab47e7edc") : secret "dns-default-metrics-tls" not found Jul 23 18:06:55.720095 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:55.719933 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/720bc518-628e-4cc4-a1cb-b626cfad39dc-networking-console-plugin-cert podName:720bc518-628e-4cc4-a1cb-b626cfad39dc nodeName:}" failed. No retries permitted until 2026-07-23 18:06:57.719918299 +0000 UTC m=+39.637507981 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/720bc518-628e-4cc4-a1cb-b626cfad39dc-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dsjsx" (UID: "720bc518-628e-4cc4-a1cb-b626cfad39dc") : secret "networking-console-plugin-cert" not found Jul 23 18:06:55.720095 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:55.719890 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fcff6cc5-fwvfb: secret "image-registry-tls" not found Jul 23 18:06:55.720095 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:55.719962 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-tls podName:dffca2c1-6cb2-46ec-9842-5c20982d1581 nodeName:}" failed. No retries permitted until 2026-07-23 18:06:57.719956291 +0000 UTC m=+39.637545969 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-tls") pod "image-registry-7fcff6cc5-fwvfb" (UID: "dffca2c1-6cb2-46ec-9842-5c20982d1581") : secret "image-registry-tls" not found Jul 23 18:06:55.760869 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:06:55.760838 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fe94bdd_cbb4_479a_896f_a221bc54a40c.slice/crio-40cd4f6f44060f23eddc4f23c334eecac3b2ffb1b082df09f377bcc7d59ce639 WatchSource:0}: Error finding container 40cd4f6f44060f23eddc4f23c334eecac3b2ffb1b082df09f377bcc7d59ce639: Status 404 returned error can't find the container with id 40cd4f6f44060f23eddc4f23c334eecac3b2ffb1b082df09f377bcc7d59ce639 Jul 23 18:06:55.784605 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:55.784579 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-q5hj8" event={"ID":"9fe94bdd-cbb4-479a-896f-a221bc54a40c","Type":"ContainerStarted","Data":"40cd4f6f44060f23eddc4f23c334eecac3b2ffb1b082df09f377bcc7d59ce639"} Jul 23 18:06:56.790140 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:56.790106 2575 generic.go:356] "Generic (PLEG): container finished" podID="7e5fe41d-ada3-4ef4-8a18-facdc8037fec" containerID="cd996f9894901eae2296a2108b15931338d21ada8baf847176b9830d9e0b881d" exitCode=0 Jul 23 18:06:56.790572 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:56.790153 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fps7b" event={"ID":"7e5fe41d-ada3-4ef4-8a18-facdc8037fec","Type":"ContainerDied","Data":"cd996f9894901eae2296a2108b15931338d21ada8baf847176b9830d9e0b881d"} Jul 23 18:06:57.735871 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:57.735829 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/720bc518-628e-4cc4-a1cb-b626cfad39dc-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dsjsx\" (UID: \"720bc518-628e-4cc4-a1cb-b626cfad39dc\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dsjsx" Jul 23 18:06:57.736020 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:57.735908 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-tls\") pod \"image-registry-7fcff6cc5-fwvfb\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:06:57.736020 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:57.735949 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/98381009-83a2-4c5c-9e31-267ab47e7edc-metrics-tls\") pod \"dns-default-6qdgb\" (UID: \"98381009-83a2-4c5c-9e31-267ab47e7edc\") " pod="openshift-dns/dns-default-6qdgb" Jul 23 18:06:57.736020 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:57.735971 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 18:06:57.736020 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:57.736012 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 18:06:57.736215 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:57.736031 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fcff6cc5-fwvfb: secret "image-registry-tls" not found Jul 23 18:06:57.736215 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:57.736049 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/720bc518-628e-4cc4-a1cb-b626cfad39dc-networking-console-plugin-cert podName:720bc518-628e-4cc4-a1cb-b626cfad39dc nodeName:}" failed. No retries permitted until 2026-07-23 18:07:01.736026425 +0000 UTC m=+43.653616158 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/720bc518-628e-4cc4-a1cb-b626cfad39dc-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dsjsx" (UID: "720bc518-628e-4cc4-a1cb-b626cfad39dc") : secret "networking-console-plugin-cert" not found Jul 23 18:06:57.736215 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:57.736086 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-tls podName:dffca2c1-6cb2-46ec-9842-5c20982d1581 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:01.736067044 +0000 UTC m=+43.653656747 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-tls") pod "image-registry-7fcff6cc5-fwvfb" (UID: "dffca2c1-6cb2-46ec-9842-5c20982d1581") : secret "image-registry-tls" not found Jul 23 18:06:57.736215 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:57.736085 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:06:57.736215 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:06:57.736142 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98381009-83a2-4c5c-9e31-267ab47e7edc-metrics-tls podName:98381009-83a2-4c5c-9e31-267ab47e7edc nodeName:}" failed. No retries permitted until 2026-07-23 18:07:01.736127065 +0000 UTC m=+43.653716746 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/98381009-83a2-4c5c-9e31-267ab47e7edc-metrics-tls") pod "dns-default-6qdgb" (UID: "98381009-83a2-4c5c-9e31-267ab47e7edc") : secret "dns-default-metrics-tls" not found Jul 23 18:06:57.746387 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:57.746353 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:06:57.795877 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:57.795842 2575 generic.go:356] "Generic (PLEG): container finished" podID="7e5fe41d-ada3-4ef4-8a18-facdc8037fec" containerID="68055bbe46da6c371abe264c1bb6de1808d636bd3f04d9a177d4961ae8a379e6" exitCode=0 Jul 23 18:06:57.796280 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:57.795885 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fps7b" event={"ID":"7e5fe41d-ada3-4ef4-8a18-facdc8037fec","Type":"ContainerDied","Data":"68055bbe46da6c371abe264c1bb6de1808d636bd3f04d9a177d4961ae8a379e6"} Jul 23 18:06:58.799884 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:58.799670 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-q5hj8" event={"ID":"9fe94bdd-cbb4-479a-896f-a221bc54a40c","Type":"ContainerStarted","Data":"93c1f20638170e03698f793e6234fd155dcfbc37b8a249a2d22a9eb110f3b698"} Jul 23 18:06:58.802938 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:58.802908 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fps7b" event={"ID":"7e5fe41d-ada3-4ef4-8a18-facdc8037fec","Type":"ContainerStarted","Data":"3bce406fdc0ec3499802a93e1e153cc0e2a23f0a983e84998218add9008fceeb"} Jul 23 18:06:58.826024 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:58.825970 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fps7b" podStartSLOduration=7.928598265 podStartE2EDuration="39.825953546s" totalImagesPullingTime="31.897355281s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:06:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:58.823845892 +0000 UTC m=+40.741435617" watchObservedRunningTime="2026-07-23 18:06:58.825953546 +0000 UTC m=+40.743543246" Jul 23 18:06:58.945571 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:58.945488 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:06:59.001534 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:59.001497 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:06:59.225866 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:59.225767 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:06:59.822127 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:06:59.822076 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-q5hj8" podStartSLOduration=3.930656748 podStartE2EDuration="6.822060403s" totalImagesPullingTime="2.891403655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:06:59.821309873 +0000 UTC m=+41.738899574" watchObservedRunningTime="2026-07-23 18:06:59.822060403 +0000 UTC m=+41.739650122" Jul 23 18:07:01.762902 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:01.762858 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/720bc518-628e-4cc4-a1cb-b626cfad39dc-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dsjsx\" (UID: \"720bc518-628e-4cc4-a1cb-b626cfad39dc\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dsjsx" Jul 23 18:07:01.763283 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:01.762926 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-tls\") pod \"image-registry-7fcff6cc5-fwvfb\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:07:01.763283 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:01.762961 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/98381009-83a2-4c5c-9e31-267ab47e7edc-metrics-tls\") pod \"dns-default-6qdgb\" (UID: \"98381009-83a2-4c5c-9e31-267ab47e7edc\") " pod="openshift-dns/dns-default-6qdgb" Jul 23 18:07:01.763283 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:07:01.763012 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 18:07:01.763283 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:07:01.763060 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:07:01.763283 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:07:01.763074 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 18:07:01.763283 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:07:01.763095 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fcff6cc5-fwvfb: secret "image-registry-tls" not found Jul 23 18:07:01.763283 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:07:01.763080 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/720bc518-628e-4cc4-a1cb-b626cfad39dc-networking-console-plugin-cert podName:720bc518-628e-4cc4-a1cb-b626cfad39dc nodeName:}" failed. No retries permitted until 2026-07-23 18:07:09.763062054 +0000 UTC m=+51.680651755 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/720bc518-628e-4cc4-a1cb-b626cfad39dc-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dsjsx" (UID: "720bc518-628e-4cc4-a1cb-b626cfad39dc") : secret "networking-console-plugin-cert" not found Jul 23 18:07:01.763283 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:07:01.763173 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98381009-83a2-4c5c-9e31-267ab47e7edc-metrics-tls podName:98381009-83a2-4c5c-9e31-267ab47e7edc nodeName:}" failed. No retries permitted until 2026-07-23 18:07:09.763150902 +0000 UTC m=+51.680740583 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/98381009-83a2-4c5c-9e31-267ab47e7edc-metrics-tls") pod "dns-default-6qdgb" (UID: "98381009-83a2-4c5c-9e31-267ab47e7edc") : secret "dns-default-metrics-tls" not found Jul 23 18:07:01.763283 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:07:01.763190 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-tls podName:dffca2c1-6cb2-46ec-9842-5c20982d1581 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:09.763183834 +0000 UTC m=+51.680773516 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-tls") pod "image-registry-7fcff6cc5-fwvfb" (UID: "dffca2c1-6cb2-46ec-9842-5c20982d1581") : secret "image-registry-tls" not found Jul 23 18:07:05.413691 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:05.413631 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:07:05.833361 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:05.833279 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:07:05.954244 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:05.954216 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:07:08.507817 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:08.507780 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:07:08.973837 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:08.973809 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:07:09.475906 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:09.475875 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:07:09.577864 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:09.577832 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:07:09.819026 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:09.818948 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-tls\") pod \"image-registry-7fcff6cc5-fwvfb\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:07:09.819026 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:09.818988 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/98381009-83a2-4c5c-9e31-267ab47e7edc-metrics-tls\") pod \"dns-default-6qdgb\" (UID: \"98381009-83a2-4c5c-9e31-267ab47e7edc\") " pod="openshift-dns/dns-default-6qdgb" Jul 23 18:07:09.819199 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:09.819042 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/720bc518-628e-4cc4-a1cb-b626cfad39dc-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dsjsx\" (UID: \"720bc518-628e-4cc4-a1cb-b626cfad39dc\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dsjsx" Jul 23 18:07:09.819199 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:07:09.819111 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 18:07:09.819199 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:07:09.819128 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 18:07:09.819199 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:07:09.819134 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fcff6cc5-fwvfb: secret "image-registry-tls" not found Jul 23 18:07:09.819199 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:07:09.819143 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:07:09.819199 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:07:09.819179 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/720bc518-628e-4cc4-a1cb-b626cfad39dc-networking-console-plugin-cert podName:720bc518-628e-4cc4-a1cb-b626cfad39dc nodeName:}" failed. No retries permitted until 2026-07-23 18:07:25.81916405 +0000 UTC m=+67.736753729 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/720bc518-628e-4cc4-a1cb-b626cfad39dc-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dsjsx" (UID: "720bc518-628e-4cc4-a1cb-b626cfad39dc") : secret "networking-console-plugin-cert" not found Jul 23 18:07:09.819199 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:07:09.819191 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-tls podName:dffca2c1-6cb2-46ec-9842-5c20982d1581 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:25.819185617 +0000 UTC m=+67.736775295 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-tls") pod "image-registry-7fcff6cc5-fwvfb" (UID: "dffca2c1-6cb2-46ec-9842-5c20982d1581") : secret "image-registry-tls" not found Jul 23 18:07:09.819199 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:07:09.819201 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98381009-83a2-4c5c-9e31-267ab47e7edc-metrics-tls podName:98381009-83a2-4c5c-9e31-267ab47e7edc nodeName:}" failed. No retries permitted until 2026-07-23 18:07:25.819196007 +0000 UTC m=+67.736785684 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/98381009-83a2-4c5c-9e31-267ab47e7edc-metrics-tls") pod "dns-default-6qdgb" (UID: "98381009-83a2-4c5c-9e31-267ab47e7edc") : secret "dns-default-metrics-tls" not found Jul 23 18:07:10.477918 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:10.477883 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:07:10.578723 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:10.578666 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:07:11.417532 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:11.417502 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:07:11.886371 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:11.886338 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:07:11.940968 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:11.940942 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:07:19.777135 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:19.777108 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-s2l8h" Jul 23 18:07:19.928912 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:19.928664 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:07:19.987225 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:19.987186 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:07:21.791665 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:21.791622 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:07:21.892249 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:21.892211 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:07:24.333799 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:24.333764 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ec5e15a-5e12-4225-becb-4590f3039255-original-pull-secret\") pod \"global-pull-secret-syncer-v4vxx\" (UID: \"3ec5e15a-5e12-4225-becb-4590f3039255\") " pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:07:24.336670 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:24.336652 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 23 18:07:24.347728 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:24.347699 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ec5e15a-5e12-4225-becb-4590f3039255-original-pull-secret\") pod \"global-pull-secret-syncer-v4vxx\" (UID: \"3ec5e15a-5e12-4225-becb-4590f3039255\") " pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:07:24.426806 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:24.426774 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-v4vxx" Jul 23 18:07:24.434892 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:24.434866 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-metrics-certs\") pod \"network-metrics-daemon-rpldf\" (UID: \"0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b\") " pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:07:24.434996 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:24.434969 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6g5p\" (UniqueName: \"kubernetes.io/projected/11c5ec1b-2dbf-49cf-9f93-fef53f4007e2-kube-api-access-l6g5p\") pod \"network-check-target-rxckm\" (UID: \"11c5ec1b-2dbf-49cf-9f93-fef53f4007e2\") " pod="openshift-network-diagnostics/network-check-target-rxckm" Jul 23 18:07:24.437733 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:24.437709 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 23 18:07:24.437847 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:24.437831 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 23 18:07:24.445905 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:07:24.445882 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 23 18:07:24.446029 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:07:24.445952 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-metrics-certs podName:0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b nodeName:}" failed. No retries permitted until 2026-07-23 18:08:28.445934594 +0000 UTC m=+130.363524276 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-metrics-certs") pod "network-metrics-daemon-rpldf" (UID: "0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b") : secret "metrics-daemon-secret" not found Jul 23 18:07:24.448503 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:24.448480 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 23 18:07:24.459100 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:24.459068 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6g5p\" (UniqueName: \"kubernetes.io/projected/11c5ec1b-2dbf-49cf-9f93-fef53f4007e2-kube-api-access-l6g5p\") pod \"network-check-target-rxckm\" (UID: \"11c5ec1b-2dbf-49cf-9f93-fef53f4007e2\") " pod="openshift-network-diagnostics/network-check-target-rxckm" Jul 23 18:07:24.560107 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:24.560077 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-v4vxx"] Jul 23 18:07:24.563340 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:07:24.563313 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ec5e15a_5e12_4225_becb_4590f3039255.slice/crio-929120cf8ef5328e837f222b10e6e2db6c5792cd10606982a07a5056f8b04355 WatchSource:0}: Error finding container 929120cf8ef5328e837f222b10e6e2db6c5792cd10606982a07a5056f8b04355: Status 404 returned error can't find the container with id 929120cf8ef5328e837f222b10e6e2db6c5792cd10606982a07a5056f8b04355 Jul 23 18:07:24.740419 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:24.740394 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hffp8\"" Jul 23 18:07:24.748744 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:24.748715 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rxckm" Jul 23 18:07:24.866107 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:24.866034 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v4vxx" event={"ID":"3ec5e15a-5e12-4225-becb-4590f3039255","Type":"ContainerStarted","Data":"929120cf8ef5328e837f222b10e6e2db6c5792cd10606982a07a5056f8b04355"} Jul 23 18:07:24.866267 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:24.866181 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rxckm"] Jul 23 18:07:24.870077 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:07:24.870056 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11c5ec1b_2dbf_49cf_9f93_fef53f4007e2.slice/crio-d6371b4eab884f6db8df7c71d93b67b7ec928860a212db1e43e202c6c6aab8e9 WatchSource:0}: Error finding container d6371b4eab884f6db8df7c71d93b67b7ec928860a212db1e43e202c6c6aab8e9: Status 404 returned error can't find the container with id d6371b4eab884f6db8df7c71d93b67b7ec928860a212db1e43e202c6c6aab8e9 Jul 23 18:07:25.672328 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:25.672237 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:07:25.773658 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:25.773624 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:07:25.846333 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:25.846293 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/720bc518-628e-4cc4-a1cb-b626cfad39dc-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dsjsx\" (UID: \"720bc518-628e-4cc4-a1cb-b626cfad39dc\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dsjsx" Jul 23 18:07:25.846506 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:25.846354 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-tls\") pod \"image-registry-7fcff6cc5-fwvfb\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:07:25.846506 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:25.846394 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/98381009-83a2-4c5c-9e31-267ab47e7edc-metrics-tls\") pod \"dns-default-6qdgb\" (UID: \"98381009-83a2-4c5c-9e31-267ab47e7edc\") " pod="openshift-dns/dns-default-6qdgb" Jul 23 18:07:25.846506 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:07:25.846449 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 18:07:25.846704 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:07:25.846519 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 18:07:25.846704 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:07:25.846528 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:07:25.846704 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:07:25.846540 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fcff6cc5-fwvfb: secret "image-registry-tls" not found Jul 23 18:07:25.846704 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:07:25.846551 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/720bc518-628e-4cc4-a1cb-b626cfad39dc-networking-console-plugin-cert podName:720bc518-628e-4cc4-a1cb-b626cfad39dc nodeName:}" failed. No retries permitted until 2026-07-23 18:07:57.846528854 +0000 UTC m=+99.764118532 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/720bc518-628e-4cc4-a1cb-b626cfad39dc-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dsjsx" (UID: "720bc518-628e-4cc4-a1cb-b626cfad39dc") : secret "networking-console-plugin-cert" not found Jul 23 18:07:25.846704 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:07:25.846576 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98381009-83a2-4c5c-9e31-267ab47e7edc-metrics-tls podName:98381009-83a2-4c5c-9e31-267ab47e7edc nodeName:}" failed. No retries permitted until 2026-07-23 18:07:57.846564655 +0000 UTC m=+99.764154333 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/98381009-83a2-4c5c-9e31-267ab47e7edc-metrics-tls") pod "dns-default-6qdgb" (UID: "98381009-83a2-4c5c-9e31-267ab47e7edc") : secret "dns-default-metrics-tls" not found Jul 23 18:07:25.846704 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:07:25.846590 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-tls podName:dffca2c1-6cb2-46ec-9842-5c20982d1581 nodeName:}" failed. No retries permitted until 2026-07-23 18:07:57.846584062 +0000 UTC m=+99.764173740 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-tls") pod "image-registry-7fcff6cc5-fwvfb" (UID: "dffca2c1-6cb2-46ec-9842-5c20982d1581") : secret "image-registry-tls" not found Jul 23 18:07:25.870385 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:25.870352 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rxckm" event={"ID":"11c5ec1b-2dbf-49cf-9f93-fef53f4007e2","Type":"ContainerStarted","Data":"d6371b4eab884f6db8df7c71d93b67b7ec928860a212db1e43e202c6c6aab8e9"} Jul 23 18:07:26.276320 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:26.276280 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:07:29.882843 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:29.882807 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-v4vxx" event={"ID":"3ec5e15a-5e12-4225-becb-4590f3039255","Type":"ContainerStarted","Data":"e2cf98df618d322f3668748323b57d00ee1627a8fda5e089df29c41d5576d31a"} Jul 23 18:07:29.884360 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:29.884336 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rxckm" event={"ID":"11c5ec1b-2dbf-49cf-9f93-fef53f4007e2","Type":"ContainerStarted","Data":"41943173cea10fced262155efdb0bad13d0c90d2900dba05cfa59c9bbd7c247e"} Jul 23 18:07:29.884494 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:29.884476 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rxckm" Jul 23 18:07:29.898502 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:29.898455 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-v4vxx" podStartSLOduration=66.282356646 podStartE2EDuration="1m10.898439919s" totalImagesPullingTime="4.616083273s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:29.897916052 +0000 UTC m=+71.815505753" watchObservedRunningTime="2026-07-23 18:07:29.898439919 +0000 UTC m=+71.816029663" Jul 23 18:07:29.912472 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:29.912432 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rxckm" podStartSLOduration=66.618671415 podStartE2EDuration="1m10.912416993s" totalImagesPullingTime="4.293745578s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:07:29.911796046 +0000 UTC m=+71.829385746" watchObservedRunningTime="2026-07-23 18:07:29.912416993 +0000 UTC m=+71.830006684" Jul 23 18:07:30.859319 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:30.859289 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:07:30.959366 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:30.959334 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:07:47.514353 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:47.514219 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:07:47.578662 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:47.578627 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:07:57.869589 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:57.869561 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-tls\") pod \"image-registry-7fcff6cc5-fwvfb\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:07:57.869937 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:57.869600 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/98381009-83a2-4c5c-9e31-267ab47e7edc-metrics-tls\") pod \"dns-default-6qdgb\" (UID: \"98381009-83a2-4c5c-9e31-267ab47e7edc\") " pod="openshift-dns/dns-default-6qdgb" Jul 23 18:07:57.869937 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:57.869651 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/720bc518-628e-4cc4-a1cb-b626cfad39dc-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dsjsx\" (UID: \"720bc518-628e-4cc4-a1cb-b626cfad39dc\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dsjsx" Jul 23 18:07:57.869937 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:07:57.869730 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 18:07:57.869937 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:07:57.869749 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fcff6cc5-fwvfb: secret "image-registry-tls" not found Jul 23 18:07:57.869937 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:07:57.869750 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 18:07:57.869937 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:07:57.869763 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:07:57.869937 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:07:57.869813 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/720bc518-628e-4cc4-a1cb-b626cfad39dc-networking-console-plugin-cert podName:720bc518-628e-4cc4-a1cb-b626cfad39dc nodeName:}" failed. No retries permitted until 2026-07-23 18:09:01.869796198 +0000 UTC m=+163.787385892 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/720bc518-628e-4cc4-a1cb-b626cfad39dc-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dsjsx" (UID: "720bc518-628e-4cc4-a1cb-b626cfad39dc") : secret "networking-console-plugin-cert" not found Jul 23 18:07:57.869937 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:07:57.869831 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98381009-83a2-4c5c-9e31-267ab47e7edc-metrics-tls podName:98381009-83a2-4c5c-9e31-267ab47e7edc nodeName:}" failed. No retries permitted until 2026-07-23 18:09:01.869821672 +0000 UTC m=+163.787411351 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/98381009-83a2-4c5c-9e31-267ab47e7edc-metrics-tls") pod "dns-default-6qdgb" (UID: "98381009-83a2-4c5c-9e31-267ab47e7edc") : secret "dns-default-metrics-tls" not found Jul 23 18:07:57.869937 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:07:57.869848 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-tls podName:dffca2c1-6cb2-46ec-9842-5c20982d1581 nodeName:}" failed. No retries permitted until 2026-07-23 18:09:01.869839995 +0000 UTC m=+163.787429688 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-tls") pod "image-registry-7fcff6cc5-fwvfb" (UID: "dffca2c1-6cb2-46ec-9842-5c20982d1581") : secret "image-registry-tls" not found Jul 23 18:07:58.492813 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:58.492777 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-578dbf6679-kvvkj"] Jul 23 18:07:58.498845 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:58.498826 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578dbf6679-kvvkj" Jul 23 18:07:58.501451 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:58.501426 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 23 18:07:58.502933 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:58.502883 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 23 18:07:58.503101 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:58.502973 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 23 18:07:58.503101 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:58.503016 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 23 18:07:58.504367 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:58.504342 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-578dbf6679-kvvkj"] Jul 23 18:07:58.574209 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:58.574177 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bcf53996-f16b-41c4-b628-2b612a592187-klusterlet-config\") pod \"klusterlet-addon-workmgr-578dbf6679-kvvkj\" (UID: \"bcf53996-f16b-41c4-b628-2b612a592187\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578dbf6679-kvvkj" Jul 23 18:07:58.574333 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:58.574225 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcf53996-f16b-41c4-b628-2b612a592187-tmp\") pod \"klusterlet-addon-workmgr-578dbf6679-kvvkj\" (UID: \"bcf53996-f16b-41c4-b628-2b612a592187\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578dbf6679-kvvkj" Jul 23 18:07:58.574333 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:58.574301 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24skd\" (UniqueName: \"kubernetes.io/projected/bcf53996-f16b-41c4-b628-2b612a592187-kube-api-access-24skd\") pod \"klusterlet-addon-workmgr-578dbf6679-kvvkj\" (UID: \"bcf53996-f16b-41c4-b628-2b612a592187\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578dbf6679-kvvkj" Jul 23 18:07:58.674945 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:58.674901 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bcf53996-f16b-41c4-b628-2b612a592187-klusterlet-config\") pod \"klusterlet-addon-workmgr-578dbf6679-kvvkj\" (UID: \"bcf53996-f16b-41c4-b628-2b612a592187\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578dbf6679-kvvkj" Jul 23 18:07:58.674945 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:58.674945 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcf53996-f16b-41c4-b628-2b612a592187-tmp\") pod \"klusterlet-addon-workmgr-578dbf6679-kvvkj\" (UID: \"bcf53996-f16b-41c4-b628-2b612a592187\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578dbf6679-kvvkj" Jul 23 18:07:58.675143 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:58.674976 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24skd\" (UniqueName: \"kubernetes.io/projected/bcf53996-f16b-41c4-b628-2b612a592187-kube-api-access-24skd\") pod \"klusterlet-addon-workmgr-578dbf6679-kvvkj\" (UID: \"bcf53996-f16b-41c4-b628-2b612a592187\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578dbf6679-kvvkj" Jul 23 18:07:58.675364 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:58.675340 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcf53996-f16b-41c4-b628-2b612a592187-tmp\") pod \"klusterlet-addon-workmgr-578dbf6679-kvvkj\" (UID: \"bcf53996-f16b-41c4-b628-2b612a592187\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578dbf6679-kvvkj" Jul 23 18:07:58.677411 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:58.677384 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bcf53996-f16b-41c4-b628-2b612a592187-klusterlet-config\") pod \"klusterlet-addon-workmgr-578dbf6679-kvvkj\" (UID: \"bcf53996-f16b-41c4-b628-2b612a592187\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578dbf6679-kvvkj" Jul 23 18:07:58.684349 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:58.684323 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24skd\" (UniqueName: \"kubernetes.io/projected/bcf53996-f16b-41c4-b628-2b612a592187-kube-api-access-24skd\") pod \"klusterlet-addon-workmgr-578dbf6679-kvvkj\" (UID: \"bcf53996-f16b-41c4-b628-2b612a592187\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578dbf6679-kvvkj" Jul 23 18:07:58.808894 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:58.808805 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578dbf6679-kvvkj" Jul 23 18:07:58.954586 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:58.954558 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-578dbf6679-kvvkj"] Jul 23 18:07:58.957449 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:07:58.957424 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcf53996_f16b_41c4_b628_2b612a592187.slice/crio-3f849e56a67074ded21c92f5e1f4a7392b8333e1b58efe2f9463d704ac9b14ab WatchSource:0}: Error finding container 3f849e56a67074ded21c92f5e1f4a7392b8333e1b58efe2f9463d704ac9b14ab: Status 404 returned error can't find the container with id 3f849e56a67074ded21c92f5e1f4a7392b8333e1b58efe2f9463d704ac9b14ab Jul 23 18:07:59.954756 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:07:59.954722 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578dbf6679-kvvkj" event={"ID":"bcf53996-f16b-41c4-b628-2b612a592187","Type":"ContainerStarted","Data":"3f849e56a67074ded21c92f5e1f4a7392b8333e1b58efe2f9463d704ac9b14ab"} Jul 23 18:08:00.888621 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:08:00.888588 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rxckm" Jul 23 18:08:03.966992 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:08:03.966952 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578dbf6679-kvvkj" event={"ID":"bcf53996-f16b-41c4-b628-2b612a592187","Type":"ContainerStarted","Data":"0ae9dc88f7ca4b941c6ccbf8d618c5152273cc121a413d884cb87426b97409ac"} Jul 23 18:08:03.967394 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:08:03.967163 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578dbf6679-kvvkj" Jul 23 18:08:03.968763 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:08:03.968744 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578dbf6679-kvvkj" Jul 23 18:08:03.983108 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:08:03.983062 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578dbf6679-kvvkj" podStartSLOduration=1.189433997 podStartE2EDuration="5.983048667s" totalImagesPullingTime="4.79361467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:08:03.98228053 +0000 UTC m=+105.899870231" watchObservedRunningTime="2026-07-23 18:08:03.983048667 +0000 UTC m=+105.900638367" Jul 23 18:08:21.438177 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:08:21.438138 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:08:21.499535 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:08:21.499496 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:08:28.490558 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:08:28.490524 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-metrics-certs\") pod \"network-metrics-daemon-rpldf\" (UID: \"0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b\") " pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:08:28.491017 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:08:28.490667 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 23 18:08:28.491017 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:08:28.490745 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-metrics-certs podName:0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b nodeName:}" failed. No retries permitted until 2026-07-23 18:10:30.490729823 +0000 UTC m=+252.408319501 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-metrics-certs") pod "network-metrics-daemon-rpldf" (UID: "0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b") : secret "metrics-daemon-secret" not found Jul 23 18:08:56.930610 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:08:56.930557 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dsjsx" podUID="720bc518-628e-4cc4-a1cb-b626cfad39dc" Jul 23 18:08:56.954769 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:08:56.954733 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" podUID="dffca2c1-6cb2-46ec-9842-5c20982d1581" Jul 23 18:08:56.975966 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:08:56.975946 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6qdgb" podUID="98381009-83a2-4c5c-9e31-267ab47e7edc" Jul 23 18:08:57.092748 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:08:57.092717 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dsjsx" Jul 23 18:08:57.092862 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:08:57.092727 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:08:57.093005 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:08:57.092728 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6qdgb" Jul 23 18:08:58.632600 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:08:58.632563 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-rpldf" podUID="0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b" Jul 23 18:09:01.914493 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:09:01.914444 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/98381009-83a2-4c5c-9e31-267ab47e7edc-metrics-tls\") pod \"dns-default-6qdgb\" (UID: \"98381009-83a2-4c5c-9e31-267ab47e7edc\") " pod="openshift-dns/dns-default-6qdgb" Jul 23 18:09:01.914905 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:09:01.914524 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/720bc518-628e-4cc4-a1cb-b626cfad39dc-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dsjsx\" (UID: \"720bc518-628e-4cc4-a1cb-b626cfad39dc\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dsjsx" Jul 23 18:09:01.914905 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:09:01.914549 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-tls\") pod \"image-registry-7fcff6cc5-fwvfb\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:09:01.914905 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:09:01.914585 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 23 18:09:01.914905 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:09:01.914646 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 23 18:09:01.914905 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:09:01.914656 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7fcff6cc5-fwvfb: secret "image-registry-tls" not found Jul 23 18:09:01.914905 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:09:01.914655 2575 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 23 18:09:01.914905 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:09:01.914660 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98381009-83a2-4c5c-9e31-267ab47e7edc-metrics-tls podName:98381009-83a2-4c5c-9e31-267ab47e7edc nodeName:}" failed. No retries permitted until 2026-07-23 18:11:03.914644303 +0000 UTC m=+285.832233982 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/98381009-83a2-4c5c-9e31-267ab47e7edc-metrics-tls") pod "dns-default-6qdgb" (UID: "98381009-83a2-4c5c-9e31-267ab47e7edc") : secret "dns-default-metrics-tls" not found Jul 23 18:09:01.914905 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:09:01.914744 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-tls podName:dffca2c1-6cb2-46ec-9842-5c20982d1581 nodeName:}" failed. No retries permitted until 2026-07-23 18:11:03.914730764 +0000 UTC m=+285.832320441 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-tls") pod "image-registry-7fcff6cc5-fwvfb" (UID: "dffca2c1-6cb2-46ec-9842-5c20982d1581") : secret "image-registry-tls" not found Jul 23 18:09:01.914905 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:09:01.914756 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/720bc518-628e-4cc4-a1cb-b626cfad39dc-networking-console-plugin-cert podName:720bc518-628e-4cc4-a1cb-b626cfad39dc nodeName:}" failed. No retries permitted until 2026-07-23 18:11:03.914750189 +0000 UTC m=+285.832339869 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/720bc518-628e-4cc4-a1cb-b626cfad39dc-networking-console-plugin-cert") pod "networking-console-plugin-7bc7489cb5-dsjsx" (UID: "720bc518-628e-4cc4-a1cb-b626cfad39dc") : secret "networking-console-plugin-cert" not found Jul 23 18:09:10.614507 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:09:10.614467 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:09:56.562895 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:09:56.562865 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:03.967736 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:03.967668 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578dbf6679-kvvkj" podUID="bcf53996-f16b-41c4-b628-2b612a592187" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.10:8000/readyz\": dial tcp 10.132.0.10:8000: connect: connection refused" Jul 23 18:10:04.252505 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:04.252473 2575 generic.go:356] "Generic (PLEG): container finished" podID="bcf53996-f16b-41c4-b628-2b612a592187" containerID="0ae9dc88f7ca4b941c6ccbf8d618c5152273cc121a413d884cb87426b97409ac" exitCode=1 Jul 23 18:10:04.252650 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:04.252548 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578dbf6679-kvvkj" event={"ID":"bcf53996-f16b-41c4-b628-2b612a592187","Type":"ContainerDied","Data":"0ae9dc88f7ca4b941c6ccbf8d618c5152273cc121a413d884cb87426b97409ac"} Jul 23 18:10:04.252868 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:04.252855 2575 scope.go:117] "RemoveContainer" containerID="0ae9dc88f7ca4b941c6ccbf8d618c5152273cc121a413d884cb87426b97409ac" Jul 23 18:10:05.256465 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:05.256424 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578dbf6679-kvvkj" event={"ID":"bcf53996-f16b-41c4-b628-2b612a592187","Type":"ContainerStarted","Data":"2470d92079bcd04c893a36c00734200ec7dbdfbf4750a376854ab92ce63f74a6"} Jul 23 18:10:05.256840 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:05.256810 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578dbf6679-kvvkj" Jul 23 18:10:05.257320 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:05.257304 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-578dbf6679-kvvkj" Jul 23 18:10:13.377006 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:13.376969 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:30.528554 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:30.528513 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-metrics-certs\") pod \"network-metrics-daemon-rpldf\" (UID: \"0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b\") " pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:10:30.529052 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:30.528634 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 23 18:10:30.529052 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:30.528704 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-metrics-certs podName:0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b nodeName:}" failed. No retries permitted until 2026-07-23 18:12:32.528669602 +0000 UTC m=+374.446259280 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-metrics-certs") pod "network-metrics-daemon-rpldf" (UID: "0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b") : secret "metrics-daemon-secret" not found Jul 23 18:10:41.683334 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.683262 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-75xcm"] Jul 23 18:10:41.686027 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.686012 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-75xcm" Jul 23 18:10:41.689115 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.689092 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-bt4l4\"" Jul 23 18:10:41.702311 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.702287 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-75xcm"] Jul 23 18:10:41.783936 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.783906 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-plgf8"] Jul 23 18:10:41.787087 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.787064 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7cd988784b-m9zqk"] Jul 23 18:10:41.787194 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.787175 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-plgf8" Jul 23 18:10:41.789814 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.789795 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7cd988784b-m9zqk" Jul 23 18:10:41.789922 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.789828 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 23 18:10:41.789922 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.789873 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 23 18:10:41.790029 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.789876 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 23 18:10:41.790551 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.790523 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 23 18:10:41.790646 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.790631 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-f8dwd\"" Jul 23 18:10:41.793327 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.793150 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 23 18:10:41.793327 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.793172 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 23 18:10:41.793327 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.793152 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 23 18:10:41.793327 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.793199 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 23 18:10:41.793763 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.793577 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 23 18:10:41.793763 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.793719 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-qlfft\"" Jul 23 18:10:41.795160 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.795142 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 23 18:10:41.797072 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.797055 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 23 18:10:41.801863 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.801842 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-plgf8"] Jul 23 18:10:41.801989 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.801968 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n55z\" (UniqueName: \"kubernetes.io/projected/4d00c056-1c8b-4414-91c2-a04bcd37a8af-kube-api-access-4n55z\") pod \"network-check-source-7bc5b6bf85-75xcm\" (UID: \"4d00c056-1c8b-4414-91c2-a04bcd37a8af\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-75xcm" Jul 23 18:10:41.802948 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.802929 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7cd988784b-m9zqk"] Jul 23 18:10:41.902815 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.902785 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n55z\" (UniqueName: \"kubernetes.io/projected/4d00c056-1c8b-4414-91c2-a04bcd37a8af-kube-api-access-4n55z\") pod \"network-check-source-7bc5b6bf85-75xcm\" (UID: \"4d00c056-1c8b-4414-91c2-a04bcd37a8af\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-75xcm" Jul 23 18:10:41.902947 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.902828 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a7a1d203-b9aa-43b4-8533-188e73336f5a-config\") pod \"console-operator-565b7b569d-plgf8\" (UID: \"a7a1d203-b9aa-43b4-8533-188e73336f5a\") " pod="openshift-console-operator/console-operator-565b7b569d-plgf8" Jul 23 18:10:41.902947 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.902848 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a7a1d203-b9aa-43b4-8533-188e73336f5a-serving-cert\") pod \"console-operator-565b7b569d-plgf8\" (UID: \"a7a1d203-b9aa-43b4-8533-188e73336f5a\") " pod="openshift-console-operator/console-operator-565b7b569d-plgf8" Jul 23 18:10:41.902947 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.902867 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-metrics-certs\") pod \"router-default-7cd988784b-m9zqk\" (UID: \"c7d035d4-940c-44fb-9486-2f4b1fe4fb70\") " pod="openshift-ingress/router-default-7cd988784b-m9zqk" Jul 23 18:10:41.902947 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.902934 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-stats-auth\") pod \"router-default-7cd988784b-m9zqk\" (UID: \"c7d035d4-940c-44fb-9486-2f4b1fe4fb70\") " pod="openshift-ingress/router-default-7cd988784b-m9zqk" Jul 23 18:10:41.903113 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.902950 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pln4f\" (UniqueName: \"kubernetes.io/projected/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-kube-api-access-pln4f\") pod \"router-default-7cd988784b-m9zqk\" (UID: \"c7d035d4-940c-44fb-9486-2f4b1fe4fb70\") " pod="openshift-ingress/router-default-7cd988784b-m9zqk" Jul 23 18:10:41.903113 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.902965 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvxzz\" (UniqueName: \"kubernetes.io/projected/a7a1d203-b9aa-43b4-8533-188e73336f5a-kube-api-access-dvxzz\") pod \"console-operator-565b7b569d-plgf8\" (UID: \"a7a1d203-b9aa-43b4-8533-188e73336f5a\") " pod="openshift-console-operator/console-operator-565b7b569d-plgf8" Jul 23 18:10:41.903113 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.902985 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7a1d203-b9aa-43b4-8533-188e73336f5a-trusted-ca\") pod \"console-operator-565b7b569d-plgf8\" (UID: \"a7a1d203-b9aa-43b4-8533-188e73336f5a\") " pod="openshift-console-operator/console-operator-565b7b569d-plgf8" Jul 23 18:10:41.903113 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.903009 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-default-certificate\") pod \"router-default-7cd988784b-m9zqk\" (UID: \"c7d035d4-940c-44fb-9486-2f4b1fe4fb70\") " pod="openshift-ingress/router-default-7cd988784b-m9zqk" Jul 23 18:10:41.903113 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.903025 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-service-ca-bundle\") pod \"router-default-7cd988784b-m9zqk\" (UID: \"c7d035d4-940c-44fb-9486-2f4b1fe4fb70\") " pod="openshift-ingress/router-default-7cd988784b-m9zqk" Jul 23 18:10:41.910853 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.910828 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n55z\" (UniqueName: \"kubernetes.io/projected/4d00c056-1c8b-4414-91c2-a04bcd37a8af-kube-api-access-4n55z\") pod \"network-check-source-7bc5b6bf85-75xcm\" (UID: \"4d00c056-1c8b-4414-91c2-a04bcd37a8af\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-75xcm" Jul 23 18:10:41.921590 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.921569 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:41.975120 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.975061 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:41.993911 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:41.993893 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-75xcm" Jul 23 18:10:42.003877 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:42.003859 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-default-certificate\") pod \"router-default-7cd988784b-m9zqk\" (UID: \"c7d035d4-940c-44fb-9486-2f4b1fe4fb70\") " pod="openshift-ingress/router-default-7cd988784b-m9zqk" Jul 23 18:10:42.004004 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:42.003886 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-service-ca-bundle\") pod \"router-default-7cd988784b-m9zqk\" (UID: \"c7d035d4-940c-44fb-9486-2f4b1fe4fb70\") " pod="openshift-ingress/router-default-7cd988784b-m9zqk" Jul 23 18:10:42.004080 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:42.004063 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-service-ca-bundle podName:c7d035d4-940c-44fb-9486-2f4b1fe4fb70 nodeName:}" failed. No retries permitted until 2026-07-23 18:10:42.504045146 +0000 UTC m=+264.421634843 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-service-ca-bundle") pod "router-default-7cd988784b-m9zqk" (UID: "c7d035d4-940c-44fb-9486-2f4b1fe4fb70") : configmap references non-existent config key: service-ca.crt Jul 23 18:10:42.004229 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:42.004211 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a7a1d203-b9aa-43b4-8533-188e73336f5a-config\") pod \"console-operator-565b7b569d-plgf8\" (UID: \"a7a1d203-b9aa-43b4-8533-188e73336f5a\") " pod="openshift-console-operator/console-operator-565b7b569d-plgf8" Jul 23 18:10:42.004317 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:42.004246 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a7a1d203-b9aa-43b4-8533-188e73336f5a-serving-cert\") pod \"console-operator-565b7b569d-plgf8\" (UID: \"a7a1d203-b9aa-43b4-8533-188e73336f5a\") " pod="openshift-console-operator/console-operator-565b7b569d-plgf8" Jul 23 18:10:42.004317 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:42.004289 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-metrics-certs\") pod \"router-default-7cd988784b-m9zqk\" (UID: \"c7d035d4-940c-44fb-9486-2f4b1fe4fb70\") " pod="openshift-ingress/router-default-7cd988784b-m9zqk" Jul 23 18:10:42.004425 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:42.004351 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-stats-auth\") pod \"router-default-7cd988784b-m9zqk\" (UID: \"c7d035d4-940c-44fb-9486-2f4b1fe4fb70\") " pod="openshift-ingress/router-default-7cd988784b-m9zqk" Jul 23 18:10:42.004425 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:42.004377 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pln4f\" (UniqueName: \"kubernetes.io/projected/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-kube-api-access-pln4f\") pod \"router-default-7cd988784b-m9zqk\" (UID: \"c7d035d4-940c-44fb-9486-2f4b1fe4fb70\") " pod="openshift-ingress/router-default-7cd988784b-m9zqk" Jul 23 18:10:42.004425 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:42.004403 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 23 18:10:42.004574 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:42.004529 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-metrics-certs podName:c7d035d4-940c-44fb-9486-2f4b1fe4fb70 nodeName:}" failed. No retries permitted until 2026-07-23 18:10:42.504510765 +0000 UTC m=+264.422100451 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-metrics-certs") pod "router-default-7cd988784b-m9zqk" (UID: "c7d035d4-940c-44fb-9486-2f4b1fe4fb70") : secret "router-metrics-certs-default" not found Jul 23 18:10:42.004574 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:42.004407 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvxzz\" (UniqueName: \"kubernetes.io/projected/a7a1d203-b9aa-43b4-8533-188e73336f5a-kube-api-access-dvxzz\") pod \"console-operator-565b7b569d-plgf8\" (UID: \"a7a1d203-b9aa-43b4-8533-188e73336f5a\") " pod="openshift-console-operator/console-operator-565b7b569d-plgf8" Jul 23 18:10:42.004705 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:42.004620 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7a1d203-b9aa-43b4-8533-188e73336f5a-trusted-ca\") pod \"console-operator-565b7b569d-plgf8\" (UID: \"a7a1d203-b9aa-43b4-8533-188e73336f5a\") " pod="openshift-console-operator/console-operator-565b7b569d-plgf8" Jul 23 18:10:42.005275 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:42.005249 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a7a1d203-b9aa-43b4-8533-188e73336f5a-config\") pod \"console-operator-565b7b569d-plgf8\" (UID: \"a7a1d203-b9aa-43b4-8533-188e73336f5a\") " pod="openshift-console-operator/console-operator-565b7b569d-plgf8" Jul 23 18:10:42.006082 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:42.006056 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7a1d203-b9aa-43b4-8533-188e73336f5a-trusted-ca\") pod \"console-operator-565b7b569d-plgf8\" (UID: \"a7a1d203-b9aa-43b4-8533-188e73336f5a\") " pod="openshift-console-operator/console-operator-565b7b569d-plgf8" Jul 23 18:10:42.006940 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:42.006916 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-default-certificate\") pod \"router-default-7cd988784b-m9zqk\" (UID: \"c7d035d4-940c-44fb-9486-2f4b1fe4fb70\") " pod="openshift-ingress/router-default-7cd988784b-m9zqk" Jul 23 18:10:42.007204 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:42.007181 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-stats-auth\") pod \"router-default-7cd988784b-m9zqk\" (UID: \"c7d035d4-940c-44fb-9486-2f4b1fe4fb70\") " pod="openshift-ingress/router-default-7cd988784b-m9zqk" Jul 23 18:10:42.007204 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:42.007195 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a7a1d203-b9aa-43b4-8533-188e73336f5a-serving-cert\") pod \"console-operator-565b7b569d-plgf8\" (UID: \"a7a1d203-b9aa-43b4-8533-188e73336f5a\") " pod="openshift-console-operator/console-operator-565b7b569d-plgf8" Jul 23 18:10:42.012724 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:42.012696 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvxzz\" (UniqueName: \"kubernetes.io/projected/a7a1d203-b9aa-43b4-8533-188e73336f5a-kube-api-access-dvxzz\") pod \"console-operator-565b7b569d-plgf8\" (UID: \"a7a1d203-b9aa-43b4-8533-188e73336f5a\") " pod="openshift-console-operator/console-operator-565b7b569d-plgf8" Jul 23 18:10:42.013962 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:42.013929 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pln4f\" (UniqueName: \"kubernetes.io/projected/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-kube-api-access-pln4f\") pod \"router-default-7cd988784b-m9zqk\" (UID: \"c7d035d4-940c-44fb-9486-2f4b1fe4fb70\") " pod="openshift-ingress/router-default-7cd988784b-m9zqk" Jul 23 18:10:42.097270 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:42.097243 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-plgf8" Jul 23 18:10:42.118176 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:42.118150 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-75xcm"] Jul 23 18:10:42.120689 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:10:42.120646 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d00c056_1c8b_4414_91c2_a04bcd37a8af.slice/crio-3aab88ad4844cce70aa40861d9a41b6cc766f68aa24cf22d97b18fc009741d91 WatchSource:0}: Error finding container 3aab88ad4844cce70aa40861d9a41b6cc766f68aa24cf22d97b18fc009741d91: Status 404 returned error can't find the container with id 3aab88ad4844cce70aa40861d9a41b6cc766f68aa24cf22d97b18fc009741d91 Jul 23 18:10:42.221270 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:42.221241 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-plgf8"] Jul 23 18:10:42.223704 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:10:42.223664 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7a1d203_b9aa_43b4_8533_188e73336f5a.slice/crio-491fb1e2d653fd6e7e50e189609e53e2a317bcdb0defec63da6e4be19573bb13 WatchSource:0}: Error finding container 491fb1e2d653fd6e7e50e189609e53e2a317bcdb0defec63da6e4be19573bb13: Status 404 returned error can't find the container with id 491fb1e2d653fd6e7e50e189609e53e2a317bcdb0defec63da6e4be19573bb13 Jul 23 18:10:42.344631 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:42.344607 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-75xcm" event={"ID":"4d00c056-1c8b-4414-91c2-a04bcd37a8af","Type":"ContainerStarted","Data":"4a517118d181f1d3d49bff6fdb2123868c26bfdffdde4e8a09be871ea543d6c8"} Jul 23 18:10:42.344765 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:42.344654 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-75xcm" event={"ID":"4d00c056-1c8b-4414-91c2-a04bcd37a8af","Type":"ContainerStarted","Data":"3aab88ad4844cce70aa40861d9a41b6cc766f68aa24cf22d97b18fc009741d91"} Jul 23 18:10:42.345656 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:42.345633 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-plgf8" event={"ID":"a7a1d203-b9aa-43b4-8533-188e73336f5a","Type":"ContainerStarted","Data":"491fb1e2d653fd6e7e50e189609e53e2a317bcdb0defec63da6e4be19573bb13"} Jul 23 18:10:42.360251 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:42.360217 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-75xcm" podStartSLOduration=1.360204782 podStartE2EDuration="1.360204782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:10:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:10:42.359761669 +0000 UTC m=+264.277351367" watchObservedRunningTime="2026-07-23 18:10:42.360204782 +0000 UTC m=+264.277794481" Jul 23 18:10:42.508460 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:42.508403 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-metrics-certs\") pod \"router-default-7cd988784b-m9zqk\" (UID: \"c7d035d4-940c-44fb-9486-2f4b1fe4fb70\") " pod="openshift-ingress/router-default-7cd988784b-m9zqk" Jul 23 18:10:42.508533 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:42.508466 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-service-ca-bundle\") pod \"router-default-7cd988784b-m9zqk\" (UID: \"c7d035d4-940c-44fb-9486-2f4b1fe4fb70\") " pod="openshift-ingress/router-default-7cd988784b-m9zqk" Jul 23 18:10:42.508580 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:42.508532 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 23 18:10:42.508580 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:42.508567 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-service-ca-bundle podName:c7d035d4-940c-44fb-9486-2f4b1fe4fb70 nodeName:}" failed. No retries permitted until 2026-07-23 18:10:43.508555787 +0000 UTC m=+265.426145465 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-service-ca-bundle") pod "router-default-7cd988784b-m9zqk" (UID: "c7d035d4-940c-44fb-9486-2f4b1fe4fb70") : configmap references non-existent config key: service-ca.crt Jul 23 18:10:42.508651 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:42.508582 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-metrics-certs podName:c7d035d4-940c-44fb-9486-2f4b1fe4fb70 nodeName:}" failed. No retries permitted until 2026-07-23 18:10:43.508575288 +0000 UTC m=+265.426164966 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-metrics-certs") pod "router-default-7cd988784b-m9zqk" (UID: "c7d035d4-940c-44fb-9486-2f4b1fe4fb70") : secret "router-metrics-certs-default" not found Jul 23 18:10:43.517109 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:43.517073 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-metrics-certs\") pod \"router-default-7cd988784b-m9zqk\" (UID: \"c7d035d4-940c-44fb-9486-2f4b1fe4fb70\") " pod="openshift-ingress/router-default-7cd988784b-m9zqk" Jul 23 18:10:43.517537 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:43.517150 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-service-ca-bundle\") pod \"router-default-7cd988784b-m9zqk\" (UID: \"c7d035d4-940c-44fb-9486-2f4b1fe4fb70\") " pod="openshift-ingress/router-default-7cd988784b-m9zqk" Jul 23 18:10:43.517537 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:43.517228 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 23 18:10:43.517537 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:43.517268 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-service-ca-bundle podName:c7d035d4-940c-44fb-9486-2f4b1fe4fb70 nodeName:}" failed. No retries permitted until 2026-07-23 18:10:45.517251495 +0000 UTC m=+267.434841177 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-service-ca-bundle") pod "router-default-7cd988784b-m9zqk" (UID: "c7d035d4-940c-44fb-9486-2f4b1fe4fb70") : configmap references non-existent config key: service-ca.crt Jul 23 18:10:43.517537 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:43.517284 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-metrics-certs podName:c7d035d4-940c-44fb-9486-2f4b1fe4fb70 nodeName:}" failed. No retries permitted until 2026-07-23 18:10:45.517277155 +0000 UTC m=+267.434866832 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-metrics-certs") pod "router-default-7cd988784b-m9zqk" (UID: "c7d035d4-940c-44fb-9486-2f4b1fe4fb70") : secret "router-metrics-certs-default" not found Jul 23 18:10:44.358472 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:44.358441 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-plgf8_a7a1d203-b9aa-43b4-8533-188e73336f5a/console-operator/0.log" Jul 23 18:10:44.358586 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:44.358491 2575 generic.go:356] "Generic (PLEG): container finished" podID="a7a1d203-b9aa-43b4-8533-188e73336f5a" containerID="b3954a944d3f75f7e93142a9da6e3059898646a2d1700ba370fbd07ce65936dc" exitCode=255 Jul 23 18:10:44.358586 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:44.358539 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-plgf8" event={"ID":"a7a1d203-b9aa-43b4-8533-188e73336f5a","Type":"ContainerDied","Data":"b3954a944d3f75f7e93142a9da6e3059898646a2d1700ba370fbd07ce65936dc"} Jul 23 18:10:44.358824 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:44.358810 2575 scope.go:117] "RemoveContainer" containerID="b3954a944d3f75f7e93142a9da6e3059898646a2d1700ba370fbd07ce65936dc" Jul 23 18:10:44.389610 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:44.389589 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:44.490263 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:44.490235 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:45.231361 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:45.231334 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ctjdh"] Jul 23 18:10:45.234359 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:45.234343 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ctjdh" Jul 23 18:10:45.237814 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:45.237794 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 23 18:10:45.238046 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:45.238026 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 23 18:10:45.239323 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:45.239271 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 23 18:10:45.239323 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:45.239299 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-k9g92\"" Jul 23 18:10:45.239509 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:45.239305 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 23 18:10:45.255538 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:45.255518 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ctjdh"] Jul 23 18:10:45.278727 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:45.278705 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:45.331929 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:45.331904 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ctjdh\" (UID: \"3e4ebee6-a774-4d34-b9a9-f62dd2ad9336\") " pod="openshift-insights/insights-runtime-extractor-ctjdh" Jul 23 18:10:45.332004 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:45.331939 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzz22\" (UniqueName: \"kubernetes.io/projected/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-kube-api-access-xzz22\") pod \"insights-runtime-extractor-ctjdh\" (UID: \"3e4ebee6-a774-4d34-b9a9-f62dd2ad9336\") " pod="openshift-insights/insights-runtime-extractor-ctjdh" Jul 23 18:10:45.332004 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:45.331972 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-data-volume\") pod \"insights-runtime-extractor-ctjdh\" (UID: \"3e4ebee6-a774-4d34-b9a9-f62dd2ad9336\") " pod="openshift-insights/insights-runtime-extractor-ctjdh" Jul 23 18:10:45.332004 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:45.331989 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctjdh\" (UID: \"3e4ebee6-a774-4d34-b9a9-f62dd2ad9336\") " pod="openshift-insights/insights-runtime-extractor-ctjdh" Jul 23 18:10:45.332120 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:45.332088 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-crio-socket\") pod \"insights-runtime-extractor-ctjdh\" (UID: \"3e4ebee6-a774-4d34-b9a9-f62dd2ad9336\") " pod="openshift-insights/insights-runtime-extractor-ctjdh" Jul 23 18:10:45.363073 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:45.363052 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-plgf8_a7a1d203-b9aa-43b4-8533-188e73336f5a/console-operator/1.log" Jul 23 18:10:45.363431 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:45.363416 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-plgf8_a7a1d203-b9aa-43b4-8533-188e73336f5a/console-operator/0.log" Jul 23 18:10:45.363474 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:45.363452 2575 generic.go:356] "Generic (PLEG): container finished" podID="a7a1d203-b9aa-43b4-8533-188e73336f5a" containerID="8185e500911c127a4bc637a262116849f5766f5060691c56034c500add90e4e4" exitCode=255 Jul 23 18:10:45.363513 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:45.363486 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-plgf8" event={"ID":"a7a1d203-b9aa-43b4-8533-188e73336f5a","Type":"ContainerDied","Data":"8185e500911c127a4bc637a262116849f5766f5060691c56034c500add90e4e4"} Jul 23 18:10:45.363551 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:45.363543 2575 scope.go:117] "RemoveContainer" containerID="b3954a944d3f75f7e93142a9da6e3059898646a2d1700ba370fbd07ce65936dc" Jul 23 18:10:45.363761 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:45.363749 2575 scope.go:117] "RemoveContainer" containerID="8185e500911c127a4bc637a262116849f5766f5060691c56034c500add90e4e4" Jul 23 18:10:45.363953 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:45.363934 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-plgf8_openshift-console-operator(a7a1d203-b9aa-43b4-8533-188e73336f5a)\"" pod="openshift-console-operator/console-operator-565b7b569d-plgf8" podUID="a7a1d203-b9aa-43b4-8533-188e73336f5a" Jul 23 18:10:45.433009 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:45.432990 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-crio-socket\") pod \"insights-runtime-extractor-ctjdh\" (UID: \"3e4ebee6-a774-4d34-b9a9-f62dd2ad9336\") " pod="openshift-insights/insights-runtime-extractor-ctjdh" Jul 23 18:10:45.433103 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:45.433050 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ctjdh\" (UID: \"3e4ebee6-a774-4d34-b9a9-f62dd2ad9336\") " pod="openshift-insights/insights-runtime-extractor-ctjdh" Jul 23 18:10:45.433103 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:45.433101 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 18:10:45.433174 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:45.433125 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-crio-socket\") pod \"insights-runtime-extractor-ctjdh\" (UID: \"3e4ebee6-a774-4d34-b9a9-f62dd2ad9336\") " pod="openshift-insights/insights-runtime-extractor-ctjdh" Jul 23 18:10:45.433174 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:45.433140 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-kube-rbac-proxy-cm podName:3e4ebee6-a774-4d34-b9a9-f62dd2ad9336 nodeName:}" failed. No retries permitted until 2026-07-23 18:10:45.933127945 +0000 UTC m=+267.850717623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ctjdh" (UID: "3e4ebee6-a774-4d34-b9a9-f62dd2ad9336") : configmap "kube-rbac-proxy" not found Jul 23 18:10:45.433280 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:45.433261 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzz22\" (UniqueName: \"kubernetes.io/projected/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-kube-api-access-xzz22\") pod \"insights-runtime-extractor-ctjdh\" (UID: \"3e4ebee6-a774-4d34-b9a9-f62dd2ad9336\") " pod="openshift-insights/insights-runtime-extractor-ctjdh" Jul 23 18:10:45.433339 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:45.433327 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-data-volume\") pod \"insights-runtime-extractor-ctjdh\" (UID: \"3e4ebee6-a774-4d34-b9a9-f62dd2ad9336\") " pod="openshift-insights/insights-runtime-extractor-ctjdh" Jul 23 18:10:45.433372 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:45.433354 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctjdh\" (UID: \"3e4ebee6-a774-4d34-b9a9-f62dd2ad9336\") " pod="openshift-insights/insights-runtime-extractor-ctjdh" Jul 23 18:10:45.433438 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:45.433428 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 18:10:45.433480 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:45.433470 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-insights-runtime-extractor-tls podName:3e4ebee6-a774-4d34-b9a9-f62dd2ad9336 nodeName:}" failed. No retries permitted until 2026-07-23 18:10:45.933456744 +0000 UTC m=+267.851046428 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ctjdh" (UID: "3e4ebee6-a774-4d34-b9a9-f62dd2ad9336") : secret "insights-runtime-extractor-tls" not found Jul 23 18:10:45.433586 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:45.433570 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-data-volume\") pod \"insights-runtime-extractor-ctjdh\" (UID: \"3e4ebee6-a774-4d34-b9a9-f62dd2ad9336\") " pod="openshift-insights/insights-runtime-extractor-ctjdh" Jul 23 18:10:45.441498 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:45.441473 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzz22\" (UniqueName: \"kubernetes.io/projected/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-kube-api-access-xzz22\") pod \"insights-runtime-extractor-ctjdh\" (UID: \"3e4ebee6-a774-4d34-b9a9-f62dd2ad9336\") " pod="openshift-insights/insights-runtime-extractor-ctjdh" Jul 23 18:10:45.533970 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:45.533919 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-metrics-certs\") pod \"router-default-7cd988784b-m9zqk\" (UID: \"c7d035d4-940c-44fb-9486-2f4b1fe4fb70\") " pod="openshift-ingress/router-default-7cd988784b-m9zqk" Jul 23 18:10:45.534040 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:45.533993 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-service-ca-bundle\") pod \"router-default-7cd988784b-m9zqk\" (UID: \"c7d035d4-940c-44fb-9486-2f4b1fe4fb70\") " pod="openshift-ingress/router-default-7cd988784b-m9zqk" Jul 23 18:10:45.534084 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:45.534058 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 23 18:10:45.534117 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:45.534107 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-service-ca-bundle podName:c7d035d4-940c-44fb-9486-2f4b1fe4fb70 nodeName:}" failed. No retries permitted until 2026-07-23 18:10:49.5340933 +0000 UTC m=+271.451682984 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-service-ca-bundle") pod "router-default-7cd988784b-m9zqk" (UID: "c7d035d4-940c-44fb-9486-2f4b1fe4fb70") : configmap references non-existent config key: service-ca.crt Jul 23 18:10:45.534159 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:45.534128 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-metrics-certs podName:c7d035d4-940c-44fb-9486-2f4b1fe4fb70 nodeName:}" failed. No retries permitted until 2026-07-23 18:10:49.534119097 +0000 UTC m=+271.451708781 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-metrics-certs") pod "router-default-7cd988784b-m9zqk" (UID: "c7d035d4-940c-44fb-9486-2f4b1fe4fb70") : secret "router-metrics-certs-default" not found Jul 23 18:10:45.937806 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:45.937774 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ctjdh\" (UID: \"3e4ebee6-a774-4d34-b9a9-f62dd2ad9336\") " pod="openshift-insights/insights-runtime-extractor-ctjdh" Jul 23 18:10:45.937949 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:45.937849 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctjdh\" (UID: \"3e4ebee6-a774-4d34-b9a9-f62dd2ad9336\") " pod="openshift-insights/insights-runtime-extractor-ctjdh" Jul 23 18:10:45.937949 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:45.937904 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 18:10:45.938017 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:45.937963 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-kube-rbac-proxy-cm podName:3e4ebee6-a774-4d34-b9a9-f62dd2ad9336 nodeName:}" failed. No retries permitted until 2026-07-23 18:10:46.937949963 +0000 UTC m=+268.855539641 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ctjdh" (UID: "3e4ebee6-a774-4d34-b9a9-f62dd2ad9336") : configmap "kube-rbac-proxy" not found Jul 23 18:10:45.938017 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:45.937989 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 18:10:45.938086 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:45.938035 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-insights-runtime-extractor-tls podName:3e4ebee6-a774-4d34-b9a9-f62dd2ad9336 nodeName:}" failed. No retries permitted until 2026-07-23 18:10:46.938023707 +0000 UTC m=+268.855613385 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ctjdh" (UID: "3e4ebee6-a774-4d34-b9a9-f62dd2ad9336") : secret "insights-runtime-extractor-tls" not found Jul 23 18:10:46.292301 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:46.292228 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9552s"] Jul 23 18:10:46.296493 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:46.296473 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9552s" Jul 23 18:10:46.298189 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:46.298162 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:46.299354 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:46.299328 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-t7lpk\"" Jul 23 18:10:46.299354 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:46.299348 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 23 18:10:46.299535 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:46.299376 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 23 18:10:46.304813 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:46.304791 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9552s"] Jul 23 18:10:46.340868 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:46.340848 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncs6r\" (UniqueName: \"kubernetes.io/projected/72322ce0-17eb-4779-86ad-ef7ec6819c4c-kube-api-access-ncs6r\") pod \"migrator-7cc9c7ffd7-9552s\" (UID: \"72322ce0-17eb-4779-86ad-ef7ec6819c4c\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9552s" Jul 23 18:10:46.368320 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:46.368296 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-plgf8_a7a1d203-b9aa-43b4-8533-188e73336f5a/console-operator/1.log" Jul 23 18:10:46.368590 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:46.368575 2575 scope.go:117] "RemoveContainer" containerID="8185e500911c127a4bc637a262116849f5766f5060691c56034c500add90e4e4" Jul 23 18:10:46.368751 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:46.368734 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-plgf8_openshift-console-operator(a7a1d203-b9aa-43b4-8533-188e73336f5a)\"" pod="openshift-console-operator/console-operator-565b7b569d-plgf8" podUID="a7a1d203-b9aa-43b4-8533-188e73336f5a" Jul 23 18:10:46.386420 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:46.386401 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:46.441448 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:46.441410 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncs6r\" (UniqueName: \"kubernetes.io/projected/72322ce0-17eb-4779-86ad-ef7ec6819c4c-kube-api-access-ncs6r\") pod \"migrator-7cc9c7ffd7-9552s\" (UID: \"72322ce0-17eb-4779-86ad-ef7ec6819c4c\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9552s" Jul 23 18:10:46.451226 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:46.451206 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncs6r\" (UniqueName: \"kubernetes.io/projected/72322ce0-17eb-4779-86ad-ef7ec6819c4c-kube-api-access-ncs6r\") pod \"migrator-7cc9c7ffd7-9552s\" (UID: \"72322ce0-17eb-4779-86ad-ef7ec6819c4c\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9552s" Jul 23 18:10:46.486960 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:46.486940 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:46.586874 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:46.586825 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:46.606064 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:46.606047 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9552s" Jul 23 18:10:46.648842 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:46.648809 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:46.722208 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:46.722181 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9552s"] Jul 23 18:10:46.725148 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:10:46.725123 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72322ce0_17eb_4779_86ad_ef7ec6819c4c.slice/crio-1425e5e8f972720132667d9cb473ff724fdc557d123761b2e4d0f78c56c7b942 WatchSource:0}: Error finding container 1425e5e8f972720132667d9cb473ff724fdc557d123761b2e4d0f78c56c7b942: Status 404 returned error can't find the container with id 1425e5e8f972720132667d9cb473ff724fdc557d123761b2e4d0f78c56c7b942 Jul 23 18:10:46.945590 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:46.945555 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ctjdh\" (UID: \"3e4ebee6-a774-4d34-b9a9-f62dd2ad9336\") " pod="openshift-insights/insights-runtime-extractor-ctjdh" Jul 23 18:10:46.945752 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:46.945687 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 18:10:46.945752 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:46.945708 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctjdh\" (UID: \"3e4ebee6-a774-4d34-b9a9-f62dd2ad9336\") " pod="openshift-insights/insights-runtime-extractor-ctjdh" Jul 23 18:10:46.945752 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:46.945747 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-kube-rbac-proxy-cm podName:3e4ebee6-a774-4d34-b9a9-f62dd2ad9336 nodeName:}" failed. No retries permitted until 2026-07-23 18:10:48.945730699 +0000 UTC m=+270.863320380 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ctjdh" (UID: "3e4ebee6-a774-4d34-b9a9-f62dd2ad9336") : configmap "kube-rbac-proxy" not found Jul 23 18:10:46.945854 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:46.945797 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 18:10:46.945854 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:46.945841 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-insights-runtime-extractor-tls podName:3e4ebee6-a774-4d34-b9a9-f62dd2ad9336 nodeName:}" failed. No retries permitted until 2026-07-23 18:10:48.945829163 +0000 UTC m=+270.863418841 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ctjdh" (UID: "3e4ebee6-a774-4d34-b9a9-f62dd2ad9336") : secret "insights-runtime-extractor-tls" not found Jul 23 18:10:47.036173 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:47.036153 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l4hls_81fdcc97-775f-49ca-bdea-b6ce801091bc/dns-node-resolver/0.log" Jul 23 18:10:47.070061 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:47.070033 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:47.158222 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:47.158203 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:47.376308 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:47.376276 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9552s" event={"ID":"72322ce0-17eb-4779-86ad-ef7ec6819c4c","Type":"ContainerStarted","Data":"1425e5e8f972720132667d9cb473ff724fdc557d123761b2e4d0f78c56c7b942"} Jul 23 18:10:48.023511 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:48.023484 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-29thx_82dbe848-f82c-4ff9-a7cc-7c97ee5e37c9/node-ca/0.log" Jul 23 18:10:48.731924 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:48.731864 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:48.781886 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:48.781861 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:48.961945 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:48.961921 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ctjdh\" (UID: \"3e4ebee6-a774-4d34-b9a9-f62dd2ad9336\") " pod="openshift-insights/insights-runtime-extractor-ctjdh" Jul 23 18:10:48.962047 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:48.961978 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctjdh\" (UID: \"3e4ebee6-a774-4d34-b9a9-f62dd2ad9336\") " pod="openshift-insights/insights-runtime-extractor-ctjdh" Jul 23 18:10:48.962083 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:48.962041 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 18:10:48.962112 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:48.962083 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 18:10:48.962165 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:48.962143 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-kube-rbac-proxy-cm podName:3e4ebee6-a774-4d34-b9a9-f62dd2ad9336 nodeName:}" failed. No retries permitted until 2026-07-23 18:10:52.962128814 +0000 UTC m=+274.879718491 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ctjdh" (UID: "3e4ebee6-a774-4d34-b9a9-f62dd2ad9336") : configmap "kube-rbac-proxy" not found Jul 23 18:10:48.962221 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:48.962183 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-insights-runtime-extractor-tls podName:3e4ebee6-a774-4d34-b9a9-f62dd2ad9336 nodeName:}" failed. No retries permitted until 2026-07-23 18:10:52.962160795 +0000 UTC m=+274.879750483 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ctjdh" (UID: "3e4ebee6-a774-4d34-b9a9-f62dd2ad9336") : secret "insights-runtime-extractor-tls" not found Jul 23 18:10:49.228062 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:49.228040 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-q5hj8_9fe94bdd-cbb4-479a-896f-a221bc54a40c/serve-healthcheck-canary/0.log" Jul 23 18:10:49.383187 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:49.383163 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9552s" event={"ID":"72322ce0-17eb-4779-86ad-ef7ec6819c4c","Type":"ContainerStarted","Data":"956cc8906e822a55d493bc9fb8d468be6787e4a08fcac08a1f5cea29c323d3dc"} Jul 23 18:10:49.383303 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:49.383211 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9552s" event={"ID":"72322ce0-17eb-4779-86ad-ef7ec6819c4c","Type":"ContainerStarted","Data":"aa323d8d6a107002de7c3f7fbfd5d5901c8114d55f39953a72e9c23d4467af1b"} Jul 23 18:10:49.401410 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:49.401365 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-9552s" podStartSLOduration=1.718557399 podStartE2EDuration="3.401353363s" totalImagesPullingTime="1.682795964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:10:49.401056837 +0000 UTC m=+271.318646537" watchObservedRunningTime="2026-07-23 18:10:49.401353363 +0000 UTC m=+271.318943063" Jul 23 18:10:49.516566 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:49.516517 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:49.567254 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:49.567226 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-metrics-certs\") pod \"router-default-7cd988784b-m9zqk\" (UID: \"c7d035d4-940c-44fb-9486-2f4b1fe4fb70\") " pod="openshift-ingress/router-default-7cd988784b-m9zqk" Jul 23 18:10:49.567367 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:49.567351 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 23 18:10:49.567428 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:49.567397 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-service-ca-bundle\") pod \"router-default-7cd988784b-m9zqk\" (UID: \"c7d035d4-940c-44fb-9486-2f4b1fe4fb70\") " pod="openshift-ingress/router-default-7cd988784b-m9zqk" Jul 23 18:10:49.567428 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:49.567409 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-metrics-certs podName:c7d035d4-940c-44fb-9486-2f4b1fe4fb70 nodeName:}" failed. No retries permitted until 2026-07-23 18:10:57.567394353 +0000 UTC m=+279.484984042 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-metrics-certs") pod "router-default-7cd988784b-m9zqk" (UID: "c7d035d4-940c-44fb-9486-2f4b1fe4fb70") : secret "router-metrics-certs-default" not found Jul 23 18:10:49.567539 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:49.567503 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-service-ca-bundle podName:c7d035d4-940c-44fb-9486-2f4b1fe4fb70 nodeName:}" failed. No retries permitted until 2026-07-23 18:10:57.567488324 +0000 UTC m=+279.485078026 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-service-ca-bundle") pod "router-default-7cd988784b-m9zqk" (UID: "c7d035d4-940c-44fb-9486-2f4b1fe4fb70") : configmap references non-existent config key: service-ca.crt Jul 23 18:10:49.916989 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:49.916957 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:50.059811 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:50.059783 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:50.243829 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:50.243760 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:50.343085 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:50.343058 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:50.460234 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:50.460216 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:50.613358 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:50.613338 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:51.218061 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:51.218026 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:51.600523 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:51.600451 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:52.005162 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:52.005131 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:52.097374 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:52.097350 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-plgf8" Jul 23 18:10:52.097488 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:52.097398 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-plgf8" Jul 23 18:10:52.097712 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:52.097700 2575 scope.go:117] "RemoveContainer" containerID="8185e500911c127a4bc637a262116849f5766f5060691c56034c500add90e4e4" Jul 23 18:10:52.097849 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:52.097831 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-plgf8_openshift-console-operator(a7a1d203-b9aa-43b4-8533-188e73336f5a)\"" pod="openshift-console-operator/console-operator-565b7b569d-plgf8" podUID="a7a1d203-b9aa-43b4-8533-188e73336f5a" Jul 23 18:10:52.415243 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:52.415218 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:52.476043 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:52.476020 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:52.994037 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:52.994010 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctjdh\" (UID: \"3e4ebee6-a774-4d34-b9a9-f62dd2ad9336\") " pod="openshift-insights/insights-runtime-extractor-ctjdh" Jul 23 18:10:52.994224 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:52.994080 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ctjdh\" (UID: \"3e4ebee6-a774-4d34-b9a9-f62dd2ad9336\") " pod="openshift-insights/insights-runtime-extractor-ctjdh" Jul 23 18:10:52.994224 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:52.994146 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 23 18:10:52.994224 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:52.994162 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 23 18:10:52.994224 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:52.994204 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-insights-runtime-extractor-tls podName:3e4ebee6-a774-4d34-b9a9-f62dd2ad9336 nodeName:}" failed. No retries permitted until 2026-07-23 18:11:00.994188821 +0000 UTC m=+282.911778498 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-insights-runtime-extractor-tls") pod "insights-runtime-extractor-ctjdh" (UID: "3e4ebee6-a774-4d34-b9a9-f62dd2ad9336") : secret "insights-runtime-extractor-tls" not found Jul 23 18:10:52.994224 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:10:52.994218 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-kube-rbac-proxy-cm podName:3e4ebee6-a774-4d34-b9a9-f62dd2ad9336 nodeName:}" failed. No retries permitted until 2026-07-23 18:11:00.994211246 +0000 UTC m=+282.911800925 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-kube-rbac-proxy-cm") pod "insights-runtime-extractor-ctjdh" (UID: "3e4ebee6-a774-4d34-b9a9-f62dd2ad9336") : configmap "kube-rbac-proxy" not found Jul 23 18:10:53.014374 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:53.014343 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:53.399520 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:53.399482 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:53.810949 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:53.810881 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:53.869531 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:53.869500 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:54.012502 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:54.012479 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:54.404282 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:54.404257 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:55.016779 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:55.016746 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:55.600152 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:55.600120 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:55.806783 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:55.806748 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:55.883594 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:55.883569 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:56.002187 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:56.002159 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:56.203981 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:56.203916 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:56.438817 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:56.438791 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:57.002264 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:57.002233 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:57.408692 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:57.408649 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:57.631888 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:57.631854 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-service-ca-bundle\") pod \"router-default-7cd988784b-m9zqk\" (UID: \"c7d035d4-940c-44fb-9486-2f4b1fe4fb70\") " pod="openshift-ingress/router-default-7cd988784b-m9zqk" Jul 23 18:10:57.632010 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:57.631921 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-metrics-certs\") pod \"router-default-7cd988784b-m9zqk\" (UID: \"c7d035d4-940c-44fb-9486-2f4b1fe4fb70\") " pod="openshift-ingress/router-default-7cd988784b-m9zqk" Jul 23 18:10:57.632419 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:57.632393 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-service-ca-bundle\") pod \"router-default-7cd988784b-m9zqk\" (UID: \"c7d035d4-940c-44fb-9486-2f4b1fe4fb70\") " pod="openshift-ingress/router-default-7cd988784b-m9zqk" Jul 23 18:10:57.634197 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:57.634177 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7d035d4-940c-44fb-9486-2f4b1fe4fb70-metrics-certs\") pod \"router-default-7cd988784b-m9zqk\" (UID: \"c7d035d4-940c-44fb-9486-2f4b1fe4fb70\") " pod="openshift-ingress/router-default-7cd988784b-m9zqk" Jul 23 18:10:57.702956 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:57.702910 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7cd988784b-m9zqk" Jul 23 18:10:57.809608 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:57.809582 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:57.834218 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:57.834194 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7cd988784b-m9zqk"] Jul 23 18:10:57.836850 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:10:57.836825 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7d035d4_940c_44fb_9486_2f4b1fe4fb70.slice/crio-66db0fe75228a48a5ed4aa279fe66e89d94ce82b2b56e0454c7e6ad9baee1d29 WatchSource:0}: Error finding container 66db0fe75228a48a5ed4aa279fe66e89d94ce82b2b56e0454c7e6ad9baee1d29: Status 404 returned error can't find the container with id 66db0fe75228a48a5ed4aa279fe66e89d94ce82b2b56e0454c7e6ad9baee1d29 Jul 23 18:10:58.007671 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:58.007604 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:58.405498 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:58.405472 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:58.411234 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:58.411208 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7cd988784b-m9zqk" event={"ID":"c7d035d4-940c-44fb-9486-2f4b1fe4fb70","Type":"ContainerStarted","Data":"885bf5f3916c4243b990af451fcb59f57ffa498497ad4c597d62a437a1d4ac3a"} Jul 23 18:10:58.411536 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:58.411261 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7cd988784b-m9zqk" event={"ID":"c7d035d4-940c-44fb-9486-2f4b1fe4fb70","Type":"ContainerStarted","Data":"66db0fe75228a48a5ed4aa279fe66e89d94ce82b2b56e0454c7e6ad9baee1d29"} Jul 23 18:10:58.433928 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:58.433891 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7cd988784b-m9zqk" podStartSLOduration=17.433878243 podStartE2EDuration="17.433878243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:10:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:10:58.433331777 +0000 UTC m=+280.350921477" watchObservedRunningTime="2026-07-23 18:10:58.433878243 +0000 UTC m=+280.351467942" Jul 23 18:10:58.465247 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:58.465229 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:58.703369 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:58.703287 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7cd988784b-m9zqk" Jul 23 18:10:58.706026 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:58.706004 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7cd988784b-m9zqk" Jul 23 18:10:59.006384 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:59.006305 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:59.410253 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:59.410223 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:10:59.414385 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:59.414358 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7cd988784b-m9zqk" Jul 23 18:10:59.415504 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:59.415485 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7cd988784b-m9zqk" Jul 23 18:10:59.803241 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:10:59.803169 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:00.003316 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:00.003279 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:00.093656 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:11:00.093589 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dsjsx" podUID="720bc518-628e-4cc4-a1cb-b626cfad39dc" Jul 23 18:11:00.093656 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:11:00.093603 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6qdgb" podUID="98381009-83a2-4c5c-9e31-267ab47e7edc" Jul 23 18:11:00.093803 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:11:00.093725 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" podUID="dffca2c1-6cb2-46ec-9842-5c20982d1581" Jul 23 18:11:00.408821 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:00.408790 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:00.416831 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:00.416801 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6qdgb" Jul 23 18:11:00.416831 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:00.416820 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dsjsx" Jul 23 18:11:00.417202 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:00.416806 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:11:00.508991 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:00.508966 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:00.609688 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:00.609649 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:00.709479 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:00.709415 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:01.002437 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:01.002346 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:01.059844 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:01.059817 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctjdh\" (UID: \"3e4ebee6-a774-4d34-b9a9-f62dd2ad9336\") " pod="openshift-insights/insights-runtime-extractor-ctjdh" Jul 23 18:11:01.059972 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:01.059885 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ctjdh\" (UID: \"3e4ebee6-a774-4d34-b9a9-f62dd2ad9336\") " pod="openshift-insights/insights-runtime-extractor-ctjdh" Jul 23 18:11:01.060359 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:01.060342 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ctjdh\" (UID: \"3e4ebee6-a774-4d34-b9a9-f62dd2ad9336\") " pod="openshift-insights/insights-runtime-extractor-ctjdh" Jul 23 18:11:01.062222 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:01.062196 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3e4ebee6-a774-4d34-b9a9-f62dd2ad9336-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ctjdh\" (UID: \"3e4ebee6-a774-4d34-b9a9-f62dd2ad9336\") " pod="openshift-insights/insights-runtime-extractor-ctjdh" Jul 23 18:11:01.143308 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:01.143283 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ctjdh" Jul 23 18:11:01.269037 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:01.268963 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ctjdh"] Jul 23 18:11:01.271740 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:11:01.271707 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e4ebee6_a774_4d34_b9a9_f62dd2ad9336.slice/crio-a7712624623183618f512919b3555926aa58bbe7b51ea3ccef78ffe17ff5a987 WatchSource:0}: Error finding container a7712624623183618f512919b3555926aa58bbe7b51ea3ccef78ffe17ff5a987: Status 404 returned error can't find the container with id a7712624623183618f512919b3555926aa58bbe7b51ea3ccef78ffe17ff5a987 Jul 23 18:11:01.420116 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:01.420076 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ctjdh" event={"ID":"3e4ebee6-a774-4d34-b9a9-f62dd2ad9336","Type":"ContainerStarted","Data":"a7712624623183618f512919b3555926aa58bbe7b51ea3ccef78ffe17ff5a987"} Jul 23 18:11:03.985631 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:03.985596 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/720bc518-628e-4cc4-a1cb-b626cfad39dc-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dsjsx\" (UID: \"720bc518-628e-4cc4-a1cb-b626cfad39dc\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dsjsx" Jul 23 18:11:03.986196 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:03.985688 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-tls\") pod \"image-registry-7fcff6cc5-fwvfb\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:11:03.986196 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:03.985726 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/98381009-83a2-4c5c-9e31-267ab47e7edc-metrics-tls\") pod \"dns-default-6qdgb\" (UID: \"98381009-83a2-4c5c-9e31-267ab47e7edc\") " pod="openshift-dns/dns-default-6qdgb" Jul 23 18:11:03.988523 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:03.988496 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-tls\") pod \"image-registry-7fcff6cc5-fwvfb\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:11:03.988902 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:03.988869 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/98381009-83a2-4c5c-9e31-267ab47e7edc-metrics-tls\") pod \"dns-default-6qdgb\" (UID: \"98381009-83a2-4c5c-9e31-267ab47e7edc\") " pod="openshift-dns/dns-default-6qdgb" Jul 23 18:11:03.989016 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:03.988997 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/720bc518-628e-4cc4-a1cb-b626cfad39dc-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-dsjsx\" (UID: \"720bc518-628e-4cc4-a1cb-b626cfad39dc\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dsjsx" Jul 23 18:11:04.024999 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:04.024961 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-75dl5\"" Jul 23 18:11:04.025134 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:04.025025 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qzjmk\"" Jul 23 18:11:04.025134 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:04.025057 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6k4rc\"" Jul 23 18:11:04.028327 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:04.028309 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dsjsx" Jul 23 18:11:04.028455 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:04.028404 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:11:04.028455 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:04.028442 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6qdgb" Jul 23 18:11:05.838464 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:05.838425 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:05.908944 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:05.908913 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:06.235480 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:06.235455 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6qdgb"] Jul 23 18:11:06.238216 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:11:06.238177 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98381009_83a2_4c5c_9e31_267ab47e7edc.slice/crio-4cda9a53e00d6adc4c9c7f0e611ca676278197766863ef5294d84b14a8adefdf WatchSource:0}: Error finding container 4cda9a53e00d6adc4c9c7f0e611ca676278197766863ef5294d84b14a8adefdf: Status 404 returned error can't find the container with id 4cda9a53e00d6adc4c9c7f0e611ca676278197766863ef5294d84b14a8adefdf Jul 23 18:11:06.438233 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:06.438202 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ctjdh" event={"ID":"3e4ebee6-a774-4d34-b9a9-f62dd2ad9336","Type":"ContainerStarted","Data":"775dc4b60e9a7068eaefa8c7b36aee0354b61639567e9cde0ca51e873eef66da"} Jul 23 18:11:06.439433 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:06.439406 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6qdgb" event={"ID":"98381009-83a2-4c5c-9e31-267ab47e7edc","Type":"ContainerStarted","Data":"4cda9a53e00d6adc4c9c7f0e611ca676278197766863ef5294d84b14a8adefdf"} Jul 23 18:11:06.461185 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:06.461166 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-dsjsx"] Jul 23 18:11:06.463314 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:11:06.463295 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod720bc518_628e_4cc4_a1cb_b626cfad39dc.slice/crio-182fed14321f7714117d00688b49789c106a648f47433de729ca1bcf6e8c3db0 WatchSource:0}: Error finding container 182fed14321f7714117d00688b49789c106a648f47433de729ca1bcf6e8c3db0: Status 404 returned error can't find the container with id 182fed14321f7714117d00688b49789c106a648f47433de729ca1bcf6e8c3db0 Jul 23 18:11:06.467837 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:06.467805 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7fcff6cc5-fwvfb"] Jul 23 18:11:06.470032 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:11:06.470009 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddffca2c1_6cb2_46ec_9842_5c20982d1581.slice/crio-03029843782a4bf4b31984437c61f6e677d0b95e25674786464d34a6e8496a8e WatchSource:0}: Error finding container 03029843782a4bf4b31984437c61f6e677d0b95e25674786464d34a6e8496a8e: Status 404 returned error can't find the container with id 03029843782a4bf4b31984437c61f6e677d0b95e25674786464d34a6e8496a8e Jul 23 18:11:07.446841 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:07.446801 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" event={"ID":"dffca2c1-6cb2-46ec-9842-5c20982d1581","Type":"ContainerStarted","Data":"247c154cdbac79d039055148853d16d704554e4fee4b32a0419624d6577996cf"} Jul 23 18:11:07.447274 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:07.446864 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" event={"ID":"dffca2c1-6cb2-46ec-9842-5c20982d1581","Type":"ContainerStarted","Data":"03029843782a4bf4b31984437c61f6e677d0b95e25674786464d34a6e8496a8e"} Jul 23 18:11:07.447274 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:07.446918 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:11:07.448791 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:07.448722 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dsjsx" event={"ID":"720bc518-628e-4cc4-a1cb-b626cfad39dc","Type":"ContainerStarted","Data":"182fed14321f7714117d00688b49789c106a648f47433de729ca1bcf6e8c3db0"} Jul 23 18:11:07.470600 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:07.470547 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" podStartSLOduration=266.470526814 podStartE2EDuration="4m26.470526814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:06:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:11:07.468736116 +0000 UTC m=+289.386325839" watchObservedRunningTime="2026-07-23 18:11:07.470526814 +0000 UTC m=+289.388116518" Jul 23 18:11:07.615703 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:07.615560 2575 scope.go:117] "RemoveContainer" containerID="8185e500911c127a4bc637a262116849f5766f5060691c56034c500add90e4e4" Jul 23 18:11:08.458649 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:08.458564 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-plgf8_a7a1d203-b9aa-43b4-8533-188e73336f5a/console-operator/1.log" Jul 23 18:11:08.459129 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:08.458768 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-plgf8" event={"ID":"a7a1d203-b9aa-43b4-8533-188e73336f5a","Type":"ContainerStarted","Data":"a13ccc80b281614777947e63b611dee87433f4d7d587485851f7cc36e6fa8393"} Jul 23 18:11:08.459231 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:08.459206 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-plgf8" Jul 23 18:11:08.464810 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:08.464789 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-plgf8" Jul 23 18:11:08.472256 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:08.472229 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:08.479208 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:08.479104 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-plgf8" podStartSLOduration=25.535170976 podStartE2EDuration="27.479054428s" totalImagesPullingTime="1.943883452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:10:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:11:08.477936555 +0000 UTC m=+290.395526287" watchObservedRunningTime="2026-07-23 18:11:08.479054428 +0000 UTC m=+290.396644129" Jul 23 18:11:08.573113 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:08.573026 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:08.638008 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:08.637975 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:08.765864 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:08.765792 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:09.146837 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:09.146801 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:09.215077 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:09.215041 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:09.645938 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:09.645908 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:09.770147 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:09.768994 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zl4fr"] Jul 23 18:11:09.778551 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:09.778441 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:09.787829 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:09.787798 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zl4fr" Jul 23 18:11:09.789706 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:09.789423 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-lk8q6"] Jul 23 18:11:09.794950 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:09.794925 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-lk8q6" Jul 23 18:11:09.806075 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:09.806051 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zl4fr"] Jul 23 18:11:09.816344 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:09.816322 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-lk8q6"] Jul 23 18:11:09.820056 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:09.820033 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 23 18:11:09.820423 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:09.820370 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 23 18:11:09.820527 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:09.820499 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-jdbvn\"" Jul 23 18:11:09.821166 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:09.821077 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 23 18:11:09.821166 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:09.821089 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-cxvr5\"" Jul 23 18:11:09.945065 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:09.945036 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq7rl\" (UniqueName: \"kubernetes.io/projected/f4b1d517-c159-4ef3-aeec-f25cba7cc5fb-kube-api-access-vq7rl\") pod \"downloads-5bc67dcd46-lk8q6\" (UID: \"f4b1d517-c159-4ef3-aeec-f25cba7cc5fb\") " pod="openshift-console/downloads-5bc67dcd46-lk8q6" Jul 23 18:11:09.945065 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:09.945067 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b58eaec7-0aaa-484a-bd01-12d48cbec132-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-zl4fr\" (UID: \"b58eaec7-0aaa-484a-bd01-12d48cbec132\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zl4fr" Jul 23 18:11:09.946927 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:09.946892 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:10.046294 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:10.046217 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq7rl\" (UniqueName: \"kubernetes.io/projected/f4b1d517-c159-4ef3-aeec-f25cba7cc5fb-kube-api-access-vq7rl\") pod \"downloads-5bc67dcd46-lk8q6\" (UID: \"f4b1d517-c159-4ef3-aeec-f25cba7cc5fb\") " pod="openshift-console/downloads-5bc67dcd46-lk8q6" Jul 23 18:11:10.046294 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:10.046273 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b58eaec7-0aaa-484a-bd01-12d48cbec132-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-zl4fr\" (UID: \"b58eaec7-0aaa-484a-bd01-12d48cbec132\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zl4fr" Jul 23 18:11:10.049200 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:10.049152 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b58eaec7-0aaa-484a-bd01-12d48cbec132-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-zl4fr\" (UID: \"b58eaec7-0aaa-484a-bd01-12d48cbec132\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zl4fr" Jul 23 18:11:10.049921 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:10.049894 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:10.058554 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:10.058528 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq7rl\" (UniqueName: \"kubernetes.io/projected/f4b1d517-c159-4ef3-aeec-f25cba7cc5fb-kube-api-access-vq7rl\") pod \"downloads-5bc67dcd46-lk8q6\" (UID: \"f4b1d517-c159-4ef3-aeec-f25cba7cc5fb\") " pod="openshift-console/downloads-5bc67dcd46-lk8q6" Jul 23 18:11:10.101346 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:10.101319 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zl4fr" Jul 23 18:11:10.107457 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:10.107430 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-lk8q6" Jul 23 18:11:10.168358 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:10.168322 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:10.267424 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:10.267382 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:10.367080 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:10.367051 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:10.466351 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:10.466325 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ctjdh" event={"ID":"3e4ebee6-a774-4d34-b9a9-f62dd2ad9336","Type":"ContainerStarted","Data":"795d758fe76ac5c9d672e12d9890d7d9eb78fdc1429b65daf3b91fefe9d6a1b2"} Jul 23 18:11:10.467661 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:10.467639 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6qdgb" event={"ID":"98381009-83a2-4c5c-9e31-267ab47e7edc","Type":"ContainerStarted","Data":"1bf114f14f4f548fdfc3034d4b3474bf4a4f61fe52a4c8e879ba34d65de57bd8"} Jul 23 18:11:10.468939 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:10.468915 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dsjsx" event={"ID":"720bc518-628e-4cc4-a1cb-b626cfad39dc","Type":"ContainerStarted","Data":"effab3be1362525cc522093ca545b00dedc55dde203def4c6ab77305e8bce69b"} Jul 23 18:11:10.489840 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:10.489799 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-dsjsx" podStartSLOduration=288.214822438 podStartE2EDuration="4m49.489784137s" totalImagesPullingTime="1.274961699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:06:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:11:10.488631496 +0000 UTC m=+292.406221232" watchObservedRunningTime="2026-07-23 18:11:10.489784137 +0000 UTC m=+292.407373837" Jul 23 18:11:10.591781 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:10.591703 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:10.609322 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:10.609299 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zl4fr"] Jul 23 18:11:10.611945 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:10.611924 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-lk8q6"] Jul 23 18:11:10.612375 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:11:10.612338 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb58eaec7_0aaa_484a_bd01_12d48cbec132.slice/crio-38213e921384c2c2966f107146127868d18e02ac38152f506005ebde40343440 WatchSource:0}: Error finding container 38213e921384c2c2966f107146127868d18e02ac38152f506005ebde40343440: Status 404 returned error can't find the container with id 38213e921384c2c2966f107146127868d18e02ac38152f506005ebde40343440 Jul 23 18:11:10.617059 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:11:10.617035 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4b1d517_c159_4ef3_aeec_f25cba7cc5fb.slice/crio-025f978889cdccc818d0b833423b0e9878e4d3f3397348d3fbd1eb8a31297935 WatchSource:0}: Error finding container 025f978889cdccc818d0b833423b0e9878e4d3f3397348d3fbd1eb8a31297935: Status 404 returned error can't find the container with id 025f978889cdccc818d0b833423b0e9878e4d3f3397348d3fbd1eb8a31297935 Jul 23 18:11:10.692212 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:10.692177 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:11.475657 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:11.475621 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6qdgb" event={"ID":"98381009-83a2-4c5c-9e31-267ab47e7edc","Type":"ContainerStarted","Data":"b79e7c55a2f4003d342b97ed3d1344727279ffbaece64f4bd9a39cbe435dc7ac"} Jul 23 18:11:11.476445 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:11.476392 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6qdgb" Jul 23 18:11:11.478026 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:11.478000 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-lk8q6" event={"ID":"f4b1d517-c159-4ef3-aeec-f25cba7cc5fb","Type":"ContainerStarted","Data":"025f978889cdccc818d0b833423b0e9878e4d3f3397348d3fbd1eb8a31297935"} Jul 23 18:11:11.479464 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:11.479439 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zl4fr" event={"ID":"b58eaec7-0aaa-484a-bd01-12d48cbec132","Type":"ContainerStarted","Data":"38213e921384c2c2966f107146127868d18e02ac38152f506005ebde40343440"} Jul 23 18:11:11.497345 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:11.497026 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6qdgb" podStartSLOduration=254.492217298 podStartE2EDuration="4m18.497007569s" totalImagesPullingTime="4.004790271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:11:11.496550108 +0000 UTC m=+293.414139849" watchObservedRunningTime="2026-07-23 18:11:11.497007569 +0000 UTC m=+293.414597270" Jul 23 18:11:11.976466 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:11.976346 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:12.486548 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:12.486435 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zl4fr" event={"ID":"b58eaec7-0aaa-484a-bd01-12d48cbec132","Type":"ContainerStarted","Data":"44e5e9eda896a1d7530b6f0291c881ff235b2a80f5f17e7069c7b63e639140ec"} Jul 23 18:11:13.491187 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:13.491151 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zl4fr" Jul 23 18:11:13.497144 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:13.497117 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zl4fr" Jul 23 18:11:13.514194 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:13.514144 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-zl4fr" podStartSLOduration=3.403955871 podStartE2EDuration="4.514123961s" totalImagesPullingTime="1.11016809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:11:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:11:12.501653913 +0000 UTC m=+294.419243612" watchObservedRunningTime="2026-07-23 18:11:13.514123961 +0000 UTC m=+295.431713664" Jul 23 18:11:13.615319 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:11:13.615259 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-rpldf" podUID="0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b" Jul 23 18:11:13.662580 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:13.662544 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:13.735149 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:13.735113 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:13.959009 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:13.958978 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:14.496239 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:14.496212 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ctjdh" event={"ID":"3e4ebee6-a774-4d34-b9a9-f62dd2ad9336","Type":"ContainerStarted","Data":"cbd2240dfdfda9cfd21e4b12b57181aea1d66b2394f4cdece0c9cf48302012ff"} Jul 23 18:11:14.516788 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:14.516746 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ctjdh" podStartSLOduration=16.526276582 podStartE2EDuration="29.516731723s" totalImagesPullingTime="12.990455141s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:10:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:11:14.51538565 +0000 UTC m=+296.432975351" watchObservedRunningTime="2026-07-23 18:11:14.516731723 +0000 UTC m=+296.434321422" Jul 23 18:11:15.639312 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:15.639282 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:17.806752 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:17.806720 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:17.932133 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:17.932097 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:18.034872 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.034832 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:18.054262 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.054236 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-r9r58"] Jul 23 18:11:18.057777 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.057723 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-r9r58" Jul 23 18:11:18.062241 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.062211 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 23 18:11:18.062356 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.062206 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 23 18:11:18.062762 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.062733 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 23 18:11:18.064472 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.063501 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-f58hx\"" Jul 23 18:11:18.064472 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.063649 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 23 18:11:18.064472 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.064088 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 23 18:11:18.070760 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.070728 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-r9r58"] Jul 23 18:11:18.096411 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.096387 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bzzvl"] Jul 23 18:11:18.099651 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.099632 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bzzvl" Jul 23 18:11:18.102207 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.102186 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 23 18:11:18.102315 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.102259 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 23 18:11:18.102618 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.102602 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 23 18:11:18.102720 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.102704 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fkd8l\"" Jul 23 18:11:18.129056 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.129031 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:18.192425 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.192384 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:18.216548 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.216519 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49cf608f-3e57-43b4-8423-8648f976b919-sys\") pod \"node-exporter-bzzvl\" (UID: \"49cf608f-3e57-43b4-8423-8648f976b919\") " pod="openshift-monitoring/node-exporter-bzzvl" Jul 23 18:11:18.216731 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.216562 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/49cf608f-3e57-43b4-8423-8648f976b919-root\") pod \"node-exporter-bzzvl\" (UID: \"49cf608f-3e57-43b4-8423-8648f976b919\") " pod="openshift-monitoring/node-exporter-bzzvl" Jul 23 18:11:18.216731 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.216622 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49cf608f-3e57-43b4-8423-8648f976b919-metrics-client-ca\") pod \"node-exporter-bzzvl\" (UID: \"49cf608f-3e57-43b4-8423-8648f976b919\") " pod="openshift-monitoring/node-exporter-bzzvl" Jul 23 18:11:18.216731 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.216656 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c410a776-1a1e-4616-8e41-ab4ee03b4d64-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-r9r58\" (UID: \"c410a776-1a1e-4616-8e41-ab4ee03b4d64\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-r9r58" Jul 23 18:11:18.216731 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.216714 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tb24l\" (UniqueName: \"kubernetes.io/projected/c410a776-1a1e-4616-8e41-ab4ee03b4d64-kube-api-access-tb24l\") pod \"openshift-state-metrics-79f6958cdf-r9r58\" (UID: \"c410a776-1a1e-4616-8e41-ab4ee03b4d64\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-r9r58" Jul 23 18:11:18.216948 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.216741 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/49cf608f-3e57-43b4-8423-8648f976b919-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bzzvl\" (UID: \"49cf608f-3e57-43b4-8423-8648f976b919\") " pod="openshift-monitoring/node-exporter-bzzvl" Jul 23 18:11:18.216948 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.216789 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/49cf608f-3e57-43b4-8423-8648f976b919-node-exporter-wtmp\") pod \"node-exporter-bzzvl\" (UID: \"49cf608f-3e57-43b4-8423-8648f976b919\") " pod="openshift-monitoring/node-exporter-bzzvl" Jul 23 18:11:18.216948 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.216824 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c410a776-1a1e-4616-8e41-ab4ee03b4d64-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-r9r58\" (UID: \"c410a776-1a1e-4616-8e41-ab4ee03b4d64\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-r9r58" Jul 23 18:11:18.216948 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.216845 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/49cf608f-3e57-43b4-8423-8648f976b919-node-exporter-tls\") pod \"node-exporter-bzzvl\" (UID: \"49cf608f-3e57-43b4-8423-8648f976b919\") " pod="openshift-monitoring/node-exporter-bzzvl" Jul 23 18:11:18.216948 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.216908 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c410a776-1a1e-4616-8e41-ab4ee03b4d64-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-r9r58\" (UID: \"c410a776-1a1e-4616-8e41-ab4ee03b4d64\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-r9r58" Jul 23 18:11:18.216948 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.216937 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/49cf608f-3e57-43b4-8423-8648f976b919-node-exporter-textfile\") pod \"node-exporter-bzzvl\" (UID: \"49cf608f-3e57-43b4-8423-8648f976b919\") " pod="openshift-monitoring/node-exporter-bzzvl" Jul 23 18:11:18.217146 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.216958 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml6zx\" (UniqueName: \"kubernetes.io/projected/49cf608f-3e57-43b4-8423-8648f976b919-kube-api-access-ml6zx\") pod \"node-exporter-bzzvl\" (UID: \"49cf608f-3e57-43b4-8423-8648f976b919\") " pod="openshift-monitoring/node-exporter-bzzvl" Jul 23 18:11:18.217146 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.216983 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/49cf608f-3e57-43b4-8423-8648f976b919-node-exporter-accelerators-collector-config\") pod \"node-exporter-bzzvl\" (UID: \"49cf608f-3e57-43b4-8423-8648f976b919\") " pod="openshift-monitoring/node-exporter-bzzvl" Jul 23 18:11:18.301837 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.301807 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:18.318014 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.317942 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c410a776-1a1e-4616-8e41-ab4ee03b4d64-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-r9r58\" (UID: \"c410a776-1a1e-4616-8e41-ab4ee03b4d64\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-r9r58" Jul 23 18:11:18.318014 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.317989 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tb24l\" (UniqueName: \"kubernetes.io/projected/c410a776-1a1e-4616-8e41-ab4ee03b4d64-kube-api-access-tb24l\") pod \"openshift-state-metrics-79f6958cdf-r9r58\" (UID: \"c410a776-1a1e-4616-8e41-ab4ee03b4d64\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-r9r58" Jul 23 18:11:18.318201 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.318113 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/49cf608f-3e57-43b4-8423-8648f976b919-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bzzvl\" (UID: \"49cf608f-3e57-43b4-8423-8648f976b919\") " pod="openshift-monitoring/node-exporter-bzzvl" Jul 23 18:11:18.318201 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.318166 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/49cf608f-3e57-43b4-8423-8648f976b919-node-exporter-wtmp\") pod \"node-exporter-bzzvl\" (UID: \"49cf608f-3e57-43b4-8423-8648f976b919\") " pod="openshift-monitoring/node-exporter-bzzvl" Jul 23 18:11:18.318313 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.318207 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c410a776-1a1e-4616-8e41-ab4ee03b4d64-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-r9r58\" (UID: \"c410a776-1a1e-4616-8e41-ab4ee03b4d64\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-r9r58" Jul 23 18:11:18.318313 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.318235 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/49cf608f-3e57-43b4-8423-8648f976b919-node-exporter-tls\") pod \"node-exporter-bzzvl\" (UID: \"49cf608f-3e57-43b4-8423-8648f976b919\") " pod="openshift-monitoring/node-exporter-bzzvl" Jul 23 18:11:18.318313 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.318273 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c410a776-1a1e-4616-8e41-ab4ee03b4d64-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-r9r58\" (UID: \"c410a776-1a1e-4616-8e41-ab4ee03b4d64\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-r9r58" Jul 23 18:11:18.318313 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.318300 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/49cf608f-3e57-43b4-8423-8648f976b919-node-exporter-textfile\") pod \"node-exporter-bzzvl\" (UID: \"49cf608f-3e57-43b4-8423-8648f976b919\") " pod="openshift-monitoring/node-exporter-bzzvl" Jul 23 18:11:18.318508 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.318418 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/49cf608f-3e57-43b4-8423-8648f976b919-node-exporter-wtmp\") pod \"node-exporter-bzzvl\" (UID: \"49cf608f-3e57-43b4-8423-8648f976b919\") " pod="openshift-monitoring/node-exporter-bzzvl" Jul 23 18:11:18.318566 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:11:18.318510 2575 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 23 18:11:18.318566 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.318541 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml6zx\" (UniqueName: \"kubernetes.io/projected/49cf608f-3e57-43b4-8423-8648f976b919-kube-api-access-ml6zx\") pod \"node-exporter-bzzvl\" (UID: \"49cf608f-3e57-43b4-8423-8648f976b919\") " pod="openshift-monitoring/node-exporter-bzzvl" Jul 23 18:11:18.318654 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:11:18.318570 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c410a776-1a1e-4616-8e41-ab4ee03b4d64-openshift-state-metrics-tls podName:c410a776-1a1e-4616-8e41-ab4ee03b4d64 nodeName:}" failed. No retries permitted until 2026-07-23 18:11:18.818550963 +0000 UTC m=+300.736140642 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c410a776-1a1e-4616-8e41-ab4ee03b4d64-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-r9r58" (UID: "c410a776-1a1e-4616-8e41-ab4ee03b4d64") : secret "openshift-state-metrics-tls" not found Jul 23 18:11:18.318654 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.318608 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/49cf608f-3e57-43b4-8423-8648f976b919-node-exporter-textfile\") pod \"node-exporter-bzzvl\" (UID: \"49cf608f-3e57-43b4-8423-8648f976b919\") " pod="openshift-monitoring/node-exporter-bzzvl" Jul 23 18:11:18.318800 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.318714 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/49cf608f-3e57-43b4-8423-8648f976b919-node-exporter-accelerators-collector-config\") pod \"node-exporter-bzzvl\" (UID: \"49cf608f-3e57-43b4-8423-8648f976b919\") " pod="openshift-monitoring/node-exporter-bzzvl" Jul 23 18:11:18.318800 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.318780 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49cf608f-3e57-43b4-8423-8648f976b919-sys\") pod \"node-exporter-bzzvl\" (UID: \"49cf608f-3e57-43b4-8423-8648f976b919\") " pod="openshift-monitoring/node-exporter-bzzvl" Jul 23 18:11:18.318932 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.318839 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/49cf608f-3e57-43b4-8423-8648f976b919-root\") pod \"node-exporter-bzzvl\" (UID: \"49cf608f-3e57-43b4-8423-8648f976b919\") " pod="openshift-monitoring/node-exporter-bzzvl" Jul 23 18:11:18.318932 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.318865 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49cf608f-3e57-43b4-8423-8648f976b919-metrics-client-ca\") pod \"node-exporter-bzzvl\" (UID: \"49cf608f-3e57-43b4-8423-8648f976b919\") " pod="openshift-monitoring/node-exporter-bzzvl" Jul 23 18:11:18.318932 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.318890 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49cf608f-3e57-43b4-8423-8648f976b919-sys\") pod \"node-exporter-bzzvl\" (UID: \"49cf608f-3e57-43b4-8423-8648f976b919\") " pod="openshift-monitoring/node-exporter-bzzvl" Jul 23 18:11:18.319073 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.318947 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/49cf608f-3e57-43b4-8423-8648f976b919-root\") pod \"node-exporter-bzzvl\" (UID: \"49cf608f-3e57-43b4-8423-8648f976b919\") " pod="openshift-monitoring/node-exporter-bzzvl" Jul 23 18:11:18.319073 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.319063 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c410a776-1a1e-4616-8e41-ab4ee03b4d64-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-r9r58\" (UID: \"c410a776-1a1e-4616-8e41-ab4ee03b4d64\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-r9r58" Jul 23 18:11:18.319391 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.319340 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/49cf608f-3e57-43b4-8423-8648f976b919-node-exporter-accelerators-collector-config\") pod \"node-exporter-bzzvl\" (UID: \"49cf608f-3e57-43b4-8423-8648f976b919\") " pod="openshift-monitoring/node-exporter-bzzvl" Jul 23 18:11:18.319514 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.319424 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/49cf608f-3e57-43b4-8423-8648f976b919-metrics-client-ca\") pod \"node-exporter-bzzvl\" (UID: \"49cf608f-3e57-43b4-8423-8648f976b919\") " pod="openshift-monitoring/node-exporter-bzzvl" Jul 23 18:11:18.321123 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.321100 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/49cf608f-3e57-43b4-8423-8648f976b919-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bzzvl\" (UID: \"49cf608f-3e57-43b4-8423-8648f976b919\") " pod="openshift-monitoring/node-exporter-bzzvl" Jul 23 18:11:18.321236 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.321219 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/49cf608f-3e57-43b4-8423-8648f976b919-node-exporter-tls\") pod \"node-exporter-bzzvl\" (UID: \"49cf608f-3e57-43b4-8423-8648f976b919\") " pod="openshift-monitoring/node-exporter-bzzvl" Jul 23 18:11:18.321285 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.321264 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c410a776-1a1e-4616-8e41-ab4ee03b4d64-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-r9r58\" (UID: \"c410a776-1a1e-4616-8e41-ab4ee03b4d64\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-r9r58" Jul 23 18:11:18.329916 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.329889 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tb24l\" (UniqueName: \"kubernetes.io/projected/c410a776-1a1e-4616-8e41-ab4ee03b4d64-kube-api-access-tb24l\") pod \"openshift-state-metrics-79f6958cdf-r9r58\" (UID: \"c410a776-1a1e-4616-8e41-ab4ee03b4d64\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-r9r58" Jul 23 18:11:18.330288 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.330245 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml6zx\" (UniqueName: \"kubernetes.io/projected/49cf608f-3e57-43b4-8423-8648f976b919-kube-api-access-ml6zx\") pod \"node-exporter-bzzvl\" (UID: \"49cf608f-3e57-43b4-8423-8648f976b919\") " pod="openshift-monitoring/node-exporter-bzzvl" Jul 23 18:11:18.403369 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.403342 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:18.411353 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.411331 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bzzvl" Jul 23 18:11:18.424015 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:11:18.423989 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49cf608f_3e57_43b4_8423_8648f976b919.slice/crio-075c054688589698b7d8cd7aabcbd2460c772cac46462ac3b7bdf269f40cab0d WatchSource:0}: Error finding container 075c054688589698b7d8cd7aabcbd2460c772cac46462ac3b7bdf269f40cab0d: Status 404 returned error can't find the container with id 075c054688589698b7d8cd7aabcbd2460c772cac46462ac3b7bdf269f40cab0d Jul 23 18:11:18.465924 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.465894 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:18.511530 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.511496 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bzzvl" event={"ID":"49cf608f-3e57-43b4-8423-8648f976b919","Type":"ContainerStarted","Data":"075c054688589698b7d8cd7aabcbd2460c772cac46462ac3b7bdf269f40cab0d"} Jul 23 18:11:18.514031 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.514008 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-plgf8_a7a1d203-b9aa-43b4-8533-188e73336f5a/console-operator/1.log" Jul 23 18:11:18.514749 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.514731 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-plgf8_a7a1d203-b9aa-43b4-8533-188e73336f5a/console-operator/1.log" Jul 23 18:11:18.526662 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.526642 2575 kubelet.go:1648] "Image garbage collection succeeded" Jul 23 18:11:18.527727 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.527701 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:18.822134 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.821985 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c410a776-1a1e-4616-8e41-ab4ee03b4d64-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-r9r58\" (UID: \"c410a776-1a1e-4616-8e41-ab4ee03b4d64\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-r9r58" Jul 23 18:11:18.851468 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.824319 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c410a776-1a1e-4616-8e41-ab4ee03b4d64-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-r9r58\" (UID: \"c410a776-1a1e-4616-8e41-ab4ee03b4d64\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-r9r58" Jul 23 18:11:18.973908 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.973877 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-f58hx\"" Jul 23 18:11:18.981757 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:18.981733 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-r9r58" Jul 23 18:11:19.007335 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.007306 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f848fd4dd-xs5bx"] Jul 23 18:11:19.012875 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.012449 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f848fd4dd-xs5bx" Jul 23 18:11:19.016717 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.016694 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vnkxw\"" Jul 23 18:11:19.017079 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.017057 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 23 18:11:19.017166 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.017095 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 23 18:11:19.017166 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.017067 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 23 18:11:19.017904 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.017878 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 23 18:11:19.018022 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.017975 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 23 18:11:19.045113 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.045082 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f848fd4dd-xs5bx"] Jul 23 18:11:19.125801 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.125764 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c56428ef-8b94-472c-adbc-b935258966c6-service-ca\") pod \"console-7f848fd4dd-xs5bx\" (UID: \"c56428ef-8b94-472c-adbc-b935258966c6\") " pod="openshift-console/console-7f848fd4dd-xs5bx" Jul 23 18:11:19.125955 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.125875 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c56428ef-8b94-472c-adbc-b935258966c6-console-serving-cert\") pod \"console-7f848fd4dd-xs5bx\" (UID: \"c56428ef-8b94-472c-adbc-b935258966c6\") " pod="openshift-console/console-7f848fd4dd-xs5bx" Jul 23 18:11:19.125955 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.125922 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c56428ef-8b94-472c-adbc-b935258966c6-console-oauth-config\") pod \"console-7f848fd4dd-xs5bx\" (UID: \"c56428ef-8b94-472c-adbc-b935258966c6\") " pod="openshift-console/console-7f848fd4dd-xs5bx" Jul 23 18:11:19.126065 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.125953 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c56428ef-8b94-472c-adbc-b935258966c6-oauth-serving-cert\") pod \"console-7f848fd4dd-xs5bx\" (UID: \"c56428ef-8b94-472c-adbc-b935258966c6\") " pod="openshift-console/console-7f848fd4dd-xs5bx" Jul 23 18:11:19.126118 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.126096 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c56428ef-8b94-472c-adbc-b935258966c6-console-config\") pod \"console-7f848fd4dd-xs5bx\" (UID: \"c56428ef-8b94-472c-adbc-b935258966c6\") " pod="openshift-console/console-7f848fd4dd-xs5bx" Jul 23 18:11:19.126176 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.126142 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjnth\" (UniqueName: \"kubernetes.io/projected/c56428ef-8b94-472c-adbc-b935258966c6-kube-api-access-wjnth\") pod \"console-7f848fd4dd-xs5bx\" (UID: \"c56428ef-8b94-472c-adbc-b935258966c6\") " pod="openshift-console/console-7f848fd4dd-xs5bx" Jul 23 18:11:19.131599 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.131575 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:19.139476 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.139453 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-r9r58"] Jul 23 18:11:19.143661 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:11:19.143634 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc410a776_1a1e_4616_8e41_ab4ee03b4d64.slice/crio-32a410725c904a20aabbaac1a03fe55af4f7effc77a9145c4eb2c406051116f4 WatchSource:0}: Error finding container 32a410725c904a20aabbaac1a03fe55af4f7effc77a9145c4eb2c406051116f4: Status 404 returned error can't find the container with id 32a410725c904a20aabbaac1a03fe55af4f7effc77a9145c4eb2c406051116f4 Jul 23 18:11:19.218162 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.218112 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:19.227174 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.226578 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c56428ef-8b94-472c-adbc-b935258966c6-console-config\") pod \"console-7f848fd4dd-xs5bx\" (UID: \"c56428ef-8b94-472c-adbc-b935258966c6\") " pod="openshift-console/console-7f848fd4dd-xs5bx" Jul 23 18:11:19.227174 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.226633 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjnth\" (UniqueName: \"kubernetes.io/projected/c56428ef-8b94-472c-adbc-b935258966c6-kube-api-access-wjnth\") pod \"console-7f848fd4dd-xs5bx\" (UID: \"c56428ef-8b94-472c-adbc-b935258966c6\") " pod="openshift-console/console-7f848fd4dd-xs5bx" Jul 23 18:11:19.227174 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.226706 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c56428ef-8b94-472c-adbc-b935258966c6-service-ca\") pod \"console-7f848fd4dd-xs5bx\" (UID: \"c56428ef-8b94-472c-adbc-b935258966c6\") " pod="openshift-console/console-7f848fd4dd-xs5bx" Jul 23 18:11:19.227174 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.226752 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c56428ef-8b94-472c-adbc-b935258966c6-console-serving-cert\") pod \"console-7f848fd4dd-xs5bx\" (UID: \"c56428ef-8b94-472c-adbc-b935258966c6\") " pod="openshift-console/console-7f848fd4dd-xs5bx" Jul 23 18:11:19.227174 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.226780 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c56428ef-8b94-472c-adbc-b935258966c6-console-oauth-config\") pod \"console-7f848fd4dd-xs5bx\" (UID: \"c56428ef-8b94-472c-adbc-b935258966c6\") " pod="openshift-console/console-7f848fd4dd-xs5bx" Jul 23 18:11:19.227174 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.226804 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c56428ef-8b94-472c-adbc-b935258966c6-oauth-serving-cert\") pod \"console-7f848fd4dd-xs5bx\" (UID: \"c56428ef-8b94-472c-adbc-b935258966c6\") " pod="openshift-console/console-7f848fd4dd-xs5bx" Jul 23 18:11:19.227174 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.227170 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c56428ef-8b94-472c-adbc-b935258966c6-console-config\") pod \"console-7f848fd4dd-xs5bx\" (UID: \"c56428ef-8b94-472c-adbc-b935258966c6\") " pod="openshift-console/console-7f848fd4dd-xs5bx" Jul 23 18:11:19.227711 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.227537 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c56428ef-8b94-472c-adbc-b935258966c6-oauth-serving-cert\") pod \"console-7f848fd4dd-xs5bx\" (UID: \"c56428ef-8b94-472c-adbc-b935258966c6\") " pod="openshift-console/console-7f848fd4dd-xs5bx" Jul 23 18:11:19.228016 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.227938 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c56428ef-8b94-472c-adbc-b935258966c6-service-ca\") pod \"console-7f848fd4dd-xs5bx\" (UID: \"c56428ef-8b94-472c-adbc-b935258966c6\") " pod="openshift-console/console-7f848fd4dd-xs5bx" Jul 23 18:11:19.230186 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.230153 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c56428ef-8b94-472c-adbc-b935258966c6-console-oauth-config\") pod \"console-7f848fd4dd-xs5bx\" (UID: \"c56428ef-8b94-472c-adbc-b935258966c6\") " pod="openshift-console/console-7f848fd4dd-xs5bx" Jul 23 18:11:19.230976 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.230953 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c56428ef-8b94-472c-adbc-b935258966c6-console-serving-cert\") pod \"console-7f848fd4dd-xs5bx\" (UID: \"c56428ef-8b94-472c-adbc-b935258966c6\") " pod="openshift-console/console-7f848fd4dd-xs5bx" Jul 23 18:11:19.244318 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.244276 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjnth\" (UniqueName: \"kubernetes.io/projected/c56428ef-8b94-472c-adbc-b935258966c6-kube-api-access-wjnth\") pod \"console-7f848fd4dd-xs5bx\" (UID: \"c56428ef-8b94-472c-adbc-b935258966c6\") " pod="openshift-console/console-7f848fd4dd-xs5bx" Jul 23 18:11:19.323755 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.323704 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f848fd4dd-xs5bx" Jul 23 18:11:19.518186 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.518152 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-r9r58" event={"ID":"c410a776-1a1e-4616-8e41-ab4ee03b4d64","Type":"ContainerStarted","Data":"964be8289f2e0d38a4b03f434067e70fac5d7075038fe739f4058ba13a1defb4"} Jul 23 18:11:19.518305 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.518221 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-r9r58" event={"ID":"c410a776-1a1e-4616-8e41-ab4ee03b4d64","Type":"ContainerStarted","Data":"f0aa989daa27a908e541707550c9423e74dcef4a4f82e9839a21d4a22a44636a"} Jul 23 18:11:19.518305 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.518250 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-r9r58" event={"ID":"c410a776-1a1e-4616-8e41-ab4ee03b4d64","Type":"ContainerStarted","Data":"32a410725c904a20aabbaac1a03fe55af4f7effc77a9145c4eb2c406051116f4"} Jul 23 18:11:19.561578 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.561378 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f848fd4dd-xs5bx"] Jul 23 18:11:19.562444 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:19.562416 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:19.563792 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:11:19.563769 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc56428ef_8b94_472c_adbc_b935258966c6.slice/crio-686530c98889512f3605974b58d6cf0b049232939b11cd6141b05b8ffbb13f88 WatchSource:0}: Error finding container 686530c98889512f3605974b58d6cf0b049232939b11cd6141b05b8ffbb13f88: Status 404 returned error can't find the container with id 686530c98889512f3605974b58d6cf0b049232939b11cd6141b05b8ffbb13f88 Jul 23 18:11:20.524259 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:20.524227 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f848fd4dd-xs5bx" event={"ID":"c56428ef-8b94-472c-adbc-b935258966c6","Type":"ContainerStarted","Data":"686530c98889512f3605974b58d6cf0b049232939b11cd6141b05b8ffbb13f88"} Jul 23 18:11:20.526144 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:20.526069 2575 generic.go:356] "Generic (PLEG): container finished" podID="49cf608f-3e57-43b4-8423-8648f976b919" containerID="f2f5fb1489e98a6716351fa07ab808b1cc4e31919b6a311ebc44ea3924c96b71" exitCode=0 Jul 23 18:11:20.526144 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:20.526105 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bzzvl" event={"ID":"49cf608f-3e57-43b4-8423-8648f976b919","Type":"ContainerDied","Data":"f2f5fb1489e98a6716351fa07ab808b1cc4e31919b6a311ebc44ea3924c96b71"} Jul 23 18:11:20.782227 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:20.782188 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:20.881606 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:20.881567 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:21.533148 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:21.533111 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-r9r58" event={"ID":"c410a776-1a1e-4616-8e41-ab4ee03b4d64","Type":"ContainerStarted","Data":"c951b72b476cf4a29a952ce6e87b6dec9b7b6c4e2abbaca783b442bfc240834c"} Jul 23 18:11:21.535433 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:21.535409 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bzzvl" event={"ID":"49cf608f-3e57-43b4-8423-8648f976b919","Type":"ContainerStarted","Data":"3f1b28d2e472e3eaeedfb7cacb77d1201eba74e3f8cee72c35ed6f7484ebb859"} Jul 23 18:11:21.535554 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:21.535456 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bzzvl" event={"ID":"49cf608f-3e57-43b4-8423-8648f976b919","Type":"ContainerStarted","Data":"b2fe192a0f17227fa24a9233b5dc91b491e7e7b74eb5123ce0e68b35b669d91c"} Jul 23 18:11:21.553628 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:21.553582 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-r9r58" podStartSLOduration=2.254034638 podStartE2EDuration="3.553566407s" totalImagesPullingTime="1.299531769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:11:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:11:21.551973368 +0000 UTC m=+303.469563091" watchObservedRunningTime="2026-07-23 18:11:21.553566407 +0000 UTC m=+303.471156085" Jul 23 18:11:21.574623 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:21.574568 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bzzvl" podStartSLOduration=2.470843141 podStartE2EDuration="3.574553742s" totalImagesPullingTime="1.033787759s" totalInitContainerRuntime="69.922842ms" isStatefulPod=true podCreationTimestamp="2026-07-23 18:11:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:11:21.573120814 +0000 UTC m=+303.490710540" watchObservedRunningTime="2026-07-23 18:11:21.574553742 +0000 UTC m=+303.492143444" Jul 23 18:11:22.010309 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:22.010214 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:22.493547 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:22.493515 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6qdgb" Jul 23 18:11:22.824771 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:22.824730 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:22.925098 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:22.925062 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:23.354536 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:23.354472 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:23.546392 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:23.546356 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f848fd4dd-xs5bx" event={"ID":"c56428ef-8b94-472c-adbc-b935258966c6","Type":"ContainerStarted","Data":"d3d5d029aed779ea5041f0613224a49cf7feb91e462f0a7e9d5e277daa1a129a"} Jul 23 18:11:23.566209 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:23.566153 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f848fd4dd-xs5bx" podStartSLOduration=2.325787045 podStartE2EDuration="5.566132614s" totalImagesPullingTime="3.240345569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:11:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:11:23.565578264 +0000 UTC m=+305.483167985" watchObservedRunningTime="2026-07-23 18:11:23.566132614 +0000 UTC m=+305.483722316" Jul 23 18:11:24.034459 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.034414 2575 patch_prober.go:28] interesting pod/image-registry-7fcff6cc5-fwvfb container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 23 18:11:24.034896 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.034471 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" podUID="dffca2c1-6cb2-46ec-9842-5c20982d1581" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 23 18:11:24.268667 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.268634 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:24.274474 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.274451 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 18:11:24.279425 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.279405 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.283740 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.283700 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 23 18:11:24.283864 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.283751 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 23 18:11:24.283864 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.283781 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-x6hd7\"" Jul 23 18:11:24.284251 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.284229 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 23 18:11:24.284331 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.284312 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 23 18:11:24.284392 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.284350 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 23 18:11:24.284450 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.284434 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 23 18:11:24.284571 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.284524 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 23 18:11:24.284646 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.284593 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 23 18:11:24.284646 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.284620 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 23 18:11:24.284766 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.284653 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 23 18:11:24.284766 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.284726 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 23 18:11:24.284885 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.284838 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 23 18:11:24.285092 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.285042 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1gsm4j6j61otj\"" Jul 23 18:11:24.285370 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.285348 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 23 18:11:24.285446 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.285373 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 23 18:11:24.286919 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.286878 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 23 18:11:24.297124 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.297100 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 18:11:24.374638 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.374600 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:24.378719 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.378688 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2bqx\" (UniqueName: \"kubernetes.io/projected/3e19bc43-4997-4507-b932-2ab09d2718ec-kube-api-access-x2bqx\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.378875 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.378747 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.378875 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.378793 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.378875 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.378833 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.379053 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.378909 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-web-config\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.379053 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.378960 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.379053 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.378990 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.379053 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.379021 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e19bc43-4997-4507-b932-2ab09d2718ec-config-out\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.379242 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.379054 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.379242 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.379086 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.379242 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.379129 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-config\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.379242 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.379152 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.379427 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.379264 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.379427 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.379327 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.379427 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.379354 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.379427 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.379370 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e19bc43-4997-4507-b932-2ab09d2718ec-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.379427 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.379385 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.379427 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.379400 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.379721 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.379442 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3e19bc43-4997-4507-b932-2ab09d2718ec-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.379721 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.379542 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.474279 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.474237 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:24.480505 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.480477 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2bqx\" (UniqueName: \"kubernetes.io/projected/3e19bc43-4997-4507-b932-2ab09d2718ec-kube-api-access-x2bqx\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.480664 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.480515 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.480664 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.480548 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.480664 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.480577 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.480664 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.480612 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-web-config\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.480664 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.480647 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.480664 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.480671 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.481036 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.480721 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e19bc43-4997-4507-b932-2ab09d2718ec-config-out\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.481036 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.480742 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.481036 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.480769 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.481036 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.480814 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-config\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.481036 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.480838 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.481036 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.480877 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.481036 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.480908 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.481036 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.480939 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.481036 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.480966 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e19bc43-4997-4507-b932-2ab09d2718ec-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.481036 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.480989 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.481036 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.481012 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.481036 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.481035 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3e19bc43-4997-4507-b932-2ab09d2718ec-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.481608 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.481065 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.481608 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.481337 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.481608 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.481589 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.482147 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.481869 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.482869 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.482495 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.484745 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.483909 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.484745 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.484133 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.484745 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.484515 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.484745 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.484612 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.484997 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.484835 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3e19bc43-4997-4507-b932-2ab09d2718ec-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.485705 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.485645 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.486021 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.485877 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-web-config\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.486104 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.486038 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.486307 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.486257 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.486443 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.486397 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.486545 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.486500 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-config\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.488028 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.487963 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e19bc43-4997-4507-b932-2ab09d2718ec-config-out\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.488127 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.488115 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e19bc43-4997-4507-b932-2ab09d2718ec-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.488268 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.488234 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.488533 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.488515 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.490223 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.490200 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2bqx\" (UniqueName: \"kubernetes.io/projected/3e19bc43-4997-4507-b932-2ab09d2718ec-kube-api-access-x2bqx\") pod \"prometheus-k8s-0\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:24.590929 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:24.590847 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:26.615355 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:26.615310 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:11:28.465422 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:28.465394 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:11:28.756474 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:28.756381 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:28.857437 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:28.857404 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:28.958496 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:28.958459 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:29.132129 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:29.132095 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:29.233861 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:29.233820 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:29.324506 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:29.324471 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f848fd4dd-xs5bx" Jul 23 18:11:29.324718 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:29.324567 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f848fd4dd-xs5bx" Jul 23 18:11:29.330009 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:29.329985 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7f848fd4dd-xs5bx" Jul 23 18:11:29.578059 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:29.577940 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7f848fd4dd-xs5bx" Jul 23 18:11:29.702582 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:29.702544 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:29.780583 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:29.780556 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:29.832402 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:29.832327 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:30.207435 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:30.207404 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 18:11:30.293174 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:11:30.293142 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e19bc43_4997_4507_b932_2ab09d2718ec.slice/crio-9553fe12b0734ba262000fa8d293ab5f655e3128a1d7c46cf845086f767240fb WatchSource:0}: Error finding container 9553fe12b0734ba262000fa8d293ab5f655e3128a1d7c46cf845086f767240fb: Status 404 returned error can't find the container with id 9553fe12b0734ba262000fa8d293ab5f655e3128a1d7c46cf845086f767240fb Jul 23 18:11:30.316506 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:30.316483 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 18:11:30.577800 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:30.577766 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e19bc43-4997-4507-b932-2ab09d2718ec","Type":"ContainerStarted","Data":"9553fe12b0734ba262000fa8d293ab5f655e3128a1d7c46cf845086f767240fb"} Jul 23 18:11:30.579291 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:30.579265 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-lk8q6" event={"ID":"f4b1d517-c159-4ef3-aeec-f25cba7cc5fb","Type":"ContainerStarted","Data":"6d1edf0c675b5302f7be4a7a237af30350ce6ccff105972b3a51e644361d460e"} Jul 23 18:11:30.596558 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:30.596510 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-lk8q6" podStartSLOduration=1.852713346 podStartE2EDuration="21.596498336s" totalImagesPullingTime="19.74378499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:11:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:11:30.595813852 +0000 UTC m=+312.513403552" watchObservedRunningTime="2026-07-23 18:11:30.596498336 +0000 UTC m=+312.514088035" Jul 23 18:11:31.583258 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:31.583187 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-lk8q6" Jul 23 18:11:31.597805 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:31.597776 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-lk8q6" Jul 23 18:11:31.640327 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:31.640296 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:31.741116 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:31.741082 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:32.116154 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:32.116128 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7fcff6cc5-fwvfb"] Jul 23 18:11:32.231668 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:32.231631 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:32.332616 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:32.332576 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:32.590915 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:32.590795 2575 generic.go:356] "Generic (PLEG): container finished" podID="3e19bc43-4997-4507-b932-2ab09d2718ec" containerID="19a2c61a4406a38c06fc67f1fb0ab34288d53a3b5883e9212d3751045702696b" exitCode=0 Jul 23 18:11:32.591702 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:32.591658 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e19bc43-4997-4507-b932-2ab09d2718ec","Type":"ContainerDied","Data":"19a2c61a4406a38c06fc67f1fb0ab34288d53a3b5883e9212d3751045702696b"} Jul 23 18:11:35.847298 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:35.847215 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:35.947343 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:35.947238 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:36.990027 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:36.989992 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:37.052253 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:37.052215 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:37.615358 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:37.615327 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e19bc43-4997-4507-b932-2ab09d2718ec","Type":"ContainerStarted","Data":"b363a23f3ef8e16653f608e6126ed0ac9a5024ede8d2edd4686973cba3f55be9"} Jul 23 18:11:37.615620 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:37.615399 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e19bc43-4997-4507-b932-2ab09d2718ec","Type":"ContainerStarted","Data":"a65bee388e7615e6859b9d388171ebc2175a51e9a8a6d0802744e7673223e465"} Jul 23 18:11:39.227333 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:39.227297 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:39.372135 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:39.372100 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:39.630946 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:39.630916 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e19bc43-4997-4507-b932-2ab09d2718ec","Type":"ContainerStarted","Data":"bc757bf271b7947ec28c36a0781fea80338994966c58924fb418f95f7cf588a3"} Jul 23 18:11:40.638097 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:40.638062 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e19bc43-4997-4507-b932-2ab09d2718ec","Type":"ContainerStarted","Data":"aefae416ff0174500b4074bd8602429924ce7cdd3d8d8a3f8bb44b209400362b"} Jul 23 18:11:40.638522 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:40.638124 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e19bc43-4997-4507-b932-2ab09d2718ec","Type":"ContainerStarted","Data":"a59ed7b889dedc7ed5c268a337d68a11c0d368ca2a59994c1df517c23f6e109e"} Jul 23 18:11:40.638522 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:40.638150 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e19bc43-4997-4507-b932-2ab09d2718ec","Type":"ContainerStarted","Data":"2e65a3a36f094e32141bc1bd6a98f2d081496ce994575a675715f63476f47f49"} Jul 23 18:11:40.661861 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:40.661831 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:40.676751 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:40.676711 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=8.802817519 podStartE2EDuration="16.676695671s" totalImagesPullingTime="7.849835509s" totalInitContainerRuntime="24.042643ms" isStatefulPod=false podCreationTimestamp="2026-07-23 18:11:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:11:40.675653655 +0000 UTC m=+322.593243372" watchObservedRunningTime="2026-07-23 18:11:40.676695671 +0000 UTC m=+322.594285369" Jul 23 18:11:40.730121 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:40.730096 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:42.901761 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:42.901730 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:43.002959 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:43.002927 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:44.591184 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:44.591146 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:11:46.665498 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:46.665437 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f848fd4dd-xs5bx"] Jul 23 18:11:46.808018 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:46.807986 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:46.907502 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:46.907460 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:47.009543 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:47.009466 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:47.109321 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:47.109287 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:50.833505 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:50.833469 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:50.890246 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:50.890214 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:51.994872 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:51.994835 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:52.065757 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:52.065730 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:53.308569 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:53.308538 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:53.358729 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:53.358696 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:11:57.141511 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.141464 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" podUID="dffca2c1-6cb2-46ec-9842-5c20982d1581" containerName="registry" containerID="cri-o://247c154cdbac79d039055148853d16d704554e4fee4b32a0419624d6577996cf" gracePeriod=30 Jul 23 18:11:57.443540 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.443505 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:11:57.483412 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.483374 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dffca2c1-6cb2-46ec-9842-5c20982d1581-ca-trust-extracted\") pod \"dffca2c1-6cb2-46ec-9842-5c20982d1581\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " Jul 23 18:11:57.483573 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.483427 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dffca2c1-6cb2-46ec-9842-5c20982d1581-image-registry-private-configuration\") pod \"dffca2c1-6cb2-46ec-9842-5c20982d1581\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " Jul 23 18:11:57.483573 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.483443 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dffca2c1-6cb2-46ec-9842-5c20982d1581-installation-pull-secrets\") pod \"dffca2c1-6cb2-46ec-9842-5c20982d1581\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " Jul 23 18:11:57.483573 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.483467 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-tls\") pod \"dffca2c1-6cb2-46ec-9842-5c20982d1581\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " Jul 23 18:11:57.483573 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.483498 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6g6b\" (UniqueName: \"kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-kube-api-access-q6g6b\") pod \"dffca2c1-6cb2-46ec-9842-5c20982d1581\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " Jul 23 18:11:57.483573 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.483523 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-certificates\") pod \"dffca2c1-6cb2-46ec-9842-5c20982d1581\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " Jul 23 18:11:57.483573 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.483542 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-bound-sa-token\") pod \"dffca2c1-6cb2-46ec-9842-5c20982d1581\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " Jul 23 18:11:57.483883 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.483710 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dffca2c1-6cb2-46ec-9842-5c20982d1581-trusted-ca\") pod \"dffca2c1-6cb2-46ec-9842-5c20982d1581\" (UID: \"dffca2c1-6cb2-46ec-9842-5c20982d1581\") " Jul 23 18:11:57.484382 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.484305 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dffca2c1-6cb2-46ec-9842-5c20982d1581-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "dffca2c1-6cb2-46ec-9842-5c20982d1581" (UID: "dffca2c1-6cb2-46ec-9842-5c20982d1581"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:11:57.484519 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.484496 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "dffca2c1-6cb2-46ec-9842-5c20982d1581" (UID: "dffca2c1-6cb2-46ec-9842-5c20982d1581"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:11:57.486552 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.486424 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dffca2c1-6cb2-46ec-9842-5c20982d1581-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "dffca2c1-6cb2-46ec-9842-5c20982d1581" (UID: "dffca2c1-6cb2-46ec-9842-5c20982d1581"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:11:57.486552 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.486482 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "dffca2c1-6cb2-46ec-9842-5c20982d1581" (UID: "dffca2c1-6cb2-46ec-9842-5c20982d1581"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:11:57.486552 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.486523 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "dffca2c1-6cb2-46ec-9842-5c20982d1581" (UID: "dffca2c1-6cb2-46ec-9842-5c20982d1581"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:11:57.486552 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.486518 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dffca2c1-6cb2-46ec-9842-5c20982d1581-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "dffca2c1-6cb2-46ec-9842-5c20982d1581" (UID: "dffca2c1-6cb2-46ec-9842-5c20982d1581"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:11:57.486811 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.486730 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-kube-api-access-q6g6b" (OuterVolumeSpecName: "kube-api-access-q6g6b") pod "dffca2c1-6cb2-46ec-9842-5c20982d1581" (UID: "dffca2c1-6cb2-46ec-9842-5c20982d1581"). InnerVolumeSpecName "kube-api-access-q6g6b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:11:57.492276 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.492232 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dffca2c1-6cb2-46ec-9842-5c20982d1581-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "dffca2c1-6cb2-46ec-9842-5c20982d1581" (UID: "dffca2c1-6cb2-46ec-9842-5c20982d1581"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:11:57.584510 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.584456 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6g6b\" (UniqueName: \"kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-kube-api-access-q6g6b\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:11:57.584510 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.584504 2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-certificates\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:11:57.584510 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.584517 2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-bound-sa-token\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:11:57.584789 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.584528 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/dffca2c1-6cb2-46ec-9842-5c20982d1581-trusted-ca\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:11:57.584789 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.584540 2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/dffca2c1-6cb2-46ec-9842-5c20982d1581-ca-trust-extracted\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:11:57.584789 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.584554 2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/dffca2c1-6cb2-46ec-9842-5c20982d1581-image-registry-private-configuration\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:11:57.584789 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.584566 2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/dffca2c1-6cb2-46ec-9842-5c20982d1581-installation-pull-secrets\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:11:57.584789 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.584577 2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/dffca2c1-6cb2-46ec-9842-5c20982d1581-registry-tls\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:11:57.703192 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.703091 2575 generic.go:356] "Generic (PLEG): container finished" podID="dffca2c1-6cb2-46ec-9842-5c20982d1581" containerID="247c154cdbac79d039055148853d16d704554e4fee4b32a0419624d6577996cf" exitCode=0 Jul 23 18:11:57.703192 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.703134 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" Jul 23 18:11:57.703192 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.703170 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" event={"ID":"dffca2c1-6cb2-46ec-9842-5c20982d1581","Type":"ContainerDied","Data":"247c154cdbac79d039055148853d16d704554e4fee4b32a0419624d6577996cf"} Jul 23 18:11:57.703483 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.703218 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7fcff6cc5-fwvfb" event={"ID":"dffca2c1-6cb2-46ec-9842-5c20982d1581","Type":"ContainerDied","Data":"03029843782a4bf4b31984437c61f6e677d0b95e25674786464d34a6e8496a8e"} Jul 23 18:11:57.703483 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.703243 2575 scope.go:117] "RemoveContainer" containerID="247c154cdbac79d039055148853d16d704554e4fee4b32a0419624d6577996cf" Jul 23 18:11:57.711886 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.711867 2575 scope.go:117] "RemoveContainer" containerID="247c154cdbac79d039055148853d16d704554e4fee4b32a0419624d6577996cf" Jul 23 18:11:57.712137 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:11:57.712117 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"247c154cdbac79d039055148853d16d704554e4fee4b32a0419624d6577996cf\": container with ID starting with 247c154cdbac79d039055148853d16d704554e4fee4b32a0419624d6577996cf not found: ID does not exist" containerID="247c154cdbac79d039055148853d16d704554e4fee4b32a0419624d6577996cf" Jul 23 18:11:57.712179 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.712146 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"247c154cdbac79d039055148853d16d704554e4fee4b32a0419624d6577996cf"} err="failed to get container status \"247c154cdbac79d039055148853d16d704554e4fee4b32a0419624d6577996cf\": rpc error: code = NotFound desc = could not find container \"247c154cdbac79d039055148853d16d704554e4fee4b32a0419624d6577996cf\": container with ID starting with 247c154cdbac79d039055148853d16d704554e4fee4b32a0419624d6577996cf not found: ID does not exist" Jul 23 18:11:57.724405 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.724384 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7fcff6cc5-fwvfb"] Jul 23 18:11:57.728038 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:57.728017 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7fcff6cc5-fwvfb"] Jul 23 18:11:58.620396 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:11:58.620354 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dffca2c1-6cb2-46ec-9842-5c20982d1581" path="/var/lib/kubelet/pods/dffca2c1-6cb2-46ec-9842-5c20982d1581/volumes" Jul 23 18:12:05.839802 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:05.839768 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:12:05.906992 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:05.906963 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:12:11.693220 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:11.693131 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7f848fd4dd-xs5bx" podUID="c56428ef-8b94-472c-adbc-b935258966c6" containerName="console" containerID="cri-o://d3d5d029aed779ea5041f0613224a49cf7feb91e462f0a7e9d5e277daa1a129a" gracePeriod=15 Jul 23 18:12:11.967778 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:11.967722 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f848fd4dd-xs5bx" Jul 23 18:12:11.983619 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:11.983597 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c56428ef-8b94-472c-adbc-b935258966c6-console-config\") pod \"c56428ef-8b94-472c-adbc-b935258966c6\" (UID: \"c56428ef-8b94-472c-adbc-b935258966c6\") " Jul 23 18:12:11.983765 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:11.983638 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjnth\" (UniqueName: \"kubernetes.io/projected/c56428ef-8b94-472c-adbc-b935258966c6-kube-api-access-wjnth\") pod \"c56428ef-8b94-472c-adbc-b935258966c6\" (UID: \"c56428ef-8b94-472c-adbc-b935258966c6\") " Jul 23 18:12:11.983765 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:11.983661 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c56428ef-8b94-472c-adbc-b935258966c6-console-oauth-config\") pod \"c56428ef-8b94-472c-adbc-b935258966c6\" (UID: \"c56428ef-8b94-472c-adbc-b935258966c6\") " Jul 23 18:12:11.983765 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:11.983726 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c56428ef-8b94-472c-adbc-b935258966c6-service-ca\") pod \"c56428ef-8b94-472c-adbc-b935258966c6\" (UID: \"c56428ef-8b94-472c-adbc-b935258966c6\") " Jul 23 18:12:11.983765 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:11.983747 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c56428ef-8b94-472c-adbc-b935258966c6-oauth-serving-cert\") pod \"c56428ef-8b94-472c-adbc-b935258966c6\" (UID: \"c56428ef-8b94-472c-adbc-b935258966c6\") " Jul 23 18:12:11.983978 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:11.983767 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c56428ef-8b94-472c-adbc-b935258966c6-console-serving-cert\") pod \"c56428ef-8b94-472c-adbc-b935258966c6\" (UID: \"c56428ef-8b94-472c-adbc-b935258966c6\") " Jul 23 18:12:11.984070 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:11.984043 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c56428ef-8b94-472c-adbc-b935258966c6-console-config" (OuterVolumeSpecName: "console-config") pod "c56428ef-8b94-472c-adbc-b935258966c6" (UID: "c56428ef-8b94-472c-adbc-b935258966c6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:12:11.984160 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:11.984110 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c56428ef-8b94-472c-adbc-b935258966c6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c56428ef-8b94-472c-adbc-b935258966c6" (UID: "c56428ef-8b94-472c-adbc-b935258966c6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:12:11.984160 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:11.984118 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c56428ef-8b94-472c-adbc-b935258966c6-service-ca" (OuterVolumeSpecName: "service-ca") pod "c56428ef-8b94-472c-adbc-b935258966c6" (UID: "c56428ef-8b94-472c-adbc-b935258966c6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:12:11.985884 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:11.985853 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c56428ef-8b94-472c-adbc-b935258966c6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c56428ef-8b94-472c-adbc-b935258966c6" (UID: "c56428ef-8b94-472c-adbc-b935258966c6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:12:11.985984 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:11.985899 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c56428ef-8b94-472c-adbc-b935258966c6-kube-api-access-wjnth" (OuterVolumeSpecName: "kube-api-access-wjnth") pod "c56428ef-8b94-472c-adbc-b935258966c6" (UID: "c56428ef-8b94-472c-adbc-b935258966c6"). InnerVolumeSpecName "kube-api-access-wjnth". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:12:11.986075 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:11.986054 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c56428ef-8b94-472c-adbc-b935258966c6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c56428ef-8b94-472c-adbc-b935258966c6" (UID: "c56428ef-8b94-472c-adbc-b935258966c6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:12:12.084313 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:12.084285 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c56428ef-8b94-472c-adbc-b935258966c6-console-config\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:12:12.084313 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:12.084310 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjnth\" (UniqueName: \"kubernetes.io/projected/c56428ef-8b94-472c-adbc-b935258966c6-kube-api-access-wjnth\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:12:12.084486 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:12.084322 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c56428ef-8b94-472c-adbc-b935258966c6-console-oauth-config\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:12:12.084486 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:12.084338 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c56428ef-8b94-472c-adbc-b935258966c6-service-ca\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:12:12.084486 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:12.084348 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c56428ef-8b94-472c-adbc-b935258966c6-oauth-serving-cert\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:12:12.084486 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:12.084357 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c56428ef-8b94-472c-adbc-b935258966c6-console-serving-cert\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:12:12.764115 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:12.764082 2575 generic.go:356] "Generic (PLEG): container finished" podID="c56428ef-8b94-472c-adbc-b935258966c6" containerID="d3d5d029aed779ea5041f0613224a49cf7feb91e462f0a7e9d5e277daa1a129a" exitCode=0 Jul 23 18:12:12.764600 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:12.764147 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f848fd4dd-xs5bx" event={"ID":"c56428ef-8b94-472c-adbc-b935258966c6","Type":"ContainerDied","Data":"d3d5d029aed779ea5041f0613224a49cf7feb91e462f0a7e9d5e277daa1a129a"} Jul 23 18:12:12.764600 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:12.764151 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f848fd4dd-xs5bx" Jul 23 18:12:12.764600 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:12.764209 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f848fd4dd-xs5bx" event={"ID":"c56428ef-8b94-472c-adbc-b935258966c6","Type":"ContainerDied","Data":"686530c98889512f3605974b58d6cf0b049232939b11cd6141b05b8ffbb13f88"} Jul 23 18:12:12.764600 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:12.764229 2575 scope.go:117] "RemoveContainer" containerID="d3d5d029aed779ea5041f0613224a49cf7feb91e462f0a7e9d5e277daa1a129a" Jul 23 18:12:12.772534 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:12.772514 2575 scope.go:117] "RemoveContainer" containerID="d3d5d029aed779ea5041f0613224a49cf7feb91e462f0a7e9d5e277daa1a129a" Jul 23 18:12:12.772838 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:12:12.772816 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3d5d029aed779ea5041f0613224a49cf7feb91e462f0a7e9d5e277daa1a129a\": container with ID starting with d3d5d029aed779ea5041f0613224a49cf7feb91e462f0a7e9d5e277daa1a129a not found: ID does not exist" containerID="d3d5d029aed779ea5041f0613224a49cf7feb91e462f0a7e9d5e277daa1a129a" Jul 23 18:12:12.772912 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:12.772845 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3d5d029aed779ea5041f0613224a49cf7feb91e462f0a7e9d5e277daa1a129a"} err="failed to get container status \"d3d5d029aed779ea5041f0613224a49cf7feb91e462f0a7e9d5e277daa1a129a\": rpc error: code = NotFound desc = could not find container \"d3d5d029aed779ea5041f0613224a49cf7feb91e462f0a7e9d5e277daa1a129a\": container with ID starting with d3d5d029aed779ea5041f0613224a49cf7feb91e462f0a7e9d5e277daa1a129a not found: ID does not exist" Jul 23 18:12:12.782129 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:12.782108 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f848fd4dd-xs5bx"] Jul 23 18:12:12.785544 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:12.785508 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f848fd4dd-xs5bx"] Jul 23 18:12:14.619414 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:14.619380 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c56428ef-8b94-472c-adbc-b935258966c6" path="/var/lib/kubelet/pods/c56428ef-8b94-472c-adbc-b935258966c6/volumes" Jul 23 18:12:24.591355 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:24.591311 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:24.606633 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:24.606605 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:24.828450 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:24.828421 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:32.553575 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:32.553536 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-metrics-certs\") pod \"network-metrics-daemon-rpldf\" (UID: \"0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b\") " pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:12:32.555833 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:32.555813 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b-metrics-certs\") pod \"network-metrics-daemon-rpldf\" (UID: \"0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b\") " pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:12:32.619178 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:32.619146 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cdqn6\"" Jul 23 18:12:32.626684 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:32.626660 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rpldf" Jul 23 18:12:32.749523 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:32.749413 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rpldf"] Jul 23 18:12:32.752350 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:12:32.752320 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e09e94e_8fee_49f5_b2fe_35bddb5d1c2b.slice/crio-520dc101eebbbba2bf1d14cfe308d53fcee7790fe82fdc855ae3c765dc2bd536 WatchSource:0}: Error finding container 520dc101eebbbba2bf1d14cfe308d53fcee7790fe82fdc855ae3c765dc2bd536: Status 404 returned error can't find the container with id 520dc101eebbbba2bf1d14cfe308d53fcee7790fe82fdc855ae3c765dc2bd536 Jul 23 18:12:32.845264 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:32.845199 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rpldf" event={"ID":"0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b","Type":"ContainerStarted","Data":"520dc101eebbbba2bf1d14cfe308d53fcee7790fe82fdc855ae3c765dc2bd536"} Jul 23 18:12:33.849881 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:33.849857 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rpldf" event={"ID":"0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b","Type":"ContainerStarted","Data":"c7d02d6cc26b1c93ebfff8b2ba59da094811b60daa63beab4110363c324bd618"} Jul 23 18:12:34.162502 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:34.162471 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:12:34.215804 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:34.215780 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:12:34.855519 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:34.855486 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rpldf" event={"ID":"0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b","Type":"ContainerStarted","Data":"0a04fe83ba7fd7f83d3cce2ec8335b084463fcc72bc1dc3cd0b808ed38f95e26"} Jul 23 18:12:34.873593 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:34.873550 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rpldf" podStartSLOduration=374.913711612 podStartE2EDuration="6m15.873534755s" totalImagesPullingTime="959.823143ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:12:34.872145736 +0000 UTC m=+376.789735447" watchObservedRunningTime="2026-07-23 18:12:34.873534755 +0000 UTC m=+376.791124455" Jul 23 18:12:34.964065 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:34.964038 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:12:35.025586 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:35.025564 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:12:42.679566 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:42.679529 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 18:12:42.680075 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:42.679883 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3e19bc43-4997-4507-b932-2ab09d2718ec" containerName="prometheus" containerID="cri-o://a65bee388e7615e6859b9d388171ebc2175a51e9a8a6d0802744e7673223e465" gracePeriod=600 Jul 23 18:12:42.680075 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:42.679904 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3e19bc43-4997-4507-b932-2ab09d2718ec" containerName="kube-rbac-proxy" containerID="cri-o://a59ed7b889dedc7ed5c268a337d68a11c0d368ca2a59994c1df517c23f6e109e" gracePeriod=600 Jul 23 18:12:42.680075 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:42.679934 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3e19bc43-4997-4507-b932-2ab09d2718ec" containerName="config-reloader" containerID="cri-o://b363a23f3ef8e16653f608e6126ed0ac9a5024ede8d2edd4686973cba3f55be9" gracePeriod=600 Jul 23 18:12:42.680075 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:42.679960 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3e19bc43-4997-4507-b932-2ab09d2718ec" containerName="kube-rbac-proxy-thanos" containerID="cri-o://aefae416ff0174500b4074bd8602429924ce7cdd3d8d8a3f8bb44b209400362b" gracePeriod=600 Jul 23 18:12:42.680075 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:42.679928 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3e19bc43-4997-4507-b932-2ab09d2718ec" containerName="thanos-sidecar" containerID="cri-o://bc757bf271b7947ec28c36a0781fea80338994966c58924fb418f95f7cf588a3" gracePeriod=600 Jul 23 18:12:42.680075 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:42.679936 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3e19bc43-4997-4507-b932-2ab09d2718ec" containerName="kube-rbac-proxy-web" containerID="cri-o://2e65a3a36f094e32141bc1bd6a98f2d081496ce994575a675715f63476f47f49" gracePeriod=600 Jul 23 18:12:42.887874 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:42.887846 2575 generic.go:356] "Generic (PLEG): container finished" podID="3e19bc43-4997-4507-b932-2ab09d2718ec" containerID="aefae416ff0174500b4074bd8602429924ce7cdd3d8d8a3f8bb44b209400362b" exitCode=0 Jul 23 18:12:42.887874 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:42.887870 2575 generic.go:356] "Generic (PLEG): container finished" podID="3e19bc43-4997-4507-b932-2ab09d2718ec" containerID="a59ed7b889dedc7ed5c268a337d68a11c0d368ca2a59994c1df517c23f6e109e" exitCode=0 Jul 23 18:12:42.887874 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:42.887876 2575 generic.go:356] "Generic (PLEG): container finished" podID="3e19bc43-4997-4507-b932-2ab09d2718ec" containerID="bc757bf271b7947ec28c36a0781fea80338994966c58924fb418f95f7cf588a3" exitCode=0 Jul 23 18:12:42.888035 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:42.887882 2575 generic.go:356] "Generic (PLEG): container finished" podID="3e19bc43-4997-4507-b932-2ab09d2718ec" containerID="b363a23f3ef8e16653f608e6126ed0ac9a5024ede8d2edd4686973cba3f55be9" exitCode=0 Jul 23 18:12:42.888035 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:42.887887 2575 generic.go:356] "Generic (PLEG): container finished" podID="3e19bc43-4997-4507-b932-2ab09d2718ec" containerID="a65bee388e7615e6859b9d388171ebc2175a51e9a8a6d0802744e7673223e465" exitCode=0 Jul 23 18:12:42.888035 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:42.887917 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e19bc43-4997-4507-b932-2ab09d2718ec","Type":"ContainerDied","Data":"aefae416ff0174500b4074bd8602429924ce7cdd3d8d8a3f8bb44b209400362b"} Jul 23 18:12:42.888035 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:42.887979 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e19bc43-4997-4507-b932-2ab09d2718ec","Type":"ContainerDied","Data":"a59ed7b889dedc7ed5c268a337d68a11c0d368ca2a59994c1df517c23f6e109e"} Jul 23 18:12:42.888035 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:42.888005 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e19bc43-4997-4507-b932-2ab09d2718ec","Type":"ContainerDied","Data":"bc757bf271b7947ec28c36a0781fea80338994966c58924fb418f95f7cf588a3"} Jul 23 18:12:42.888035 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:42.888029 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e19bc43-4997-4507-b932-2ab09d2718ec","Type":"ContainerDied","Data":"b363a23f3ef8e16653f608e6126ed0ac9a5024ede8d2edd4686973cba3f55be9"} Jul 23 18:12:42.888207 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:42.888055 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e19bc43-4997-4507-b932-2ab09d2718ec","Type":"ContainerDied","Data":"a65bee388e7615e6859b9d388171ebc2175a51e9a8a6d0802744e7673223e465"} Jul 23 18:12:43.896913 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:43.896884 2575 generic.go:356] "Generic (PLEG): container finished" podID="3e19bc43-4997-4507-b932-2ab09d2718ec" containerID="2e65a3a36f094e32141bc1bd6a98f2d081496ce994575a675715f63476f47f49" exitCode=0 Jul 23 18:12:43.897234 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:43.896950 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e19bc43-4997-4507-b932-2ab09d2718ec","Type":"ContainerDied","Data":"2e65a3a36f094e32141bc1bd6a98f2d081496ce994575a675715f63476f47f49"} Jul 23 18:12:43.928775 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:43.928758 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:43.984021 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:43.983960 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:12:44.038556 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.038528 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-grpc-tls\") pod \"3e19bc43-4997-4507-b932-2ab09d2718ec\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " Jul 23 18:12:44.038661 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.038568 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-prometheus-k8s-rulefiles-1\") pod \"3e19bc43-4997-4507-b932-2ab09d2718ec\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " Jul 23 18:12:44.038661 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.038587 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-prometheus-k8s-rulefiles-2\") pod \"3e19bc43-4997-4507-b932-2ab09d2718ec\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " Jul 23 18:12:44.038661 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.038618 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-prometheus-k8s-tls\") pod \"3e19bc43-4997-4507-b932-2ab09d2718ec\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " Jul 23 18:12:44.038661 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.038643 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-prometheus-k8s-rulefiles-0\") pod \"3e19bc43-4997-4507-b932-2ab09d2718ec\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " Jul 23 18:12:44.038913 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.038689 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"3e19bc43-4997-4507-b932-2ab09d2718ec\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " Jul 23 18:12:44.038913 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.038717 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3e19bc43-4997-4507-b932-2ab09d2718ec-prometheus-k8s-db\") pod \"3e19bc43-4997-4507-b932-2ab09d2718ec\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " Jul 23 18:12:44.038913 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.038748 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-kube-rbac-proxy\") pod \"3e19bc43-4997-4507-b932-2ab09d2718ec\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " Jul 23 18:12:44.038913 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.038778 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e19bc43-4997-4507-b932-2ab09d2718ec-config-out\") pod \"3e19bc43-4997-4507-b932-2ab09d2718ec\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " Jul 23 18:12:44.038913 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.038814 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"3e19bc43-4997-4507-b932-2ab09d2718ec\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " Jul 23 18:12:44.038913 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.038838 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-thanos-prometheus-http-client-file\") pod \"3e19bc43-4997-4507-b932-2ab09d2718ec\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " Jul 23 18:12:44.038913 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.038871 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-configmap-kubelet-serving-ca-bundle\") pod \"3e19bc43-4997-4507-b932-2ab09d2718ec\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " Jul 23 18:12:44.038913 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.038907 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x2bqx\" (UniqueName: \"kubernetes.io/projected/3e19bc43-4997-4507-b932-2ab09d2718ec-kube-api-access-x2bqx\") pod \"3e19bc43-4997-4507-b932-2ab09d2718ec\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " Jul 23 18:12:44.039281 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.038935 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-web-config\") pod \"3e19bc43-4997-4507-b932-2ab09d2718ec\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " Jul 23 18:12:44.039281 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.038960 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-configmap-metrics-client-ca\") pod \"3e19bc43-4997-4507-b932-2ab09d2718ec\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " Jul 23 18:12:44.039281 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.038989 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-metrics-client-certs\") pod \"3e19bc43-4997-4507-b932-2ab09d2718ec\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " Jul 23 18:12:44.039281 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.039023 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-configmap-serving-certs-ca-bundle\") pod \"3e19bc43-4997-4507-b932-2ab09d2718ec\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " Jul 23 18:12:44.039281 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.039022 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "3e19bc43-4997-4507-b932-2ab09d2718ec" (UID: "3e19bc43-4997-4507-b932-2ab09d2718ec"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:12:44.039281 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.039043 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "3e19bc43-4997-4507-b932-2ab09d2718ec" (UID: "3e19bc43-4997-4507-b932-2ab09d2718ec"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:12:44.039281 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.039065 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-config\") pod \"3e19bc43-4997-4507-b932-2ab09d2718ec\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " Jul 23 18:12:44.039281 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.039091 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e19bc43-4997-4507-b932-2ab09d2718ec-tls-assets\") pod \"3e19bc43-4997-4507-b932-2ab09d2718ec\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " Jul 23 18:12:44.039281 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.039122 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-prometheus-trusted-ca-bundle\") pod \"3e19bc43-4997-4507-b932-2ab09d2718ec\" (UID: \"3e19bc43-4997-4507-b932-2ab09d2718ec\") " Jul 23 18:12:44.039766 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.039361 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:12:44.039766 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.039381 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:12:44.039965 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.039934 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "3e19bc43-4997-4507-b932-2ab09d2718ec" (UID: "3e19bc43-4997-4507-b932-2ab09d2718ec"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:12:44.041141 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.040153 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e19bc43-4997-4507-b932-2ab09d2718ec-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "3e19bc43-4997-4507-b932-2ab09d2718ec" (UID: "3e19bc43-4997-4507-b932-2ab09d2718ec"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:12:44.041141 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.040602 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "3e19bc43-4997-4507-b932-2ab09d2718ec" (UID: "3e19bc43-4997-4507-b932-2ab09d2718ec"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:12:44.041141 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.040792 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "3e19bc43-4997-4507-b932-2ab09d2718ec" (UID: "3e19bc43-4997-4507-b932-2ab09d2718ec"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:12:44.041373 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.041201 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "3e19bc43-4997-4507-b932-2ab09d2718ec" (UID: "3e19bc43-4997-4507-b932-2ab09d2718ec"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:12:44.041373 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.041359 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "3e19bc43-4997-4507-b932-2ab09d2718ec" (UID: "3e19bc43-4997-4507-b932-2ab09d2718ec"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:12:44.041479 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.041427 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "3e19bc43-4997-4507-b932-2ab09d2718ec" (UID: "3e19bc43-4997-4507-b932-2ab09d2718ec"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:12:44.041665 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.041622 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "3e19bc43-4997-4507-b932-2ab09d2718ec" (UID: "3e19bc43-4997-4507-b932-2ab09d2718ec"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:12:44.042078 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.042053 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "3e19bc43-4997-4507-b932-2ab09d2718ec" (UID: "3e19bc43-4997-4507-b932-2ab09d2718ec"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:12:44.042289 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.042253 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "3e19bc43-4997-4507-b932-2ab09d2718ec" (UID: "3e19bc43-4997-4507-b932-2ab09d2718ec"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:12:44.042669 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.042643 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "3e19bc43-4997-4507-b932-2ab09d2718ec" (UID: "3e19bc43-4997-4507-b932-2ab09d2718ec"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:12:44.043181 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.043154 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e19bc43-4997-4507-b932-2ab09d2718ec-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3e19bc43-4997-4507-b932-2ab09d2718ec" (UID: "3e19bc43-4997-4507-b932-2ab09d2718ec"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:12:44.044021 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.043984 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "3e19bc43-4997-4507-b932-2ab09d2718ec" (UID: "3e19bc43-4997-4507-b932-2ab09d2718ec"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:12:44.044235 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.044203 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e19bc43-4997-4507-b932-2ab09d2718ec-kube-api-access-x2bqx" (OuterVolumeSpecName: "kube-api-access-x2bqx") pod "3e19bc43-4997-4507-b932-2ab09d2718ec" (UID: "3e19bc43-4997-4507-b932-2ab09d2718ec"). InnerVolumeSpecName "kube-api-access-x2bqx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:12:44.044336 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.044238 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "3e19bc43-4997-4507-b932-2ab09d2718ec" (UID: "3e19bc43-4997-4507-b932-2ab09d2718ec"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:12:44.044336 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.044267 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-config" (OuterVolumeSpecName: "config") pod "3e19bc43-4997-4507-b932-2ab09d2718ec" (UID: "3e19bc43-4997-4507-b932-2ab09d2718ec"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:12:44.044443 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.044398 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e19bc43-4997-4507-b932-2ab09d2718ec-config-out" (OuterVolumeSpecName: "config-out") pod "3e19bc43-4997-4507-b932-2ab09d2718ec" (UID: "3e19bc43-4997-4507-b932-2ab09d2718ec"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:12:44.053847 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.053751 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-web-config" (OuterVolumeSpecName: "web-config") pod "3e19bc43-4997-4507-b932-2ab09d2718ec" (UID: "3e19bc43-4997-4507-b932-2ab09d2718ec"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:12:44.084761 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.084734 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:12:44.139812 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.139782 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:12:44.139812 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.139811 2575 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-grpc-tls\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:12:44.139912 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.139821 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:12:44.139912 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.139830 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:12:44.139912 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.139839 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:12:44.139912 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.139849 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3e19bc43-4997-4507-b932-2ab09d2718ec-prometheus-k8s-db\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:12:44.139912 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.139858 2575 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-kube-rbac-proxy\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:12:44.139912 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.139866 2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3e19bc43-4997-4507-b932-2ab09d2718ec-config-out\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:12:44.139912 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.139874 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:12:44.139912 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.139882 2575 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:12:44.139912 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.139891 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:12:44.139912 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.139899 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2bqx\" (UniqueName: \"kubernetes.io/projected/3e19bc43-4997-4507-b932-2ab09d2718ec-kube-api-access-x2bqx\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:12:44.139912 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.139907 2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-web-config\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:12:44.139912 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.139915 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-configmap-metrics-client-ca\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:12:44.140256 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.139923 2575 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-secret-metrics-client-certs\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:12:44.140256 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.139931 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3e19bc43-4997-4507-b932-2ab09d2718ec-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:12:44.140256 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.139940 2575 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/3e19bc43-4997-4507-b932-2ab09d2718ec-config\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:12:44.140256 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.139948 2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3e19bc43-4997-4507-b932-2ab09d2718ec-tls-assets\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:12:44.904149 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.904080 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3e19bc43-4997-4507-b932-2ab09d2718ec","Type":"ContainerDied","Data":"9553fe12b0734ba262000fa8d293ab5f655e3128a1d7c46cf845086f767240fb"} Jul 23 18:12:44.904478 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.904161 2575 scope.go:117] "RemoveContainer" containerID="aefae416ff0174500b4074bd8602429924ce7cdd3d8d8a3f8bb44b209400362b" Jul 23 18:12:44.904478 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.904097 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:44.911628 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.911612 2575 scope.go:117] "RemoveContainer" containerID="a59ed7b889dedc7ed5c268a337d68a11c0d368ca2a59994c1df517c23f6e109e" Jul 23 18:12:44.918324 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.918307 2575 scope.go:117] "RemoveContainer" containerID="2e65a3a36f094e32141bc1bd6a98f2d081496ce994575a675715f63476f47f49" Jul 23 18:12:44.924322 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.924306 2575 scope.go:117] "RemoveContainer" containerID="bc757bf271b7947ec28c36a0781fea80338994966c58924fb418f95f7cf588a3" Jul 23 18:12:44.927507 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.927390 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 18:12:44.931515 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.931499 2575 scope.go:117] "RemoveContainer" containerID="b363a23f3ef8e16653f608e6126ed0ac9a5024ede8d2edd4686973cba3f55be9" Jul 23 18:12:44.931609 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.931588 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 18:12:44.937907 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.937891 2575 scope.go:117] "RemoveContainer" containerID="a65bee388e7615e6859b9d388171ebc2175a51e9a8a6d0802744e7673223e465" Jul 23 18:12:44.944731 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.944711 2575 scope.go:117] "RemoveContainer" containerID="19a2c61a4406a38c06fc67f1fb0ab34288d53a3b5883e9212d3751045702696b" Jul 23 18:12:44.958408 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.958375 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 18:12:44.958651 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.958639 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e19bc43-4997-4507-b932-2ab09d2718ec" containerName="kube-rbac-proxy-web" Jul 23 18:12:44.958714 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.958653 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e19bc43-4997-4507-b932-2ab09d2718ec" containerName="kube-rbac-proxy-web" Jul 23 18:12:44.958714 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.958664 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e19bc43-4997-4507-b932-2ab09d2718ec" containerName="kube-rbac-proxy" Jul 23 18:12:44.958714 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.958671 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e19bc43-4997-4507-b932-2ab09d2718ec" containerName="kube-rbac-proxy" Jul 23 18:12:44.958714 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.958694 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e19bc43-4997-4507-b932-2ab09d2718ec" containerName="kube-rbac-proxy-thanos" Jul 23 18:12:44.958714 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.958701 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e19bc43-4997-4507-b932-2ab09d2718ec" containerName="kube-rbac-proxy-thanos" Jul 23 18:12:44.958714 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.958712 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dffca2c1-6cb2-46ec-9842-5c20982d1581" containerName="registry" Jul 23 18:12:44.958898 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.958717 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="dffca2c1-6cb2-46ec-9842-5c20982d1581" containerName="registry" Jul 23 18:12:44.958898 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.958724 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e19bc43-4997-4507-b932-2ab09d2718ec" containerName="prometheus" Jul 23 18:12:44.958898 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.958729 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e19bc43-4997-4507-b932-2ab09d2718ec" containerName="prometheus" Jul 23 18:12:44.958898 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.958746 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c56428ef-8b94-472c-adbc-b935258966c6" containerName="console" Jul 23 18:12:44.958898 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.958752 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c56428ef-8b94-472c-adbc-b935258966c6" containerName="console" Jul 23 18:12:44.958898 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.958758 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e19bc43-4997-4507-b932-2ab09d2718ec" containerName="init-config-reloader" Jul 23 18:12:44.958898 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.958763 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e19bc43-4997-4507-b932-2ab09d2718ec" containerName="init-config-reloader" Jul 23 18:12:44.958898 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.958768 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e19bc43-4997-4507-b932-2ab09d2718ec" containerName="config-reloader" Jul 23 18:12:44.958898 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.958774 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e19bc43-4997-4507-b932-2ab09d2718ec" containerName="config-reloader" Jul 23 18:12:44.958898 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.958781 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e19bc43-4997-4507-b932-2ab09d2718ec" containerName="thanos-sidecar" Jul 23 18:12:44.958898 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.958786 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e19bc43-4997-4507-b932-2ab09d2718ec" containerName="thanos-sidecar" Jul 23 18:12:44.958898 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.958825 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e19bc43-4997-4507-b932-2ab09d2718ec" containerName="config-reloader" Jul 23 18:12:44.958898 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.958832 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c56428ef-8b94-472c-adbc-b935258966c6" containerName="console" Jul 23 18:12:44.958898 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.958838 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e19bc43-4997-4507-b932-2ab09d2718ec" containerName="kube-rbac-proxy-web" Jul 23 18:12:44.958898 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.958845 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e19bc43-4997-4507-b932-2ab09d2718ec" containerName="prometheus" Jul 23 18:12:44.958898 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.958850 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e19bc43-4997-4507-b932-2ab09d2718ec" containerName="thanos-sidecar" Jul 23 18:12:44.958898 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.958855 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e19bc43-4997-4507-b932-2ab09d2718ec" containerName="kube-rbac-proxy" Jul 23 18:12:44.958898 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.958861 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e19bc43-4997-4507-b932-2ab09d2718ec" containerName="kube-rbac-proxy-thanos" Jul 23 18:12:44.958898 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.958865 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="dffca2c1-6cb2-46ec-9842-5c20982d1581" containerName="registry" Jul 23 18:12:44.963651 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.963637 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:44.966984 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.966936 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 23 18:12:44.967199 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.967165 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 23 18:12:44.967298 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.967242 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 23 18:12:44.967382 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.967367 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-1gsm4j6j61otj\"" Jul 23 18:12:44.967593 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.967572 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-x6hd7\"" Jul 23 18:12:44.967593 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.967586 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 23 18:12:44.967736 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.967604 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 23 18:12:44.967736 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.967632 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 23 18:12:44.967736 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.967580 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 23 18:12:44.967843 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.967803 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 23 18:12:44.967915 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.967900 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 23 18:12:44.967962 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.967952 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 23 18:12:44.968124 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.968093 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 23 18:12:44.968124 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.968097 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 23 18:12:44.968450 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.968435 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 23 18:12:44.970541 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.970523 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 23 18:12:44.977333 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.975072 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 23 18:12:44.980067 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:44.980047 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 18:12:45.045974 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.045951 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06d7b08c-0739-4bf5-b399-c68f4c64b90f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.046055 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.045977 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06d7b08c-0739-4bf5-b399-c68f4c64b90f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.046055 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.045995 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06d7b08c-0739-4bf5-b399-c68f4c64b90f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.046055 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.046014 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06d7b08c-0739-4bf5-b399-c68f4c64b90f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.046055 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.046030 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/06d7b08c-0739-4bf5-b399-c68f4c64b90f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.046185 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.046066 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/06d7b08c-0739-4bf5-b399-c68f4c64b90f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.046185 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.046101 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/06d7b08c-0739-4bf5-b399-c68f4c64b90f-config\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.046185 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.046125 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06d7b08c-0739-4bf5-b399-c68f4c64b90f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.046185 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.046145 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/06d7b08c-0739-4bf5-b399-c68f4c64b90f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.046185 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.046162 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06d7b08c-0739-4bf5-b399-c68f4c64b90f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.046331 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.046184 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06d7b08c-0739-4bf5-b399-c68f4c64b90f-config-out\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.046331 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.046203 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06d7b08c-0739-4bf5-b399-c68f4c64b90f-web-config\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.046331 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.046228 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06d7b08c-0739-4bf5-b399-c68f4c64b90f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.046331 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.046261 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkdrt\" (UniqueName: \"kubernetes.io/projected/06d7b08c-0739-4bf5-b399-c68f4c64b90f-kube-api-access-pkdrt\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.046331 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.046281 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/06d7b08c-0739-4bf5-b399-c68f4c64b90f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.046331 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.046296 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06d7b08c-0739-4bf5-b399-c68f4c64b90f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.046495 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.046328 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/06d7b08c-0739-4bf5-b399-c68f4c64b90f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.046495 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.046360 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/06d7b08c-0739-4bf5-b399-c68f4c64b90f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.046495 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.046380 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/06d7b08c-0739-4bf5-b399-c68f4c64b90f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.046495 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.046395 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/06d7b08c-0739-4bf5-b399-c68f4c64b90f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.147494 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.147475 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06d7b08c-0739-4bf5-b399-c68f4c64b90f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.147589 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.147500 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06d7b08c-0739-4bf5-b399-c68f4c64b90f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.147589 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.147516 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06d7b08c-0739-4bf5-b399-c68f4c64b90f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.147589 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.147534 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06d7b08c-0739-4bf5-b399-c68f4c64b90f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.147589 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.147549 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/06d7b08c-0739-4bf5-b399-c68f4c64b90f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.147788 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.147729 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/06d7b08c-0739-4bf5-b399-c68f4c64b90f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.147788 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.147780 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/06d7b08c-0739-4bf5-b399-c68f4c64b90f-config\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.147884 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.147811 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06d7b08c-0739-4bf5-b399-c68f4c64b90f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.147884 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.147842 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/06d7b08c-0739-4bf5-b399-c68f4c64b90f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.147884 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.147874 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06d7b08c-0739-4bf5-b399-c68f4c64b90f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.148022 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.147898 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06d7b08c-0739-4bf5-b399-c68f4c64b90f-config-out\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.148022 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.147923 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06d7b08c-0739-4bf5-b399-c68f4c64b90f-web-config\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.148022 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.147938 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/06d7b08c-0739-4bf5-b399-c68f4c64b90f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.148022 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.147974 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06d7b08c-0739-4bf5-b399-c68f4c64b90f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.148022 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.148007 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkdrt\" (UniqueName: \"kubernetes.io/projected/06d7b08c-0739-4bf5-b399-c68f4c64b90f-kube-api-access-pkdrt\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.148308 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.148044 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/06d7b08c-0739-4bf5-b399-c68f4c64b90f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.148308 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.148069 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06d7b08c-0739-4bf5-b399-c68f4c64b90f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.148308 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.148093 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/06d7b08c-0739-4bf5-b399-c68f4c64b90f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.148308 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.148130 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/06d7b08c-0739-4bf5-b399-c68f4c64b90f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.148308 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.148162 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/06d7b08c-0739-4bf5-b399-c68f4c64b90f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.148308 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.148186 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/06d7b08c-0739-4bf5-b399-c68f4c64b90f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.149525 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.148545 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06d7b08c-0739-4bf5-b399-c68f4c64b90f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.149525 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.149291 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06d7b08c-0739-4bf5-b399-c68f4c64b90f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.150930 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.150907 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06d7b08c-0739-4bf5-b399-c68f4c64b90f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.151426 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.151397 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/06d7b08c-0739-4bf5-b399-c68f4c64b90f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.152156 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.151657 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/06d7b08c-0739-4bf5-b399-c68f4c64b90f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.152156 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.151769 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06d7b08c-0739-4bf5-b399-c68f4c64b90f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.152156 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.152038 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/06d7b08c-0739-4bf5-b399-c68f4c64b90f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.152156 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.152115 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06d7b08c-0739-4bf5-b399-c68f4c64b90f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.152395 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.152331 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/06d7b08c-0739-4bf5-b399-c68f4c64b90f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.152395 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.152350 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/06d7b08c-0739-4bf5-b399-c68f4c64b90f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.152718 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.152698 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06d7b08c-0739-4bf5-b399-c68f4c64b90f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.153044 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.153016 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06d7b08c-0739-4bf5-b399-c68f4c64b90f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.153143 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.153072 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/06d7b08c-0739-4bf5-b399-c68f4c64b90f-config\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.153209 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.153183 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/06d7b08c-0739-4bf5-b399-c68f4c64b90f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.153664 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.153642 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/06d7b08c-0739-4bf5-b399-c68f4c64b90f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.153769 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.153750 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/06d7b08c-0739-4bf5-b399-c68f4c64b90f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.153899 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.153881 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06d7b08c-0739-4bf5-b399-c68f4c64b90f-config-out\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.154916 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.154881 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06d7b08c-0739-4bf5-b399-c68f4c64b90f-web-config\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.158964 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.158946 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkdrt\" (UniqueName: \"kubernetes.io/projected/06d7b08c-0739-4bf5-b399-c68f4c64b90f-kube-api-access-pkdrt\") pod \"prometheus-k8s-0\" (UID: \"06d7b08c-0739-4bf5-b399-c68f4c64b90f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.272854 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.272825 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:45.408726 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.408643 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 23 18:12:45.412410 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:12:45.412384 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06d7b08c_0739_4bf5_b399_c68f4c64b90f.slice/crio-ce0b11d486196a0cb2cfcc9c66fc5b55a4e4777fffa5126d93d06b537273f991 WatchSource:0}: Error finding container ce0b11d486196a0cb2cfcc9c66fc5b55a4e4777fffa5126d93d06b537273f991: Status 404 returned error can't find the container with id ce0b11d486196a0cb2cfcc9c66fc5b55a4e4777fffa5126d93d06b537273f991 Jul 23 18:12:45.909806 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.909769 2575 generic.go:356] "Generic (PLEG): container finished" podID="06d7b08c-0739-4bf5-b399-c68f4c64b90f" containerID="b55444fa44e2b8ab94a86172cc23d1ea50c9300a092d2f5a9bcd9bd258675323" exitCode=0 Jul 23 18:12:45.910139 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.909814 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06d7b08c-0739-4bf5-b399-c68f4c64b90f","Type":"ContainerDied","Data":"b55444fa44e2b8ab94a86172cc23d1ea50c9300a092d2f5a9bcd9bd258675323"} Jul 23 18:12:45.910139 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:45.909881 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06d7b08c-0739-4bf5-b399-c68f4c64b90f","Type":"ContainerStarted","Data":"ce0b11d486196a0cb2cfcc9c66fc5b55a4e4777fffa5126d93d06b537273f991"} Jul 23 18:12:46.021041 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:46.021015 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:12:46.122189 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:46.122133 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:12:46.619163 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:46.619132 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e19bc43-4997-4507-b932-2ab09d2718ec" path="/var/lib/kubelet/pods/3e19bc43-4997-4507-b932-2ab09d2718ec/volumes" Jul 23 18:12:46.919959 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:46.919875 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06d7b08c-0739-4bf5-b399-c68f4c64b90f","Type":"ContainerStarted","Data":"41e5e21cf16679d921e4b0c3747d949ee97798e924cc5da6cfdb5b3485a52329"} Jul 23 18:12:46.919959 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:46.919942 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06d7b08c-0739-4bf5-b399-c68f4c64b90f","Type":"ContainerStarted","Data":"9d25ddc5ef52a43494aa8b71f2c2f390ecb866a3a83013f0d6e9c6b5cc275e7c"} Jul 23 18:12:46.920328 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:46.919970 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06d7b08c-0739-4bf5-b399-c68f4c64b90f","Type":"ContainerStarted","Data":"e309084954480a09073acaccc3d5e04eb5e529efe42fdeebed34f0037a3be0fb"} Jul 23 18:12:46.920328 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:46.919995 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06d7b08c-0739-4bf5-b399-c68f4c64b90f","Type":"ContainerStarted","Data":"dad5d955668d6e9b9040fc61434cf506f4a0407442f8fa0b1a9f137c0775bbe9"} Jul 23 18:12:46.920328 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:46.920021 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06d7b08c-0739-4bf5-b399-c68f4c64b90f","Type":"ContainerStarted","Data":"e4f2d71c63f8b4bccc6afc6dbbb38f57fd29a1e0bab93059890442998043184d"} Jul 23 18:12:46.920328 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:46.920045 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"06d7b08c-0739-4bf5-b399-c68f4c64b90f","Type":"ContainerStarted","Data":"8c1c5be63a59f2abb58e7d422a628af1dbf6bed0e2ae0a3386d46f1a90565628"} Jul 23 18:12:46.948616 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:46.948566 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.928320127 podStartE2EDuration="2.948547899s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.227772ms" isStatefulPod=false podCreationTimestamp="2026-07-23 18:12:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:12:46.946864026 +0000 UTC m=+388.864453746" watchObservedRunningTime="2026-07-23 18:12:46.948547899 +0000 UTC m=+388.866137600" Jul 23 18:12:50.273881 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:50.273835 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:12:50.841249 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:50.841213 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:12:50.942355 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:50.942326 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:12:55.522840 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:55.522802 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:12:55.585362 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:55.585331 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:12:55.645232 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:55.645204 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:12:56.231529 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:56.231482 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:12:56.289538 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:12:56.289508 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:13:06.077513 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:13:06.077479 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:13:06.182919 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:13:06.182884 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:13:06.248513 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:13:06.248476 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:13:43.324139 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:13:43.324049 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:13:43.420043 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:13:43.420015 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:13:45.273217 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:13:45.273183 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:13:45.288412 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:13:45.288386 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:13:46.092062 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:13:46.092026 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:13:46.149074 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:13:46.149043 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 23 18:13:46.184472 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:13:46.184438 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:14:10.156249 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:14:10.156210 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:14:10.978314 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:14:10.978274 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:14:13.765981 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:14:13.765942 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:14:13.819572 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:14:13.819540 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:14:15.312457 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:14:15.312428 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:14:15.412912 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:14:15.412881 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:14:17.762013 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:14:17.761975 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:14:17.929230 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:14:17.929198 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:14:18.554654 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:14:18.554621 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:14:18.616958 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:14:18.616917 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:14:25.328904 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:14:25.328864 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:14:27.491566 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:14:27.491518 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:14:27.599090 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:14:27.599055 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:14:28.187836 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:14:28.187807 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:14:28.250493 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:14:28.250465 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:14:38.170386 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:14:38.170350 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:14:38.270057 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:14:38.270029 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:14:48.256981 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:14:48.256944 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:14:50.271177 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:14:50.271145 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:14:58.629029 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:14:58.628996 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:14:58.728981 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:14:58.728951 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:14:58.851095 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:14:58.851062 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:15:19.144209 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:15:19.144130 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:15:28.407386 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:15:28.407346 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:15:37.033916 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:15:37.033882 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:15:38.984936 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:15:38.984900 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:15:39.088698 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:15:39.088643 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:15:49.226783 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:15:49.226747 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:15:49.323479 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:15:49.323441 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:15:49.396032 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:15:49.395997 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:16:10.526085 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:10.526030 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:16:10.577758 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:10.577725 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:16:18.539923 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:18.539897 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-plgf8_a7a1d203-b9aa-43b4-8533-188e73336f5a/console-operator/1.log" Jul 23 18:16:18.540438 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:18.540213 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-plgf8_a7a1d203-b9aa-43b4-8533-188e73336f5a/console-operator/1.log" Jul 23 18:16:36.143517 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:36.143476 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:16:37.243020 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:37.242984 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:16:38.380907 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:38.380874 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:16:38.384304 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:38.384279 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw"] Jul 23 18:16:38.387418 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:38.387404 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw" Jul 23 18:16:38.390396 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:38.390375 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 23 18:16:38.391537 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:38.391507 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jul 23 18:16:38.391537 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:38.391519 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 23 18:16:38.391717 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:38.391507 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-hs4kl\"" Jul 23 18:16:38.391717 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:38.391585 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jul 23 18:16:38.400631 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:38.400612 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw"] Jul 23 18:16:38.434668 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:38.434639 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/9a54f1e3-48ed-4559-9232-7fcff34fa720-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw\" (UID: \"9a54f1e3-48ed-4559-9232-7fcff34fa720\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw" Jul 23 18:16:38.434801 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:38.434672 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxzlm\" (UniqueName: \"kubernetes.io/projected/9a54f1e3-48ed-4559-9232-7fcff34fa720-kube-api-access-sxzlm\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw\" (UID: \"9a54f1e3-48ed-4559-9232-7fcff34fa720\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw" Jul 23 18:16:38.434801 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:38.434784 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a54f1e3-48ed-4559-9232-7fcff34fa720-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw\" (UID: \"9a54f1e3-48ed-4559-9232-7fcff34fa720\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw" Jul 23 18:16:38.535931 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:38.535903 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/9a54f1e3-48ed-4559-9232-7fcff34fa720-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw\" (UID: \"9a54f1e3-48ed-4559-9232-7fcff34fa720\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw" Jul 23 18:16:38.536033 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:38.535936 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxzlm\" (UniqueName: \"kubernetes.io/projected/9a54f1e3-48ed-4559-9232-7fcff34fa720-kube-api-access-sxzlm\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw\" (UID: \"9a54f1e3-48ed-4559-9232-7fcff34fa720\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw" Jul 23 18:16:38.536033 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:38.535991 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a54f1e3-48ed-4559-9232-7fcff34fa720-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw\" (UID: \"9a54f1e3-48ed-4559-9232-7fcff34fa720\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw" Jul 23 18:16:38.536618 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:38.536599 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/9a54f1e3-48ed-4559-9232-7fcff34fa720-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw\" (UID: \"9a54f1e3-48ed-4559-9232-7fcff34fa720\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw" Jul 23 18:16:38.538236 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:38.538194 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a54f1e3-48ed-4559-9232-7fcff34fa720-cert\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw\" (UID: \"9a54f1e3-48ed-4559-9232-7fcff34fa720\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw" Jul 23 18:16:38.545200 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:38.545179 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxzlm\" (UniqueName: \"kubernetes.io/projected/9a54f1e3-48ed-4559-9232-7fcff34fa720-kube-api-access-sxzlm\") pod \"kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw\" (UID: \"9a54f1e3-48ed-4559-9232-7fcff34fa720\") " pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw" Jul 23 18:16:38.633031 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:38.632972 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:16:38.706066 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:38.706045 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw" Jul 23 18:16:38.828514 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:38.828470 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw"] Jul 23 18:16:38.831156 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:16:38.831127 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a54f1e3_48ed_4559_9232_7fcff34fa720.slice/crio-f98b64b30666b09850fd19836d754d4c1990b3e9ed6be0858f3c01429fbddc5b WatchSource:0}: Error finding container f98b64b30666b09850fd19836d754d4c1990b3e9ed6be0858f3c01429fbddc5b: Status 404 returned error can't find the container with id f98b64b30666b09850fd19836d754d4c1990b3e9ed6be0858f3c01429fbddc5b Jul 23 18:16:38.832998 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:38.832981 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 23 18:16:39.756189 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:39.756150 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw" event={"ID":"9a54f1e3-48ed-4559-9232-7fcff34fa720","Type":"ContainerStarted","Data":"f98b64b30666b09850fd19836d754d4c1990b3e9ed6be0858f3c01429fbddc5b"} Jul 23 18:16:40.710445 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:40.710413 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:16:40.838546 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:40.838508 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:16:41.766313 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:41.766266 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw" event={"ID":"9a54f1e3-48ed-4559-9232-7fcff34fa720","Type":"ContainerStarted","Data":"d6e87b57ba5f05fc7988556a0d00888d3b12542c23a2d0971b3b0436b542528d"} Jul 23 18:16:41.766475 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:41.766434 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw" Jul 23 18:16:41.782390 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:41.782340 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw" podStartSLOduration=0.983073476 podStartE2EDuration="3.782326412s" totalImagesPullingTime="2.799252936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:16:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:16:41.781780665 +0000 UTC m=+623.699370374" watchObservedRunningTime="2026-07-23 18:16:41.782326412 +0000 UTC m=+623.699916109" Jul 23 18:16:42.597058 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:42.597024 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:16:48.328755 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:48.328723 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:16:48.384290 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:48.384261 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:16:52.115863 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:52.115829 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:16:52.170008 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:52.169981 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:16:52.225530 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:52.225498 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:16:57.776400 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:57.776366 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw" Jul 23 18:16:59.282870 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:59.282841 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-xkxnl"] Jul 23 18:16:59.283249 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:59.283050 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:16:59.286191 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:59.286176 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-xkxnl" Jul 23 18:16:59.289480 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:59.289463 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-rgx6j\"" Jul 23 18:16:59.297428 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:59.297406 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-xkxnl"] Jul 23 18:16:59.390403 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:59.390374 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzvx6\" (UniqueName: \"kubernetes.io/projected/1a2b8d4f-aebf-402a-b856-81ed08970faf-kube-api-access-fzvx6\") pod \"test-trainjob-workflow-node-0-0-xkxnl\" (UID: \"1a2b8d4f-aebf-402a-b856-81ed08970faf\") " pod="opendatahub/test-trainjob-workflow-node-0-0-xkxnl" Jul 23 18:16:59.490691 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:59.490653 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzvx6\" (UniqueName: \"kubernetes.io/projected/1a2b8d4f-aebf-402a-b856-81ed08970faf-kube-api-access-fzvx6\") pod \"test-trainjob-workflow-node-0-0-xkxnl\" (UID: \"1a2b8d4f-aebf-402a-b856-81ed08970faf\") " pod="opendatahub/test-trainjob-workflow-node-0-0-xkxnl" Jul 23 18:16:59.499649 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:59.499617 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzvx6\" (UniqueName: \"kubernetes.io/projected/1a2b8d4f-aebf-402a-b856-81ed08970faf-kube-api-access-fzvx6\") pod \"test-trainjob-workflow-node-0-0-xkxnl\" (UID: \"1a2b8d4f-aebf-402a-b856-81ed08970faf\") " pod="opendatahub/test-trainjob-workflow-node-0-0-xkxnl" Jul 23 18:16:59.594730 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:59.594656 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-xkxnl" Jul 23 18:16:59.718468 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:59.718446 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-xkxnl"] Jul 23 18:16:59.720965 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:16:59.720939 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a2b8d4f_aebf_402a_b856_81ed08970faf.slice/crio-a75a8708575ec6a648fbddd6c0b788c1cb0f05e0b12a5cae9ad6667f5bddc8b3 WatchSource:0}: Error finding container a75a8708575ec6a648fbddd6c0b788c1cb0f05e0b12a5cae9ad6667f5bddc8b3: Status 404 returned error can't find the container with id a75a8708575ec6a648fbddd6c0b788c1cb0f05e0b12a5cae9ad6667f5bddc8b3 Jul 23 18:16:59.832383 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:16:59.832358 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-xkxnl" event={"ID":"1a2b8d4f-aebf-402a-b856-81ed08970faf","Type":"ContainerStarted","Data":"a75a8708575ec6a648fbddd6c0b788c1cb0f05e0b12a5cae9ad6667f5bddc8b3"} Jul 23 18:17:01.079598 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:17:01.079529 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:17:01.177346 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:17:01.177314 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:18:15.172872 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:15.172832 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-xkxnl" event={"ID":"1a2b8d4f-aebf-402a-b856-81ed08970faf","Type":"ContainerStarted","Data":"0cc1eefc766db32df998f1cea399de0bd5012ec2b9d69fe0bb0a6a84cf2a690c"} Jul 23 18:18:15.192067 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:15.192016 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-trainjob-workflow-node-0-0-xkxnl" podStartSLOduration=1.681835588 podStartE2EDuration="1m16.191999898s" totalImagesPullingTime="1m14.51016431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:16:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:18:15.190707224 +0000 UTC m=+717.108296922" watchObservedRunningTime="2026-07-23 18:18:15.191999898 +0000 UTC m=+717.109589597" Jul 23 18:18:17.182241 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:17.182209 2575 generic.go:356] "Generic (PLEG): container finished" podID="1a2b8d4f-aebf-402a-b856-81ed08970faf" containerID="0cc1eefc766db32df998f1cea399de0bd5012ec2b9d69fe0bb0a6a84cf2a690c" exitCode=0 Jul 23 18:18:17.182669 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:17.182282 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-xkxnl" event={"ID":"1a2b8d4f-aebf-402a-b856-81ed08970faf","Type":"ContainerDied","Data":"0cc1eefc766db32df998f1cea399de0bd5012ec2b9d69fe0bb0a6a84cf2a690c"} Jul 23 18:18:18.339060 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:18.339031 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-xkxnl" Jul 23 18:18:18.370782 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:18.370760 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzvx6\" (UniqueName: \"kubernetes.io/projected/1a2b8d4f-aebf-402a-b856-81ed08970faf-kube-api-access-fzvx6\") pod \"1a2b8d4f-aebf-402a-b856-81ed08970faf\" (UID: \"1a2b8d4f-aebf-402a-b856-81ed08970faf\") " Jul 23 18:18:18.372786 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:18.372753 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a2b8d4f-aebf-402a-b856-81ed08970faf-kube-api-access-fzvx6" (OuterVolumeSpecName: "kube-api-access-fzvx6") pod "1a2b8d4f-aebf-402a-b856-81ed08970faf" (UID: "1a2b8d4f-aebf-402a-b856-81ed08970faf"). InnerVolumeSpecName "kube-api-access-fzvx6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:18:18.472028 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:18.471976 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzvx6\" (UniqueName: \"kubernetes.io/projected/1a2b8d4f-aebf-402a-b856-81ed08970faf-kube-api-access-fzvx6\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:18:19.191265 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:19.191232 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-xkxnl" event={"ID":"1a2b8d4f-aebf-402a-b856-81ed08970faf","Type":"ContainerDied","Data":"a75a8708575ec6a648fbddd6c0b788c1cb0f05e0b12a5cae9ad6667f5bddc8b3"} Jul 23 18:18:19.191265 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:19.191261 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-xkxnl" Jul 23 18:18:19.191265 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:19.191269 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a75a8708575ec6a648fbddd6c0b788c1cb0f05e0b12a5cae9ad6667f5bddc8b3" Jul 23 18:18:19.558319 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:19.558245 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-xkxnl"] Jul 23 18:18:19.561606 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:19.561583 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-xkxnl"] Jul 23 18:18:19.590371 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:19.590350 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:18:19.688791 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:19.688764 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw"] Jul 23 18:18:19.688945 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:19.688921 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw" podUID="9a54f1e3-48ed-4559-9232-7fcff34fa720" containerName="manager" containerID="cri-o://d6e87b57ba5f05fc7988556a0d00888d3b12542c23a2d0971b3b0436b542528d" gracePeriod=30 Jul 23 18:18:19.705450 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:19.705403 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:18:19.968712 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:19.968665 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw" Jul 23 18:18:19.971143 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:19.971122 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jhttc/must-gather-8chnq"] Jul 23 18:18:19.971445 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:19.971429 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a2b8d4f-aebf-402a-b856-81ed08970faf" containerName="node" Jul 23 18:18:19.971486 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:19.971449 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a2b8d4f-aebf-402a-b856-81ed08970faf" containerName="node" Jul 23 18:18:19.971519 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:19.971484 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a54f1e3-48ed-4559-9232-7fcff34fa720" containerName="manager" Jul 23 18:18:19.971519 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:19.971493 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a54f1e3-48ed-4559-9232-7fcff34fa720" containerName="manager" Jul 23 18:18:19.971578 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:19.971552 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a2b8d4f-aebf-402a-b856-81ed08970faf" containerName="node" Jul 23 18:18:19.971578 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:19.971566 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a54f1e3-48ed-4559-9232-7fcff34fa720" containerName="manager" Jul 23 18:18:19.983461 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:19.983437 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxzlm\" (UniqueName: \"kubernetes.io/projected/9a54f1e3-48ed-4559-9232-7fcff34fa720-kube-api-access-sxzlm\") pod \"9a54f1e3-48ed-4559-9232-7fcff34fa720\" (UID: \"9a54f1e3-48ed-4559-9232-7fcff34fa720\") " Jul 23 18:18:19.983603 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:19.983476 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/9a54f1e3-48ed-4559-9232-7fcff34fa720-kubeflow-trainer-config\") pod \"9a54f1e3-48ed-4559-9232-7fcff34fa720\" (UID: \"9a54f1e3-48ed-4559-9232-7fcff34fa720\") " Jul 23 18:18:19.983603 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:19.983529 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a54f1e3-48ed-4559-9232-7fcff34fa720-cert\") pod \"9a54f1e3-48ed-4559-9232-7fcff34fa720\" (UID: \"9a54f1e3-48ed-4559-9232-7fcff34fa720\") " Jul 23 18:18:19.986197 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:19.986174 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a54f1e3-48ed-4559-9232-7fcff34fa720-cert" (OuterVolumeSpecName: "cert") pod "9a54f1e3-48ed-4559-9232-7fcff34fa720" (UID: "9a54f1e3-48ed-4559-9232-7fcff34fa720"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 23 18:18:19.986324 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:19.986177 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a54f1e3-48ed-4559-9232-7fcff34fa720-kube-api-access-sxzlm" (OuterVolumeSpecName: "kube-api-access-sxzlm") pod "9a54f1e3-48ed-4559-9232-7fcff34fa720" (UID: "9a54f1e3-48ed-4559-9232-7fcff34fa720"). InnerVolumeSpecName "kube-api-access-sxzlm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:18:19.986739 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:19.986695 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jhttc/must-gather-8chnq"] Jul 23 18:18:19.986855 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:19.986788 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jhttc/must-gather-8chnq" Jul 23 18:18:19.989210 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:19.989180 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a54f1e3-48ed-4559-9232-7fcff34fa720-kubeflow-trainer-config" (OuterVolumeSpecName: "kubeflow-trainer-config") pod "9a54f1e3-48ed-4559-9232-7fcff34fa720" (UID: "9a54f1e3-48ed-4559-9232-7fcff34fa720"). InnerVolumeSpecName "kubeflow-trainer-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 23 18:18:19.989729 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:19.989709 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jhttc\"/\"kube-root-ca.crt\"" Jul 23 18:18:19.989831 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:19.989784 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jhttc\"/\"openshift-service-ca.crt\"" Jul 23 18:18:19.989831 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:19.989808 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jhttc\"/\"default-dockercfg-7q8lc\"" Jul 23 18:18:20.084309 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:20.084256 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8501e8a2-57db-4e39-b721-bf3a9a70b145-must-gather-output\") pod \"must-gather-8chnq\" (UID: \"8501e8a2-57db-4e39-b721-bf3a9a70b145\") " pod="openshift-must-gather-jhttc/must-gather-8chnq" Jul 23 18:18:20.084309 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:20.084284 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkwpt\" (UniqueName: \"kubernetes.io/projected/8501e8a2-57db-4e39-b721-bf3a9a70b145-kube-api-access-hkwpt\") pod \"must-gather-8chnq\" (UID: \"8501e8a2-57db-4e39-b721-bf3a9a70b145\") " pod="openshift-must-gather-jhttc/must-gather-8chnq" Jul 23 18:18:20.084439 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:20.084331 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxzlm\" (UniqueName: \"kubernetes.io/projected/9a54f1e3-48ed-4559-9232-7fcff34fa720-kube-api-access-sxzlm\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:18:20.084439 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:20.084341 2575 reconciler_common.go:299] "Volume detached for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/9a54f1e3-48ed-4559-9232-7fcff34fa720-kubeflow-trainer-config\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:18:20.084439 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:20.084350 2575 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a54f1e3-48ed-4559-9232-7fcff34fa720-cert\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:18:20.185105 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:20.185085 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8501e8a2-57db-4e39-b721-bf3a9a70b145-must-gather-output\") pod \"must-gather-8chnq\" (UID: \"8501e8a2-57db-4e39-b721-bf3a9a70b145\") " pod="openshift-must-gather-jhttc/must-gather-8chnq" Jul 23 18:18:20.185195 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:20.185109 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkwpt\" (UniqueName: \"kubernetes.io/projected/8501e8a2-57db-4e39-b721-bf3a9a70b145-kube-api-access-hkwpt\") pod \"must-gather-8chnq\" (UID: \"8501e8a2-57db-4e39-b721-bf3a9a70b145\") " pod="openshift-must-gather-jhttc/must-gather-8chnq" Jul 23 18:18:20.185394 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:20.185378 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8501e8a2-57db-4e39-b721-bf3a9a70b145-must-gather-output\") pod \"must-gather-8chnq\" (UID: \"8501e8a2-57db-4e39-b721-bf3a9a70b145\") " pod="openshift-must-gather-jhttc/must-gather-8chnq" Jul 23 18:18:20.193536 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:20.193499 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkwpt\" (UniqueName: \"kubernetes.io/projected/8501e8a2-57db-4e39-b721-bf3a9a70b145-kube-api-access-hkwpt\") pod \"must-gather-8chnq\" (UID: \"8501e8a2-57db-4e39-b721-bf3a9a70b145\") " pod="openshift-must-gather-jhttc/must-gather-8chnq" Jul 23 18:18:20.196242 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:20.196219 2575 generic.go:356] "Generic (PLEG): container finished" podID="9a54f1e3-48ed-4559-9232-7fcff34fa720" containerID="d6e87b57ba5f05fc7988556a0d00888d3b12542c23a2d0971b3b0436b542528d" exitCode=0 Jul 23 18:18:20.196329 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:20.196258 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw" Jul 23 18:18:20.196329 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:20.196297 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw" event={"ID":"9a54f1e3-48ed-4559-9232-7fcff34fa720","Type":"ContainerDied","Data":"d6e87b57ba5f05fc7988556a0d00888d3b12542c23a2d0971b3b0436b542528d"} Jul 23 18:18:20.196409 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:20.196331 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw" event={"ID":"9a54f1e3-48ed-4559-9232-7fcff34fa720","Type":"ContainerDied","Data":"f98b64b30666b09850fd19836d754d4c1990b3e9ed6be0858f3c01429fbddc5b"} Jul 23 18:18:20.196409 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:20.196352 2575 scope.go:117] "RemoveContainer" containerID="d6e87b57ba5f05fc7988556a0d00888d3b12542c23a2d0971b3b0436b542528d" Jul 23 18:18:20.204418 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:20.204401 2575 scope.go:117] "RemoveContainer" containerID="d6e87b57ba5f05fc7988556a0d00888d3b12542c23a2d0971b3b0436b542528d" Jul 23 18:18:20.204688 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:18:20.204656 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6e87b57ba5f05fc7988556a0d00888d3b12542c23a2d0971b3b0436b542528d\": container with ID starting with d6e87b57ba5f05fc7988556a0d00888d3b12542c23a2d0971b3b0436b542528d not found: ID does not exist" containerID="d6e87b57ba5f05fc7988556a0d00888d3b12542c23a2d0971b3b0436b542528d" Jul 23 18:18:20.204759 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:20.204695 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6e87b57ba5f05fc7988556a0d00888d3b12542c23a2d0971b3b0436b542528d"} err="failed to get container status \"d6e87b57ba5f05fc7988556a0d00888d3b12542c23a2d0971b3b0436b542528d\": rpc error: code = NotFound desc = could not find container \"d6e87b57ba5f05fc7988556a0d00888d3b12542c23a2d0971b3b0436b542528d\": container with ID starting with d6e87b57ba5f05fc7988556a0d00888d3b12542c23a2d0971b3b0436b542528d not found: ID does not exist" Jul 23 18:18:20.221999 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:20.221975 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw"] Jul 23 18:18:20.226864 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:20.226827 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-7b4fcbc79d-z97sw"] Jul 23 18:18:20.231087 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:18:20.231068 2575 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a54f1e3_48ed_4559_9232_7fcff34fa720.slice/crio-f98b64b30666b09850fd19836d754d4c1990b3e9ed6be0858f3c01429fbddc5b\": RecentStats: unable to find data in memory cache]" Jul 23 18:18:20.246118 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:20.246101 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:18:20.305287 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:20.305262 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jhttc/must-gather-8chnq" Jul 23 18:18:20.346075 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:20.346052 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:18:20.454807 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:20.454785 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jhttc/must-gather-8chnq"] Jul 23 18:18:20.456747 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:18:20.456720 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8501e8a2_57db_4e39_b721_bf3a9a70b145.slice/crio-3d08dda22d38b5e7340f7b856d6fcd4d8737a3abfc9fa5533ba32f438bdffc4e WatchSource:0}: Error finding container 3d08dda22d38b5e7340f7b856d6fcd4d8737a3abfc9fa5533ba32f438bdffc4e: Status 404 returned error can't find the container with id 3d08dda22d38b5e7340f7b856d6fcd4d8737a3abfc9fa5533ba32f438bdffc4e Jul 23 18:18:20.619247 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:20.619218 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a2b8d4f-aebf-402a-b856-81ed08970faf" path="/var/lib/kubelet/pods/1a2b8d4f-aebf-402a-b856-81ed08970faf/volumes" Jul 23 18:18:20.619575 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:20.619563 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a54f1e3-48ed-4559-9232-7fcff34fa720" path="/var/lib/kubelet/pods/9a54f1e3-48ed-4559-9232-7fcff34fa720/volumes" Jul 23 18:18:21.201168 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:21.201135 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jhttc/must-gather-8chnq" event={"ID":"8501e8a2-57db-4e39-b721-bf3a9a70b145","Type":"ContainerStarted","Data":"3d08dda22d38b5e7340f7b856d6fcd4d8737a3abfc9fa5533ba32f438bdffc4e"} Jul 23 18:18:29.237810 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:29.237764 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jhttc/must-gather-8chnq" event={"ID":"8501e8a2-57db-4e39-b721-bf3a9a70b145","Type":"ContainerStarted","Data":"48c084ff077c00c0f5f0b0078a4c26846f253dab36222a2df658ffdb0061afda"} Jul 23 18:18:29.238338 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:29.237820 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jhttc/must-gather-8chnq" event={"ID":"8501e8a2-57db-4e39-b721-bf3a9a70b145","Type":"ContainerStarted","Data":"1569410e2fa3120b7fba9335025ccd9f6968090c54d2b59289180440ec79a4dd"} Jul 23 18:18:29.254276 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:18:29.254224 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jhttc/must-gather-8chnq" podStartSLOduration=2.364366935 podStartE2EDuration="10.254208615s" totalImagesPullingTime="7.88984168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-23 18:18:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:18:29.253501979 +0000 UTC m=+731.171091676" watchObservedRunningTime="2026-07-23 18:18:29.254208615 +0000 UTC m=+731.171798315" Jul 23 18:19:12.436518 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:12.436489 2575 generic.go:356] "Generic (PLEG): container finished" podID="8501e8a2-57db-4e39-b721-bf3a9a70b145" containerID="1569410e2fa3120b7fba9335025ccd9f6968090c54d2b59289180440ec79a4dd" exitCode=0 Jul 23 18:19:12.436873 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:12.436533 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jhttc/must-gather-8chnq" event={"ID":"8501e8a2-57db-4e39-b721-bf3a9a70b145","Type":"ContainerDied","Data":"1569410e2fa3120b7fba9335025ccd9f6968090c54d2b59289180440ec79a4dd"} Jul 23 18:19:12.436873 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:12.436841 2575 scope.go:117] "RemoveContainer" containerID="1569410e2fa3120b7fba9335025ccd9f6968090c54d2b59289180440ec79a4dd" Jul 23 18:19:13.421651 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:13.421626 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-jhttc_must-gather-8chnq_8501e8a2-57db-4e39-b721-bf3a9a70b145/gather/0.log" Jul 23 18:19:13.789946 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:13.789881 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:19:13.941695 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:13.941649 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:19:13.997961 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:13.997934 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:19:16.467712 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:16.467685 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-v4vxx_3ec5e15a-5e12-4225-becb-4590f3039255/global-pull-secret-syncer/0.log" Jul 23 18:19:16.509889 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:16.509868 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" Jul 23 18:19:16.613810 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:16.613788 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-200.ec2.internal_2a94965afd49ccda17885f2b9c0f7cb3/haproxy/0.log" Jul 23 18:19:18.771375 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:18.771343 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-jhttc/must-gather-8chnq"] Jul 23 18:19:18.771741 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:18.771503 2575 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-jhttc/must-gather-8chnq" podUID="8501e8a2-57db-4e39-b721-bf3a9a70b145" containerName="copy" containerID="cri-o://48c084ff077c00c0f5f0b0078a4c26846f253dab36222a2df658ffdb0061afda" gracePeriod=2 Jul 23 18:19:18.774299 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:19:18.774250 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-8chnq\" is forbidden: User \"system:node:ip-10-0-135-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-jhttc\": no relationship found between node 'ip-10-0-135-200.ec2.internal' and this object" podUID="8501e8a2-57db-4e39-b721-bf3a9a70b145" pod="openshift-must-gather-jhttc/must-gather-8chnq" Jul 23 18:19:18.774506 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:18.774486 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-jhttc/must-gather-8chnq"] Jul 23 18:19:19.010003 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:19.009976 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-jhttc_must-gather-8chnq_8501e8a2-57db-4e39-b721-bf3a9a70b145/copy/0.log" Jul 23 18:19:19.012590 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:19.012570 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jhttc/must-gather-8chnq" Jul 23 18:19:19.015191 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:19:19.015168 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-8chnq\" is forbidden: User \"system:node:ip-10-0-135-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-jhttc\": no relationship found between node 'ip-10-0-135-200.ec2.internal' and this object" podUID="8501e8a2-57db-4e39-b721-bf3a9a70b145" pod="openshift-must-gather-jhttc/must-gather-8chnq" Jul 23 18:19:19.064530 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:19.064505 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8501e8a2-57db-4e39-b721-bf3a9a70b145-must-gather-output\") pod \"8501e8a2-57db-4e39-b721-bf3a9a70b145\" (UID: \"8501e8a2-57db-4e39-b721-bf3a9a70b145\") " Jul 23 18:19:19.064622 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:19.064599 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkwpt\" (UniqueName: \"kubernetes.io/projected/8501e8a2-57db-4e39-b721-bf3a9a70b145-kube-api-access-hkwpt\") pod \"8501e8a2-57db-4e39-b721-bf3a9a70b145\" (UID: \"8501e8a2-57db-4e39-b721-bf3a9a70b145\") " Jul 23 18:19:19.065807 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:19.065786 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8501e8a2-57db-4e39-b721-bf3a9a70b145-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "8501e8a2-57db-4e39-b721-bf3a9a70b145" (UID: "8501e8a2-57db-4e39-b721-bf3a9a70b145"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 23 18:19:19.066616 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:19.066590 2575 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8501e8a2-57db-4e39-b721-bf3a9a70b145-kube-api-access-hkwpt" (OuterVolumeSpecName: "kube-api-access-hkwpt") pod "8501e8a2-57db-4e39-b721-bf3a9a70b145" (UID: "8501e8a2-57db-4e39-b721-bf3a9a70b145"). InnerVolumeSpecName "kube-api-access-hkwpt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 23 18:19:19.165220 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:19.165166 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkwpt\" (UniqueName: \"kubernetes.io/projected/8501e8a2-57db-4e39-b721-bf3a9a70b145-kube-api-access-hkwpt\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:19:19.165220 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:19.165186 2575 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8501e8a2-57db-4e39-b721-bf3a9a70b145-must-gather-output\") on node \"ip-10-0-135-200.ec2.internal\" DevicePath \"\"" Jul 23 18:19:19.424380 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:19.424305 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:19:19.462752 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:19.462733 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-jhttc_must-gather-8chnq_8501e8a2-57db-4e39-b721-bf3a9a70b145/copy/0.log" Jul 23 18:19:19.463072 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:19.463053 2575 generic.go:356] "Generic (PLEG): container finished" podID="8501e8a2-57db-4e39-b721-bf3a9a70b145" containerID="48c084ff077c00c0f5f0b0078a4c26846f253dab36222a2df658ffdb0061afda" exitCode=143 Jul 23 18:19:19.463125 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:19.463100 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jhttc/must-gather-8chnq" Jul 23 18:19:19.463162 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:19.463123 2575 scope.go:117] "RemoveContainer" containerID="48c084ff077c00c0f5f0b0078a4c26846f253dab36222a2df658ffdb0061afda" Jul 23 18:19:19.465490 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:19:19.465465 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-8chnq\" is forbidden: User \"system:node:ip-10-0-135-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-jhttc\": no relationship found between node 'ip-10-0-135-200.ec2.internal' and this object" podUID="8501e8a2-57db-4e39-b721-bf3a9a70b145" pod="openshift-must-gather-jhttc/must-gather-8chnq" Jul 23 18:19:19.471578 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:19.471560 2575 scope.go:117] "RemoveContainer" containerID="1569410e2fa3120b7fba9335025ccd9f6968090c54d2b59289180440ec79a4dd" Jul 23 18:19:19.474073 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:19:19.474047 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-8chnq\" is forbidden: User \"system:node:ip-10-0-135-200.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-jhttc\": no relationship found between node 'ip-10-0-135-200.ec2.internal' and this object" podUID="8501e8a2-57db-4e39-b721-bf3a9a70b145" pod="openshift-must-gather-jhttc/must-gather-8chnq" Jul 23 18:19:19.480112 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:19.480092 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gbpfx_9b95f1a4-e3e4-416b-a987-7d6aae5ac214/konnectivity-agent/0.log" limit=1024 Jul 23 18:19:19.482231 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:19.482216 2575 scope.go:117] "RemoveContainer" containerID="48c084ff077c00c0f5f0b0078a4c26846f253dab36222a2df658ffdb0061afda" Jul 23 18:19:19.482493 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:19:19.482475 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48c084ff077c00c0f5f0b0078a4c26846f253dab36222a2df658ffdb0061afda\": container with ID starting with 48c084ff077c00c0f5f0b0078a4c26846f253dab36222a2df658ffdb0061afda not found: ID does not exist" containerID="48c084ff077c00c0f5f0b0078a4c26846f253dab36222a2df658ffdb0061afda" Jul 23 18:19:19.482540 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:19.482501 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48c084ff077c00c0f5f0b0078a4c26846f253dab36222a2df658ffdb0061afda"} err="failed to get container status \"48c084ff077c00c0f5f0b0078a4c26846f253dab36222a2df658ffdb0061afda\": rpc error: code = NotFound desc = could not find container \"48c084ff077c00c0f5f0b0078a4c26846f253dab36222a2df658ffdb0061afda\": container with ID starting with 48c084ff077c00c0f5f0b0078a4c26846f253dab36222a2df658ffdb0061afda not found: ID does not exist" Jul 23 18:19:19.482540 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:19.482517 2575 scope.go:117] "RemoveContainer" containerID="1569410e2fa3120b7fba9335025ccd9f6968090c54d2b59289180440ec79a4dd" Jul 23 18:19:19.482741 ip-10-0-135-200 kubenswrapper[2575]: E0723 18:19:19.482724 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1569410e2fa3120b7fba9335025ccd9f6968090c54d2b59289180440ec79a4dd\": container with ID starting with 1569410e2fa3120b7fba9335025ccd9f6968090c54d2b59289180440ec79a4dd not found: ID does not exist" containerID="1569410e2fa3120b7fba9335025ccd9f6968090c54d2b59289180440ec79a4dd" Jul 23 18:19:19.482791 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:19.482746 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1569410e2fa3120b7fba9335025ccd9f6968090c54d2b59289180440ec79a4dd"} err="failed to get container status \"1569410e2fa3120b7fba9335025ccd9f6968090c54d2b59289180440ec79a4dd\": rpc error: code = NotFound desc = could not find container \"1569410e2fa3120b7fba9335025ccd9f6968090c54d2b59289180440ec79a4dd\": container with ID starting with 1569410e2fa3120b7fba9335025ccd9f6968090c54d2b59289180440ec79a4dd not found: ID does not exist" Jul 23 18:19:20.152385 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:20.152356 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bzzvl_49cf608f-3e57-43b4-8423-8648f976b919/node-exporter/0.log" Jul 23 18:19:20.171709 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:20.171671 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bzzvl_49cf608f-3e57-43b4-8423-8648f976b919/kube-rbac-proxy/0.log" Jul 23 18:19:20.207908 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:20.207890 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bzzvl_49cf608f-3e57-43b4-8423-8648f976b919/init-textfile/0.log" Jul 23 18:19:20.391453 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:20.391393 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-r9r58_c410a776-1a1e-4616-8e41-ab4ee03b4d64/kube-rbac-proxy-main/0.log" Jul 23 18:19:20.415544 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:20.415525 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-r9r58_c410a776-1a1e-4616-8e41-ab4ee03b4d64/kube-rbac-proxy-self/0.log" Jul 23 18:19:20.439620 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:20.439601 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-r9r58_c410a776-1a1e-4616-8e41-ab4ee03b4d64/openshift-state-metrics/0.log" Jul 23 18:19:20.488056 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:20.488040 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06d7b08c-0739-4bf5-b399-c68f4c64b90f/prometheus/0.log" Jul 23 18:19:20.510445 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:20.510426 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06d7b08c-0739-4bf5-b399-c68f4c64b90f/config-reloader/0.log" Jul 23 18:19:20.535720 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:20.535692 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06d7b08c-0739-4bf5-b399-c68f4c64b90f/thanos-sidecar/0.log" Jul 23 18:19:20.555365 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:20.555338 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06d7b08c-0739-4bf5-b399-c68f4c64b90f/kube-rbac-proxy-web/0.log" Jul 23 18:19:20.575457 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:20.575439 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06d7b08c-0739-4bf5-b399-c68f4c64b90f/kube-rbac-proxy/0.log" Jul 23 18:19:20.598609 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:20.598588 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06d7b08c-0739-4bf5-b399-c68f4c64b90f/kube-rbac-proxy-thanos/0.log" Jul 23 18:19:20.618409 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:20.618388 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8501e8a2-57db-4e39-b721-bf3a9a70b145" path="/var/lib/kubelet/pods/8501e8a2-57db-4e39-b721-bf3a9a70b145/volumes" Jul 23 18:19:20.623213 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:20.623196 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_06d7b08c-0739-4bf5-b399-c68f4c64b90f/init-config-reloader/0.log" Jul 23 18:19:20.692703 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:20.692616 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-zl4fr_b58eaec7-0aaa-484a-bd01-12d48cbec132/prometheus-operator-admission-webhook/0.log" Jul 23 18:19:22.132988 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:22.132959 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-dsjsx_720bc518-628e-4cc4-a1cb-b626cfad39dc/networking-console-plugin/0.log" Jul 23 18:19:22.628695 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:22.628654 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-plgf8_a7a1d203-b9aa-43b4-8533-188e73336f5a/console-operator/1.log" Jul 23 18:19:22.632892 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:22.632872 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-plgf8_a7a1d203-b9aa-43b4-8533-188e73336f5a/console-operator/2.log" Jul 23 18:19:23.038870 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:23.038795 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-lk8q6_f4b1d517-c159-4ef3-aeec-f25cba7cc5fb/download-server/0.log" Jul 23 18:19:24.103159 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:24.103130 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-v2h2z/perf-node-gather-daemonset-mtn9z"] Jul 23 18:19:24.103508 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:24.103432 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8501e8a2-57db-4e39-b721-bf3a9a70b145" containerName="gather" Jul 23 18:19:24.103508 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:24.103447 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8501e8a2-57db-4e39-b721-bf3a9a70b145" containerName="gather" Jul 23 18:19:24.103508 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:24.103454 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8501e8a2-57db-4e39-b721-bf3a9a70b145" containerName="copy" Jul 23 18:19:24.103508 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:24.103462 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8501e8a2-57db-4e39-b721-bf3a9a70b145" containerName="copy" Jul 23 18:19:24.103508 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:24.103508 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8501e8a2-57db-4e39-b721-bf3a9a70b145" containerName="copy" Jul 23 18:19:24.103664 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:24.103520 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8501e8a2-57db-4e39-b721-bf3a9a70b145" containerName="gather" Jul 23 18:19:24.108445 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:24.108415 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-mtn9z" Jul 23 18:19:24.111370 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:24.111352 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v2h2z\"/\"kube-root-ca.crt\"" Jul 23 18:19:24.112569 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:24.112554 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-v2h2z\"/\"default-dockercfg-bnlz8\"" Jul 23 18:19:24.112659 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:24.112579 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v2h2z\"/\"openshift-service-ca.crt\"" Jul 23 18:19:24.115553 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:24.115531 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v2h2z/perf-node-gather-daemonset-mtn9z"] Jul 23 18:19:24.200345 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:24.200317 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69110efe-2173-480e-b76d-e6e3c28b9c88-sys\") pod \"perf-node-gather-daemonset-mtn9z\" (UID: \"69110efe-2173-480e-b76d-e6e3c28b9c88\") " pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-mtn9z" Jul 23 18:19:24.200451 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:24.200359 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/69110efe-2173-480e-b76d-e6e3c28b9c88-proc\") pod \"perf-node-gather-daemonset-mtn9z\" (UID: \"69110efe-2173-480e-b76d-e6e3c28b9c88\") " pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-mtn9z" Jul 23 18:19:24.200525 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:24.200476 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/69110efe-2173-480e-b76d-e6e3c28b9c88-podres\") pod \"perf-node-gather-daemonset-mtn9z\" (UID: \"69110efe-2173-480e-b76d-e6e3c28b9c88\") " pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-mtn9z" Jul 23 18:19:24.200525 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:24.200514 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69110efe-2173-480e-b76d-e6e3c28b9c88-lib-modules\") pod \"perf-node-gather-daemonset-mtn9z\" (UID: \"69110efe-2173-480e-b76d-e6e3c28b9c88\") " pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-mtn9z" Jul 23 18:19:24.200628 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:24.200562 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zzg2\" (UniqueName: \"kubernetes.io/projected/69110efe-2173-480e-b76d-e6e3c28b9c88-kube-api-access-6zzg2\") pod \"perf-node-gather-daemonset-mtn9z\" (UID: \"69110efe-2173-480e-b76d-e6e3c28b9c88\") " pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-mtn9z" Jul 23 18:19:24.301583 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:24.301559 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/69110efe-2173-480e-b76d-e6e3c28b9c88-podres\") pod \"perf-node-gather-daemonset-mtn9z\" (UID: \"69110efe-2173-480e-b76d-e6e3c28b9c88\") " pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-mtn9z" Jul 23 18:19:24.301697 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:24.301588 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69110efe-2173-480e-b76d-e6e3c28b9c88-lib-modules\") pod \"perf-node-gather-daemonset-mtn9z\" (UID: \"69110efe-2173-480e-b76d-e6e3c28b9c88\") " pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-mtn9z" Jul 23 18:19:24.301697 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:24.301611 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zzg2\" (UniqueName: \"kubernetes.io/projected/69110efe-2173-480e-b76d-e6e3c28b9c88-kube-api-access-6zzg2\") pod \"perf-node-gather-daemonset-mtn9z\" (UID: \"69110efe-2173-480e-b76d-e6e3c28b9c88\") " pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-mtn9z" Jul 23 18:19:24.301697 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:24.301629 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69110efe-2173-480e-b76d-e6e3c28b9c88-sys\") pod \"perf-node-gather-daemonset-mtn9z\" (UID: \"69110efe-2173-480e-b76d-e6e3c28b9c88\") " pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-mtn9z" Jul 23 18:19:24.301697 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:24.301663 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/69110efe-2173-480e-b76d-e6e3c28b9c88-proc\") pod \"perf-node-gather-daemonset-mtn9z\" (UID: \"69110efe-2173-480e-b76d-e6e3c28b9c88\") " pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-mtn9z" Jul 23 18:19:24.301870 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:24.301744 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/69110efe-2173-480e-b76d-e6e3c28b9c88-sys\") pod \"perf-node-gather-daemonset-mtn9z\" (UID: \"69110efe-2173-480e-b76d-e6e3c28b9c88\") " pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-mtn9z" Jul 23 18:19:24.301870 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:24.301763 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/69110efe-2173-480e-b76d-e6e3c28b9c88-lib-modules\") pod \"perf-node-gather-daemonset-mtn9z\" (UID: \"69110efe-2173-480e-b76d-e6e3c28b9c88\") " pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-mtn9z" Jul 23 18:19:24.301870 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:24.301772 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/69110efe-2173-480e-b76d-e6e3c28b9c88-proc\") pod \"perf-node-gather-daemonset-mtn9z\" (UID: \"69110efe-2173-480e-b76d-e6e3c28b9c88\") " pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-mtn9z" Jul 23 18:19:24.301870 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:24.301763 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/69110efe-2173-480e-b76d-e6e3c28b9c88-podres\") pod \"perf-node-gather-daemonset-mtn9z\" (UID: \"69110efe-2173-480e-b76d-e6e3c28b9c88\") " pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-mtn9z" Jul 23 18:19:24.309481 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:24.309459 2575 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zzg2\" (UniqueName: \"kubernetes.io/projected/69110efe-2173-480e-b76d-e6e3c28b9c88-kube-api-access-6zzg2\") pod \"perf-node-gather-daemonset-mtn9z\" (UID: \"69110efe-2173-480e-b76d-e6e3c28b9c88\") " pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-mtn9z" Jul 23 18:19:24.312390 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:24.312360 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6qdgb_98381009-83a2-4c5c-9e31-267ab47e7edc/dns/0.log" Jul 23 18:19:24.337622 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:24.337600 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6qdgb_98381009-83a2-4c5c-9e31-267ab47e7edc/kube-rbac-proxy/0.log" Jul 23 18:19:24.418594 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:24.418571 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-mtn9z" Jul 23 18:19:24.441153 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:24.441135 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-l4hls_81fdcc97-775f-49ca-bdea-b6ce801091bc/dns-node-resolver/0.log" Jul 23 18:19:24.540577 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:24.540486 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v2h2z/perf-node-gather-daemonset-mtn9z"] Jul 23 18:19:24.543173 ip-10-0-135-200 kubenswrapper[2575]: W0723 18:19:24.543145 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod69110efe_2173_480e_b76d_e6e3c28b9c88.slice/crio-ae7c7459152395199aee1ba53554b351598f7ca6209d2c0da553c5c4b85e9643 WatchSource:0}: Error finding container ae7c7459152395199aee1ba53554b351598f7ca6209d2c0da553c5c4b85e9643: Status 404 returned error can't find the container with id ae7c7459152395199aee1ba53554b351598f7ca6209d2c0da553c5c4b85e9643 Jul 23 18:19:24.875652 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:24.875630 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-29thx_82dbe848-f82c-4ff9-a7cc-7c97ee5e37c9/node-ca/0.log" Jul 23 18:19:25.486790 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:25.486754 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-mtn9z" event={"ID":"69110efe-2173-480e-b76d-e6e3c28b9c88","Type":"ContainerStarted","Data":"18ce3195a12860ad104449115178a64b6355a642935b52d6cadc7a14e4e91ca2"} Jul 23 18:19:25.487152 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:25.486816 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-mtn9z" event={"ID":"69110efe-2173-480e-b76d-e6e3c28b9c88","Type":"ContainerStarted","Data":"ae7c7459152395199aee1ba53554b351598f7ca6209d2c0da553c5c4b85e9643"} Jul 23 18:19:25.487152 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:25.486934 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-mtn9z" Jul 23 18:19:25.504966 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:25.504920 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-mtn9z" podStartSLOduration=1.5049054370000001 podStartE2EDuration="1.504905437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-23 18:19:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-23 18:19:25.503564401 +0000 UTC m=+787.421154102" watchObservedRunningTime="2026-07-23 18:19:25.504905437 +0000 UTC m=+787.422495137" Jul 23 18:19:25.540191 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:25.540145 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7cd988784b-m9zqk_c7d035d4-940c-44fb-9486-2f4b1fe4fb70/router/0.log" Jul 23 18:19:25.862554 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:25.862532 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-q5hj8_9fe94bdd-cbb4-479a-896f-a221bc54a40c/serve-healthcheck-canary/0.log" Jul 23 18:19:26.175301 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:26.175238 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ctjdh_3e4ebee6-a774-4d34-b9a9-f62dd2ad9336/kube-rbac-proxy/0.log" Jul 23 18:19:26.193045 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:26.193012 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ctjdh_3e4ebee6-a774-4d34-b9a9-f62dd2ad9336/exporter/0.log" Jul 23 18:19:26.213211 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:26.213187 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ctjdh_3e4ebee6-a774-4d34-b9a9-f62dd2ad9336/extractor/0.log" Jul 23 18:19:30.690980 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:30.690952 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-9552s_72322ce0-17eb-4779-86ad-ef7ec6819c4c/migrator/0.log" Jul 23 18:19:30.706642 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:30.706620 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-9552s_72322ce0-17eb-4779-86ad-ef7ec6819c4c/graceful-termination/0.log" Jul 23 18:19:31.499485 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:31.499454 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-v2h2z/perf-node-gather-daemonset-mtn9z" Jul 23 18:19:31.831946 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:31.831867 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fps7b_7e5fe41d-ada3-4ef4-8a18-facdc8037fec/kube-multus-additional-cni-plugins/0.log" Jul 23 18:19:31.847824 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:31.847802 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fps7b_7e5fe41d-ada3-4ef4-8a18-facdc8037fec/egress-router-binary-copy/0.log" Jul 23 18:19:31.863303 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:31.863285 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fps7b_7e5fe41d-ada3-4ef4-8a18-facdc8037fec/cni-plugins/0.log" Jul 23 18:19:31.879211 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:31.879191 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fps7b_7e5fe41d-ada3-4ef4-8a18-facdc8037fec/bond-cni-plugin/0.log" Jul 23 18:19:31.895059 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:31.895037 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fps7b_7e5fe41d-ada3-4ef4-8a18-facdc8037fec/routeoverride-cni/0.log" Jul 23 18:19:31.911158 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:31.911137 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fps7b_7e5fe41d-ada3-4ef4-8a18-facdc8037fec/whereabouts-cni-bincopy/0.log" Jul 23 18:19:31.927251 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:31.927232 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-fps7b_7e5fe41d-ada3-4ef4-8a18-facdc8037fec/whereabouts-cni/0.log" Jul 23 18:19:32.238054 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:32.238027 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rlbzs_26dc96fe-1cc5-4c06-9a9f-856592e4b9b1/kube-multus/0.log" Jul 23 18:19:32.282809 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:32.282786 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rpldf_0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b/network-metrics-daemon/0.log" Jul 23 18:19:32.306083 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:32.306064 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rpldf_0e09e94e-8fee-49f5-b2fe-35bddb5d1c2b/kube-rbac-proxy/0.log" Jul 23 18:19:33.563442 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:33.563410 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s2l8h_65f9df7d-8a39-4000-b505-92cb839f2d94/ovn-controller/0.log" Jul 23 18:19:33.578449 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:33.578430 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s2l8h_65f9df7d-8a39-4000-b505-92cb839f2d94/ovn-acl-logging/0.log" Jul 23 18:19:33.604880 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:33.604857 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s2l8h_65f9df7d-8a39-4000-b505-92cb839f2d94/kube-rbac-proxy-node/0.log" Jul 23 18:19:33.622965 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:33.622947 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s2l8h_65f9df7d-8a39-4000-b505-92cb839f2d94/kube-rbac-proxy-ovn-metrics/0.log" Jul 23 18:19:33.637020 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:33.636954 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s2l8h_65f9df7d-8a39-4000-b505-92cb839f2d94/northd/0.log" Jul 23 18:19:33.654764 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:33.654742 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s2l8h_65f9df7d-8a39-4000-b505-92cb839f2d94/nbdb/0.log" Jul 23 18:19:33.671046 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:33.671029 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s2l8h_65f9df7d-8a39-4000-b505-92cb839f2d94/sbdb/0.log" Jul 23 18:19:33.705514 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:33.705492 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-s2l8h_65f9df7d-8a39-4000-b505-92cb839f2d94/ovnkube-controller/0.log" Jul 23 18:19:34.611768 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:34.611743 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7bc5b6bf85-75xcm_4d00c056-1c8b-4414-91c2-a04bcd37a8af/check-endpoints/0.log" Jul 23 18:19:34.674874 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:34.674851 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-rxckm_11c5ec1b-2dbf-49cf-9f93-fef53f4007e2/network-check-target-container/0.log" Jul 23 18:19:35.483206 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:35.483174 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-nwp4l_b44a91e6-fc2b-4a02-ab9d-80eb66a9aed9/iptables-alerter/0.log" Jul 23 18:19:36.020399 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:36.020375 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-299wk_c4ae62d1-1f58-4490-bb0c-5bf4074452dd/tuned/0.log" Jul 23 18:19:39.133988 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:39.133961 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-xj2dq_89ab6665-15e8-4c0c-9fab-2002482c8ac7/csi-driver/0.log" Jul 23 18:19:39.151463 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:39.151447 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-xj2dq_89ab6665-15e8-4c0c-9fab-2002482c8ac7/csi-node-driver-registrar/0.log" Jul 23 18:19:39.168488 ip-10-0-135-200 kubenswrapper[2575]: I0723 18:19:39.168467 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-xj2dq_89ab6665-15e8-4c0c-9fab-2002482c8ac7/csi-liveness-probe/0.log"