Jul 10 14:29:14.711409 ip-10-0-137-101 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 10 14:29:14.711419 ip-10-0-137-101 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 10 14:29:14.711426 ip-10-0-137-101 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 10 14:29:14.711673 ip-10-0-137-101 systemd[1]: Failed to start Kubernetes Kubelet. Jul 10 14:29:24.859650 ip-10-0-137-101 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 10 14:29:24.859666 ip-10-0-137-101 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot aff67d2d838d4004bdce10c085d22b44 -- Jul 10 14:31:21.802286 ip-10-0-137-101 systemd[1]: Starting Kubernetes Kubelet... Jul 10 14:31:22.217651 ip-10-0-137-101 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 14:31:22.217651 ip-10-0-137-101 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 10 14:31:22.217651 ip-10-0-137-101 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 14:31:22.217651 ip-10-0-137-101 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 10 14:31:22.217651 ip-10-0-137-101 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 10 14:31:22.218576 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.218493 2571 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 10 14:31:22.221947 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.221929 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 14:31:22.221947 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.221947 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 14:31:22.222026 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.221951 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 14:31:22.222026 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.221954 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 14:31:22.222026 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.221957 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 14:31:22.222026 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.221959 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 14:31:22.222026 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.221962 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 14:31:22.222026 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.221980 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 14:31:22.222026 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.221984 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 14:31:22.222026 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.221988 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 14:31:22.222026 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.221992 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 14:31:22.222026 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.221997 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 14:31:22.222026 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222001 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 14:31:22.222026 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222003 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 14:31:22.222026 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222007 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 14:31:22.222026 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222010 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 14:31:22.222026 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222013 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 14:31:22.222026 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222015 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 14:31:22.222026 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222018 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 14:31:22.222026 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222021 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 14:31:22.222026 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222024 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 14:31:22.222026 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222033 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 14:31:22.222511 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222036 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 14:31:22.222511 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222039 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 14:31:22.222511 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222042 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 14:31:22.222511 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222045 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 14:31:22.222511 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222047 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 14:31:22.222511 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222050 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 14:31:22.222511 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222052 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 14:31:22.222511 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222055 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 14:31:22.222511 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222057 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 14:31:22.222511 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222060 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 14:31:22.222511 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222062 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 14:31:22.222511 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222065 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 14:31:22.222511 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222067 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 14:31:22.222511 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222070 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 14:31:22.222511 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222072 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 14:31:22.222511 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222075 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 14:31:22.222511 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222077 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 14:31:22.222511 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222080 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 14:31:22.222511 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222082 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 14:31:22.223003 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222085 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 14:31:22.223003 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222089 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 14:31:22.223003 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222093 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 14:31:22.223003 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222096 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 14:31:22.223003 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222099 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 14:31:22.223003 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222103 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 14:31:22.223003 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222107 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 14:31:22.223003 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222110 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 14:31:22.223003 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222112 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 14:31:22.223003 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222115 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 14:31:22.223003 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222117 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 14:31:22.223003 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222120 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 14:31:22.223003 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222122 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 14:31:22.223003 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222125 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 14:31:22.223003 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222128 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 14:31:22.223003 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222130 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 14:31:22.223003 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222133 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 14:31:22.223003 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222135 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 14:31:22.223003 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222138 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 14:31:22.223459 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222141 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 14:31:22.223459 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222143 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 14:31:22.223459 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222146 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 14:31:22.223459 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222148 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 14:31:22.223459 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222151 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 14:31:22.223459 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222154 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 14:31:22.223459 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222156 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 14:31:22.223459 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222159 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 14:31:22.223459 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222162 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 14:31:22.223459 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222164 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 14:31:22.223459 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222167 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 14:31:22.223459 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222170 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 14:31:22.223459 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222173 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 14:31:22.223459 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222176 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 14:31:22.223459 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222178 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 14:31:22.223459 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222180 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 14:31:22.223459 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222183 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 14:31:22.223459 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222186 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 14:31:22.223459 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222188 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 14:31:22.223459 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222191 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 14:31:22.223996 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222193 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 14:31:22.223996 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222196 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 14:31:22.223996 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222198 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 14:31:22.223996 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222201 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 14:31:22.223996 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222203 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 14:31:22.223996 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222206 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 14:31:22.223996 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222210 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 14:31:22.223996 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222214 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 14:31:22.223996 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222218 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 14:31:22.223996 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222221 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 14:31:22.223996 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222224 2571 feature_gate.go:328] unrecognized feature gate: Example Jul 10 14:31:22.223996 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222226 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 14:31:22.223996 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222229 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 14:31:22.223996 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222231 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 14:31:22.223996 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222234 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 14:31:22.223996 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222236 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 14:31:22.223996 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222239 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 14:31:22.223996 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222241 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 14:31:22.223996 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.222244 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 14:31:22.224465 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223002 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 14:31:22.224465 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223009 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 14:31:22.224465 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223013 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 14:31:22.224465 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223016 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 14:31:22.224465 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223019 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 14:31:22.224465 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223022 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 14:31:22.224465 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223025 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 14:31:22.224465 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223028 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 14:31:22.224465 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223031 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 14:31:22.224465 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223033 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 14:31:22.224465 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223036 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 14:31:22.224465 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223039 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 14:31:22.224465 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223041 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 14:31:22.224465 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223044 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 14:31:22.224465 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223047 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 14:31:22.224465 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223049 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 14:31:22.224465 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223052 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 14:31:22.224465 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223055 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 14:31:22.224465 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223057 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 14:31:22.224465 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223061 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 14:31:22.225002 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223066 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 14:31:22.225002 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223068 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 14:31:22.225002 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223071 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 14:31:22.225002 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223074 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 14:31:22.225002 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223076 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 14:31:22.225002 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223079 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 14:31:22.225002 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223082 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 14:31:22.225002 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223085 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 14:31:22.225002 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223087 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 14:31:22.225002 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223090 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 14:31:22.225002 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223092 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 14:31:22.225002 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223094 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 14:31:22.225002 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223097 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 14:31:22.225002 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223100 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 14:31:22.225002 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223102 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 14:31:22.225002 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223105 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 14:31:22.225002 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223107 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 14:31:22.225002 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223110 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 14:31:22.225002 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223114 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 14:31:22.225002 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223116 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 14:31:22.225488 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223119 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 14:31:22.225488 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223121 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 14:31:22.225488 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223124 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 14:31:22.225488 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223126 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 14:31:22.225488 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223129 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 14:31:22.225488 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223132 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 14:31:22.225488 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223135 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 14:31:22.225488 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223139 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 14:31:22.225488 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223142 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 14:31:22.225488 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223145 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 14:31:22.225488 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223148 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 14:31:22.225488 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223151 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 14:31:22.225488 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223153 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 14:31:22.225488 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223156 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 14:31:22.225488 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223158 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 14:31:22.225488 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223161 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 14:31:22.225488 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223163 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 14:31:22.225488 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223166 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 14:31:22.225488 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223168 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 14:31:22.225488 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223171 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 14:31:22.225989 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223174 2571 feature_gate.go:328] unrecognized feature gate: Example Jul 10 14:31:22.225989 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223176 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 14:31:22.225989 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223179 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 14:31:22.225989 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223182 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 14:31:22.225989 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223184 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 14:31:22.225989 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223187 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 14:31:22.225989 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223189 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 14:31:22.225989 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223192 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 14:31:22.225989 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223194 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 14:31:22.225989 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223197 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 14:31:22.225989 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223200 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 14:31:22.225989 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223203 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 14:31:22.225989 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223206 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 14:31:22.225989 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223208 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 14:31:22.225989 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223212 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 14:31:22.225989 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223217 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 14:31:22.225989 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223221 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 14:31:22.225989 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223224 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 14:31:22.225989 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223226 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 14:31:22.226456 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223229 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 14:31:22.226456 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223232 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 14:31:22.226456 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223234 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 14:31:22.226456 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223237 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 14:31:22.226456 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223240 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 14:31:22.226456 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223243 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 14:31:22.226456 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223246 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 14:31:22.226456 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223249 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 14:31:22.226456 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223251 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 14:31:22.226456 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223253 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 14:31:22.226456 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223256 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 14:31:22.226456 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223260 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 14:31:22.226456 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223263 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 14:31:22.226456 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223267 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 14:31:22.226456 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223269 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 14:31:22.226456 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223272 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 14:31:22.226456 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223275 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 14:31:22.226456 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223278 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 14:31:22.226456 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223281 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 14:31:22.226918 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223283 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 14:31:22.226918 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223667 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 14:31:22.226918 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223671 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 14:31:22.226918 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223674 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 14:31:22.226918 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223677 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 14:31:22.226918 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223680 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 14:31:22.226918 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223683 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 14:31:22.226918 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223686 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 14:31:22.226918 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223689 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 14:31:22.226918 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223692 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 14:31:22.226918 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223695 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 14:31:22.226918 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223697 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 14:31:22.226918 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223700 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 14:31:22.226918 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223703 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 14:31:22.226918 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223705 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 14:31:22.226918 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223708 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 14:31:22.226918 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223711 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 14:31:22.226918 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223713 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 14:31:22.226918 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223718 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 14:31:22.227414 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223721 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 14:31:22.227414 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223724 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 14:31:22.227414 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223727 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 14:31:22.227414 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223730 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 14:31:22.227414 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223733 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 14:31:22.227414 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223735 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 14:31:22.227414 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223738 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 14:31:22.227414 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223740 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 14:31:22.227414 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223743 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 14:31:22.227414 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223745 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 14:31:22.227414 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223748 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 14:31:22.227414 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223750 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 14:31:22.227414 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223753 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 14:31:22.227414 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223755 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 14:31:22.227414 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223757 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 14:31:22.227414 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223760 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 14:31:22.227414 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223762 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 14:31:22.227414 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223765 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 14:31:22.227414 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223767 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 14:31:22.227414 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223770 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 14:31:22.227914 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223773 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 14:31:22.227914 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223778 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 14:31:22.227914 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223781 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 14:31:22.227914 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223783 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 14:31:22.227914 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223786 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 14:31:22.227914 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223788 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 14:31:22.227914 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223791 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 14:31:22.227914 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223793 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 14:31:22.227914 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223796 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 14:31:22.227914 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223798 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 14:31:22.227914 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223801 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 14:31:22.227914 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223804 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 14:31:22.227914 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223806 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 14:31:22.227914 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223809 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 14:31:22.227914 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223811 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 14:31:22.227914 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223814 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 14:31:22.227914 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223816 2571 feature_gate.go:328] unrecognized feature gate: Example Jul 10 14:31:22.227914 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223819 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 14:31:22.227914 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223821 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 14:31:22.227914 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223824 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 14:31:22.228413 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223827 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 14:31:22.228413 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223830 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 14:31:22.228413 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223833 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 14:31:22.228413 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223835 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 14:31:22.228413 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223837 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 14:31:22.228413 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223840 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 14:31:22.228413 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223842 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 14:31:22.228413 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223845 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 14:31:22.228413 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223847 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 14:31:22.228413 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223850 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 14:31:22.228413 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223852 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 14:31:22.228413 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223854 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 14:31:22.228413 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223857 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 14:31:22.228413 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223863 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 14:31:22.228413 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223866 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 14:31:22.228413 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223868 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 14:31:22.228413 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223871 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 14:31:22.228413 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223874 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 14:31:22.228413 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223877 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 14:31:22.228881 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223882 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 14:31:22.228881 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223885 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 14:31:22.228881 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223889 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 14:31:22.228881 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223891 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 14:31:22.228881 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223894 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 14:31:22.228881 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223897 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 14:31:22.228881 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223900 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 14:31:22.228881 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223902 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 14:31:22.228881 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223905 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 14:31:22.228881 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223907 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 14:31:22.228881 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223910 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 14:31:22.228881 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223912 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 14:31:22.228881 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223915 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 14:31:22.228881 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223917 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 14:31:22.228881 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223920 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 14:31:22.228881 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223922 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 14:31:22.228881 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223925 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 14:31:22.228881 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223927 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 14:31:22.228881 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223930 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 14:31:22.228881 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223932 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 14:31:22.229377 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223935 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 14:31:22.229377 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.223948 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 14:31:22.229377 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224050 2571 flags.go:64] FLAG: --address="0.0.0.0" Jul 10 14:31:22.229377 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224060 2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 10 14:31:22.229377 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224071 2571 flags.go:64] FLAG: --anonymous-auth="true" Jul 10 14:31:22.229377 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224077 2571 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 10 14:31:22.229377 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224086 2571 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 10 14:31:22.229377 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224090 2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 10 14:31:22.229377 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224095 2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 10 14:31:22.229377 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224099 2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 10 14:31:22.229377 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224103 2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 10 14:31:22.229377 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224105 2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 10 14:31:22.229377 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224111 2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 10 14:31:22.229377 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224114 2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 10 14:31:22.229377 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224117 2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 10 14:31:22.229377 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224120 2571 flags.go:64] FLAG: --cgroup-root="" Jul 10 14:31:22.229377 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224123 2571 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 10 14:31:22.229377 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224126 2571 flags.go:64] FLAG: --client-ca-file="" Jul 10 14:31:22.229377 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224129 2571 flags.go:64] FLAG: --cloud-provider="external" Jul 10 14:31:22.229377 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224132 2571 flags.go:64] FLAG: --cluster-dns="[]" Jul 10 14:31:22.229377 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224136 2571 flags.go:64] FLAG: --cluster-domain="" Jul 10 14:31:22.229377 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224139 2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 10 14:31:22.229377 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224142 2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 10 14:31:22.229377 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224145 2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 10 14:31:22.229942 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224148 2571 flags.go:64] FLAG: --container-log-max-files="5" Jul 10 14:31:22.229942 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224152 2571 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 10 14:31:22.229942 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224155 2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 10 14:31:22.229942 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224158 2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 10 14:31:22.229942 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224161 2571 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 10 14:31:22.229942 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224164 2571 flags.go:64] FLAG: --contention-profiling="false" Jul 10 14:31:22.229942 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224167 2571 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 10 14:31:22.229942 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224170 2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 10 14:31:22.229942 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224173 2571 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 10 14:31:22.229942 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224176 2571 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 10 14:31:22.229942 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224180 2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 10 14:31:22.229942 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224184 2571 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 10 14:31:22.229942 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224186 2571 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 10 14:31:22.229942 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224189 2571 flags.go:64] FLAG: --enable-load-reader="false" Jul 10 14:31:22.229942 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224193 2571 flags.go:64] FLAG: --enable-server="true" Jul 10 14:31:22.229942 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224199 2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 10 14:31:22.229942 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224204 2571 flags.go:64] FLAG: --event-burst="100" Jul 10 14:31:22.229942 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224208 2571 flags.go:64] FLAG: --event-qps="50" Jul 10 14:31:22.229942 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224211 2571 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 10 14:31:22.229942 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224214 2571 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 10 14:31:22.229942 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224218 2571 flags.go:64] FLAG: --eviction-hard="" Jul 10 14:31:22.229942 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224222 2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 10 14:31:22.229942 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224225 2571 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 10 14:31:22.229942 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224228 2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 10 14:31:22.229942 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224231 2571 flags.go:64] FLAG: --eviction-soft="" Jul 10 14:31:22.230583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224234 2571 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 10 14:31:22.230583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224237 2571 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 10 14:31:22.230583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224240 2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 10 14:31:22.230583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224243 2571 flags.go:64] FLAG: --experimental-mounter-path="" Jul 10 14:31:22.230583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224245 2571 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 10 14:31:22.230583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224248 2571 flags.go:64] FLAG: --fail-swap-on="true" Jul 10 14:31:22.230583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224251 2571 flags.go:64] FLAG: --feature-gates="" Jul 10 14:31:22.230583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224255 2571 flags.go:64] FLAG: --file-check-frequency="20s" Jul 10 14:31:22.230583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224258 2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 10 14:31:22.230583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224261 2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 10 14:31:22.230583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224264 2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 10 14:31:22.230583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224267 2571 flags.go:64] FLAG: --healthz-port="10248" Jul 10 14:31:22.230583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224270 2571 flags.go:64] FLAG: --help="false" Jul 10 14:31:22.230583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224273 2571 flags.go:64] FLAG: --hostname-override="ip-10-0-137-101.ec2.internal" Jul 10 14:31:22.230583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224277 2571 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 10 14:31:22.230583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224279 2571 flags.go:64] FLAG: --http-check-frequency="20s" Jul 10 14:31:22.230583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224282 2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 10 14:31:22.230583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224285 2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 10 14:31:22.230583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224289 2571 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 10 14:31:22.230583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224292 2571 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 10 14:31:22.230583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224295 2571 flags.go:64] FLAG: --image-service-endpoint="" Jul 10 14:31:22.230583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224298 2571 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 10 14:31:22.230583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224301 2571 flags.go:64] FLAG: --kube-api-burst="100" Jul 10 14:31:22.231183 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224304 2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 10 14:31:22.231183 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224308 2571 flags.go:64] FLAG: --kube-api-qps="50" Jul 10 14:31:22.231183 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224311 2571 flags.go:64] FLAG: --kube-reserved="" Jul 10 14:31:22.231183 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224314 2571 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 10 14:31:22.231183 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224318 2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 10 14:31:22.231183 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224321 2571 flags.go:64] FLAG: --kubelet-cgroups="" Jul 10 14:31:22.231183 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224324 2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 10 14:31:22.231183 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224326 2571 flags.go:64] FLAG: --lock-file="" Jul 10 14:31:22.231183 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224329 2571 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 10 14:31:22.231183 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224332 2571 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 10 14:31:22.231183 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224335 2571 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 10 14:31:22.231183 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224341 2571 flags.go:64] FLAG: --log-json-split-stream="false" Jul 10 14:31:22.231183 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224344 2571 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 10 14:31:22.231183 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224346 2571 flags.go:64] FLAG: --log-text-split-stream="false" Jul 10 14:31:22.231183 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224349 2571 flags.go:64] FLAG: --logging-format="text" Jul 10 14:31:22.231183 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224352 2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 10 14:31:22.231183 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224356 2571 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 10 14:31:22.231183 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224358 2571 flags.go:64] FLAG: --manifest-url="" Jul 10 14:31:22.231183 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224361 2571 flags.go:64] FLAG: --manifest-url-header="" Jul 10 14:31:22.231183 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224372 2571 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 10 14:31:22.231183 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224375 2571 flags.go:64] FLAG: --max-open-files="1000000" Jul 10 14:31:22.231183 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224379 2571 flags.go:64] FLAG: --max-pods="110" Jul 10 14:31:22.231183 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224382 2571 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 10 14:31:22.231183 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224385 2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 10 14:31:22.231183 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224388 2571 flags.go:64] FLAG: --memory-manager-policy="None" Jul 10 14:31:22.231791 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224391 2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 10 14:31:22.231791 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224394 2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 10 14:31:22.231791 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224397 2571 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 10 14:31:22.231791 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224400 2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 10 14:31:22.231791 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224407 2571 flags.go:64] FLAG: --node-status-max-images="50" Jul 10 14:31:22.231791 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224410 2571 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 10 14:31:22.231791 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224413 2571 flags.go:64] FLAG: --oom-score-adj="-999" Jul 10 14:31:22.231791 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224416 2571 flags.go:64] FLAG: --pod-cidr="" Jul 10 14:31:22.231791 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224419 2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 10 14:31:22.231791 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224425 2571 flags.go:64] FLAG: --pod-manifest-path="" Jul 10 14:31:22.231791 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224428 2571 flags.go:64] FLAG: --pod-max-pids="-1" Jul 10 14:31:22.231791 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224433 2571 flags.go:64] FLAG: --pods-per-core="0" Jul 10 14:31:22.231791 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224436 2571 flags.go:64] FLAG: --port="10250" Jul 10 14:31:22.231791 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224438 2571 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 10 14:31:22.231791 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224441 2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0299f0a56b41974cc" Jul 10 14:31:22.231791 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224444 2571 flags.go:64] FLAG: --qos-reserved="" Jul 10 14:31:22.231791 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224447 2571 flags.go:64] FLAG: --read-only-port="10255" Jul 10 14:31:22.231791 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224450 2571 flags.go:64] FLAG: --register-node="true" Jul 10 14:31:22.231791 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224453 2571 flags.go:64] FLAG: --register-with-taints="" Jul 10 14:31:22.231791 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224457 2571 flags.go:64] FLAG: --registry-burst="10" Jul 10 14:31:22.231791 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224460 2571 flags.go:64] FLAG: --registry-qps="5" Jul 10 14:31:22.231791 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224462 2571 flags.go:64] FLAG: --reserved-cpus="" Jul 10 14:31:22.231791 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224465 2571 flags.go:64] FLAG: --reserved-memory="" Jul 10 14:31:22.231791 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224469 2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 10 14:31:22.231791 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224472 2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 10 14:31:22.232467 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224475 2571 flags.go:64] FLAG: --rotate-certificates="false" Jul 10 14:31:22.232467 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224478 2571 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 10 14:31:22.232467 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224481 2571 flags.go:64] FLAG: --runonce="false" Jul 10 14:31:22.232467 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224484 2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 10 14:31:22.232467 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224487 2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 10 14:31:22.232467 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224490 2571 flags.go:64] FLAG: --seccomp-default="false" Jul 10 14:31:22.232467 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224493 2571 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 10 14:31:22.232467 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224496 2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 10 14:31:22.232467 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224499 2571 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 10 14:31:22.232467 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224502 2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 10 14:31:22.232467 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224505 2571 flags.go:64] FLAG: --storage-driver-password="root" Jul 10 14:31:22.232467 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224508 2571 flags.go:64] FLAG: --storage-driver-secure="false" Jul 10 14:31:22.232467 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224511 2571 flags.go:64] FLAG: --storage-driver-table="stats" Jul 10 14:31:22.232467 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224516 2571 flags.go:64] FLAG: --storage-driver-user="root" Jul 10 14:31:22.232467 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224519 2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 10 14:31:22.232467 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224522 2571 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 10 14:31:22.232467 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224525 2571 flags.go:64] FLAG: --system-cgroups="" Jul 10 14:31:22.232467 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224528 2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 10 14:31:22.232467 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224535 2571 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 10 14:31:22.232467 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224538 2571 flags.go:64] FLAG: --tls-cert-file="" Jul 10 14:31:22.232467 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224541 2571 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 10 14:31:22.232467 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224545 2571 flags.go:64] FLAG: --tls-min-version="" Jul 10 14:31:22.232467 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224548 2571 flags.go:64] FLAG: --tls-private-key-file="" Jul 10 14:31:22.232467 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224550 2571 flags.go:64] FLAG: --topology-manager-policy="none" Jul 10 14:31:22.232467 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224553 2571 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 10 14:31:22.233088 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224556 2571 flags.go:64] FLAG: --topology-manager-scope="container" Jul 10 14:31:22.233088 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224559 2571 flags.go:64] FLAG: --v="2" Jul 10 14:31:22.233088 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224563 2571 flags.go:64] FLAG: --version="false" Jul 10 14:31:22.233088 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224567 2571 flags.go:64] FLAG: --vmodule="" Jul 10 14:31:22.233088 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224571 2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 10 14:31:22.233088 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224574 2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 10 14:31:22.233088 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224696 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 14:31:22.233088 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224701 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 14:31:22.233088 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224706 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 14:31:22.233088 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224709 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 14:31:22.233088 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224713 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 14:31:22.233088 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224717 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 14:31:22.233088 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224720 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 14:31:22.233088 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224722 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 14:31:22.233088 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224725 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 14:31:22.233088 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224728 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 14:31:22.233088 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224731 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 14:31:22.233088 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224734 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 14:31:22.233088 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224736 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 14:31:22.233088 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224739 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 14:31:22.233582 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224743 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 14:31:22.233582 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224746 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 14:31:22.233582 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224748 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 14:31:22.233582 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224751 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 14:31:22.233582 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224754 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 14:31:22.233582 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224758 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 14:31:22.233582 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224761 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 14:31:22.233582 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224763 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 14:31:22.233582 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224766 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 14:31:22.233582 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224769 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 14:31:22.233582 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224771 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 14:31:22.233582 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224774 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 14:31:22.233582 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224777 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 14:31:22.233582 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224779 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 14:31:22.233582 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224782 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 14:31:22.233582 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224785 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 14:31:22.233582 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224787 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 14:31:22.233582 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224790 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 14:31:22.233582 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224792 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 14:31:22.233582 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224795 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 14:31:22.234114 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224797 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 14:31:22.234114 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224800 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 14:31:22.234114 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224803 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 14:31:22.234114 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224805 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 14:31:22.234114 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224808 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 14:31:22.234114 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224810 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 14:31:22.234114 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224813 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 14:31:22.234114 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224815 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 14:31:22.234114 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224818 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 14:31:22.234114 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224820 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 14:31:22.234114 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224823 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 14:31:22.234114 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224825 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 14:31:22.234114 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224830 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 14:31:22.234114 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224833 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 14:31:22.234114 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224835 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 14:31:22.234114 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224838 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 14:31:22.234114 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224840 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 14:31:22.234114 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224845 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 14:31:22.234114 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224847 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 14:31:22.234114 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224850 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 14:31:22.234603 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224853 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 14:31:22.234603 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224855 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 14:31:22.234603 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224858 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 14:31:22.234603 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224861 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 14:31:22.234603 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224863 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 14:31:22.234603 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224866 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 14:31:22.234603 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224868 2571 feature_gate.go:328] unrecognized feature gate: Example Jul 10 14:31:22.234603 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224871 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 14:31:22.234603 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224873 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 14:31:22.234603 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224876 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 14:31:22.234603 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224878 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 14:31:22.234603 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224881 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 14:31:22.234603 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224883 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 14:31:22.234603 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224886 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 14:31:22.234603 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224889 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 14:31:22.234603 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224891 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 14:31:22.234603 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224893 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 14:31:22.234603 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224896 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 14:31:22.234603 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224898 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 14:31:22.234603 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224901 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 14:31:22.235108 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224903 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 14:31:22.235108 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224906 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 14:31:22.235108 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224908 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 14:31:22.235108 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224911 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 14:31:22.235108 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224914 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 14:31:22.235108 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224917 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 14:31:22.235108 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224920 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 14:31:22.235108 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224922 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 14:31:22.235108 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224925 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 14:31:22.235108 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224928 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 14:31:22.235108 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224931 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 14:31:22.235108 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224933 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 14:31:22.235108 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224936 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 14:31:22.235108 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224938 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 14:31:22.235108 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224941 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 14:31:22.235108 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224943 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 14:31:22.235108 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224946 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 14:31:22.235108 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224948 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 14:31:22.235108 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224951 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 14:31:22.235108 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224953 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 14:31:22.235583 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224955 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 14:31:22.235583 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224958 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 14:31:22.235583 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224961 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 14:31:22.235583 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224963 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 14:31:22.235583 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.224980 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 14:31:22.235583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.224985 2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 14:31:22.235583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.231394 2571 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 10 14:31:22.235583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.231410 2571 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 10 14:31:22.235583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.232245 2571 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 10 14:31:22.235583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.232253 2571 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 10 14:31:22.235583 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232332 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 14:31:22.235583 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232337 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 14:31:22.235583 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232341 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 14:31:22.235583 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232344 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 14:31:22.235583 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232348 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 14:31:22.236158 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232351 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 14:31:22.236158 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232353 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 14:31:22.236158 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232356 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 14:31:22.236158 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232358 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 14:31:22.236158 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232361 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 14:31:22.236158 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232363 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 14:31:22.236158 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232366 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 14:31:22.236158 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232368 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 14:31:22.236158 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232371 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 14:31:22.236158 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232374 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 14:31:22.236158 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232377 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 14:31:22.236158 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232380 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 14:31:22.236158 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232382 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 14:31:22.236158 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232385 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 14:31:22.236158 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232387 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 14:31:22.236158 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232389 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 14:31:22.236158 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232392 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 14:31:22.236158 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232394 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 14:31:22.236158 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232397 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 14:31:22.236158 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232399 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 14:31:22.236638 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232402 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 14:31:22.236638 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232404 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 14:31:22.236638 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232407 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 14:31:22.236638 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232410 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 14:31:22.236638 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232413 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 14:31:22.236638 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232416 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 14:31:22.236638 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232418 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 14:31:22.236638 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232421 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 14:31:22.236638 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232423 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 14:31:22.236638 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232426 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 14:31:22.236638 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232429 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 14:31:22.236638 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232433 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 14:31:22.236638 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232437 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 14:31:22.236638 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232440 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 14:31:22.236638 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232443 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 14:31:22.236638 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232445 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 14:31:22.236638 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232448 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 14:31:22.236638 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232451 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 14:31:22.236638 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232453 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 14:31:22.237113 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232456 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 14:31:22.237113 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232458 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 14:31:22.237113 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232462 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 14:31:22.237113 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232465 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 14:31:22.237113 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232468 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 14:31:22.237113 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232471 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 14:31:22.237113 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232474 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 14:31:22.237113 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232477 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 14:31:22.237113 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232479 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 14:31:22.237113 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232483 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 14:31:22.237113 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232485 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 14:31:22.237113 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232488 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 14:31:22.237113 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232492 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 14:31:22.237113 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232495 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 14:31:22.237113 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232498 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 14:31:22.237113 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232501 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 14:31:22.237113 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232504 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 14:31:22.237113 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232507 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 14:31:22.237113 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232510 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 14:31:22.237113 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232514 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 14:31:22.237755 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232516 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 14:31:22.237755 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232519 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 14:31:22.237755 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232521 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 14:31:22.237755 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232523 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 14:31:22.237755 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232526 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 14:31:22.237755 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232528 2571 feature_gate.go:328] unrecognized feature gate: Example Jul 10 14:31:22.237755 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232531 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 14:31:22.237755 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232533 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 14:31:22.237755 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232535 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 14:31:22.237755 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232538 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 14:31:22.237755 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232540 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 14:31:22.237755 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232543 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 14:31:22.237755 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232546 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 14:31:22.237755 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232549 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 14:31:22.237755 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232553 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 14:31:22.237755 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232556 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 14:31:22.237755 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232558 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 14:31:22.237755 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232561 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 14:31:22.237755 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232563 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 14:31:22.237755 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232566 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 14:31:22.238589 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232568 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 14:31:22.238589 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232571 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 14:31:22.238589 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232573 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 14:31:22.238589 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232576 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 14:31:22.238589 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232578 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 14:31:22.238589 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232581 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 14:31:22.238589 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232583 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 14:31:22.238589 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232586 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 14:31:22.238589 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232589 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 14:31:22.238589 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232591 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 14:31:22.238589 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232594 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 14:31:22.238589 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232597 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 14:31:22.238589 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232600 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 14:31:22.238589 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232602 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 14:31:22.238589 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232605 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 14:31:22.239009 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.232610 2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 14:31:22.239009 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232727 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 10 14:31:22.239009 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232733 2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 10 14:31:22.239009 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232735 2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 10 14:31:22.239009 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232738 2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 10 14:31:22.239009 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232740 2571 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 10 14:31:22.239009 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232743 2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 10 14:31:22.239009 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232745 2571 feature_gate.go:328] unrecognized feature gate: Example2 Jul 10 14:31:22.239009 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232748 2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 10 14:31:22.239009 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232751 2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 10 14:31:22.239009 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232754 2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 10 14:31:22.239009 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232756 2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 10 14:31:22.239009 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232759 2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 10 14:31:22.239009 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232761 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 10 14:31:22.239009 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232764 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 10 14:31:22.239530 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232767 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 10 14:31:22.239530 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232769 2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 10 14:31:22.239530 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232771 2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 10 14:31:22.239530 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232774 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 10 14:31:22.239530 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232777 2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 10 14:31:22.239530 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232779 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 10 14:31:22.239530 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232782 2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 10 14:31:22.239530 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232784 2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 10 14:31:22.239530 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232787 2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 10 14:31:22.239530 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232789 2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 10 14:31:22.239530 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232791 2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 10 14:31:22.239530 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232794 2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 10 14:31:22.239530 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232797 2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 10 14:31:22.239530 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232800 2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 10 14:31:22.239530 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232803 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 10 14:31:22.239530 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232805 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 10 14:31:22.239530 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232808 2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 10 14:31:22.239530 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232810 2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 10 14:31:22.239530 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232813 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 10 14:31:22.240167 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232816 2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 10 14:31:22.240167 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232818 2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 10 14:31:22.240167 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232820 2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 10 14:31:22.240167 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232823 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 10 14:31:22.240167 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232825 2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 10 14:31:22.240167 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232828 2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 10 14:31:22.240167 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232831 2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 10 14:31:22.240167 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232836 2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 10 14:31:22.240167 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232840 2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 10 14:31:22.240167 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232844 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 10 14:31:22.240167 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232847 2571 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 10 14:31:22.240167 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232850 2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 10 14:31:22.240167 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232852 2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 10 14:31:22.240167 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232855 2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 10 14:31:22.240167 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232857 2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 10 14:31:22.240167 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232860 2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 10 14:31:22.240167 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232862 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 10 14:31:22.240167 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232864 2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 10 14:31:22.240167 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232867 2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 10 14:31:22.240622 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232869 2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 10 14:31:22.240622 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232871 2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 10 14:31:22.240622 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232874 2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 10 14:31:22.240622 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232876 2571 feature_gate.go:328] unrecognized feature gate: Example Jul 10 14:31:22.240622 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232879 2571 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 10 14:31:22.240622 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232882 2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 10 14:31:22.240622 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232886 2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 10 14:31:22.240622 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232889 2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 10 14:31:22.240622 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232892 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 10 14:31:22.240622 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232895 2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 10 14:31:22.240622 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232898 2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 10 14:31:22.240622 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232901 2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 10 14:31:22.240622 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232903 2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 10 14:31:22.240622 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232906 2571 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 10 14:31:22.240622 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232909 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 10 14:31:22.240622 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232911 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 10 14:31:22.240622 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232914 2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 10 14:31:22.240622 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232916 2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 10 14:31:22.240622 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232919 2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 10 14:31:22.240622 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232921 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 10 14:31:22.241451 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232924 2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 10 14:31:22.241451 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232926 2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 10 14:31:22.241451 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232929 2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 10 14:31:22.241451 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232931 2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 10 14:31:22.241451 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232934 2571 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 10 14:31:22.241451 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232936 2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 10 14:31:22.241451 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232938 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 10 14:31:22.241451 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232941 2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 10 14:31:22.241451 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232943 2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 10 14:31:22.241451 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232946 2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 10 14:31:22.241451 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232948 2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 10 14:31:22.241451 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232951 2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 10 14:31:22.241451 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232953 2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 10 14:31:22.241451 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232956 2571 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 10 14:31:22.241451 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232958 2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 10 14:31:22.241451 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232960 2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 10 14:31:22.241451 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232963 2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 10 14:31:22.241451 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232977 2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 10 14:31:22.241451 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232980 2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 10 14:31:22.241451 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232983 2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 10 14:31:22.241960 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232986 2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 10 14:31:22.241960 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232988 2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 10 14:31:22.241960 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232991 2571 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 10 14:31:22.241960 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232994 2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 10 14:31:22.241960 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232996 2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 10 14:31:22.241960 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.232999 2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 10 14:31:22.241960 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:22.233002 2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 10 14:31:22.241960 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.233007 2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 10 14:31:22.241960 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.233123 2571 server.go:962] "Client rotation is on, will bootstrap in background" Jul 10 14:31:22.241960 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.235039 2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 10 14:31:22.241960 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.237087 2571 server.go:1019] "Starting client certificate rotation" Jul 10 14:31:22.241960 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.237188 2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 14:31:22.241960 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.237588 2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 10 14:31:22.242318 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.241351 2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 14:31:22.243531 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.243511 2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 10 14:31:22.252323 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.252305 2571 log.go:25] "Validated CRI v1 runtime API" Jul 10 14:31:22.255411 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.255395 2571 log.go:25] "Validated CRI v1 image API" Jul 10 14:31:22.257131 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.257108 2571 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 10 14:31:22.259651 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.259624 2571 fs.go:135] Filesystem UUIDs: map[3b719a24-c131-4459-93f5-c0499f6045d4:/dev/nvme0n1p3 5adbd27e-ef8f-49f7-8f11-6d1ee266ec1b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 10 14:31:22.259723 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.259649 2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 10 14:31:22.265127 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.265011 2571 manager.go:216] Machine: {Timestamp:2026-07-10 14:31:22.263868616 +0000 UTC m=+0.341530153 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098751 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ddfd8aca4eee032a6464dd73907ac SystemUUID:ec2ddfd8-aca4-eee0-32a6-464dd73907ac BootID:aff67d2d-838d-4004-bdce-10c085d22b44 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:97:ea:fe:c4:4b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:97:ea:fe:c4:4b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:b2:db:5b:63:82 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 10 14:31:22.265127 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.265119 2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 10 14:31:22.265243 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.265205 2571 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 10 14:31:22.268512 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.268485 2571 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 10 14:31:22.268714 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.268516 2571 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-101.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 10 14:31:22.269385 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.269373 2571 topology_manager.go:138] "Creating topology manager with none policy" Jul 10 14:31:22.269440 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.269391 2571 container_manager_linux.go:309] "Creating device plugin manager" Jul 10 14:31:22.269440 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.269401 2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 14:31:22.269544 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.269528 2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 14:31:22.271018 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.271005 2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 10 14:31:22.272333 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.272321 2571 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 10 14:31:22.275197 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.275184 2571 state_mem.go:36] "Initialized new in-memory state store" Jul 10 14:31:22.275343 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.275332 2571 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 10 14:31:22.275400 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.275371 2571 kubelet.go:486] "Attempting to sync node with API server" Jul 10 14:31:22.275400 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.275385 2571 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 10 14:31:22.275492 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.275405 2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 10 14:31:22.275492 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.275419 2571 kubelet.go:398] "Adding apiserver pod source" Jul 10 14:31:22.275492 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.275431 2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 10 14:31:22.276008 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.275993 2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 14:31:22.276084 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.276029 2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 10 14:31:22.280897 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.280879 2571 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 10 14:31:22.282861 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.282844 2571 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 10 14:31:22.282951 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.282882 2571 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 10 14:31:22.283095 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.283082 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 10 14:31:22.283153 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.283100 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 10 14:31:22.283153 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.283111 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 10 14:31:22.283153 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.283119 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 10 14:31:22.283153 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.283130 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 10 14:31:22.283153 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.283139 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 10 14:31:22.283637 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.283627 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 10 14:31:22.283687 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.283639 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 10 14:31:22.283687 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.283650 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 10 14:31:22.283687 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.283659 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 10 14:31:22.283687 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.283671 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 10 14:31:22.283687 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.283682 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 10 14:31:22.284455 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.284445 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 10 14:31:22.284507 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.284457 2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 10 14:31:22.287267 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.287247 2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-101.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 10 14:31:22.287350 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:22.287279 2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-101.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 10 14:31:22.287350 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:22.287290 2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 10 14:31:22.287837 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.287824 2571 server.go:1268] "Started kubelet" Jul 10 14:31:22.287928 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.287897 2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 10 14:31:22.288006 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.287898 2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 10 14:31:22.288006 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.287956 2571 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 10 14:31:22.288685 ip-10-0-137-101 systemd[1]: Started Kubernetes Kubelet. Jul 10 14:31:22.289711 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.289698 2571 server.go:310] "Adding debug handlers to kubelet server" Jul 10 14:31:22.292170 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.292150 2571 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 10 14:31:22.294595 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:22.294580 2571 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 10 14:31:22.296188 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:22.295143 2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-101.ec2.internal.18c0f422b1cd2a86 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-101.ec2.internal,UID:ip-10-0-137-101.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-101.ec2.internal,},FirstTimestamp:2026-07-10 14:31:22.287794822 +0000 UTC m=+0.365456359,LastTimestamp:2026-07-10 14:31:22.287794822 +0000 UTC m=+0.365456359,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-101.ec2.internal,}" Jul 10 14:31:22.298442 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.298422 2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 10 14:31:22.298520 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.298440 2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 10 14:31:22.298570 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:22.298536 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-101.ec2.internal\" not found" Jul 10 14:31:22.298570 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.298540 2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-z9vnc" Jul 10 14:31:22.299048 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.299027 2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 10 14:31:22.299143 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.299029 2571 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 10 14:31:22.299143 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.299075 2571 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 10 14:31:22.299253 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.299241 2571 reconstruct.go:97] "Volume reconstruction finished" Jul 10 14:31:22.299253 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.299247 2571 reconciler.go:29] "Reconciler: start to sync state" Jul 10 14:31:22.299339 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.299313 2571 factory.go:55] Registering systemd factory Jul 10 14:31:22.299339 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.299331 2571 factory.go:223] Registration of the systemd container factory successfully Jul 10 14:31:22.299550 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.299533 2571 factory.go:153] Registering CRI-O factory Jul 10 14:31:22.299550 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.299551 2571 factory.go:223] Registration of the crio container factory successfully Jul 10 14:31:22.299683 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.299598 2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 10 14:31:22.299683 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.299634 2571 factory.go:103] Registering Raw factory Jul 10 14:31:22.299683 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.299646 2571 manager.go:1196] Started watching for new ooms in manager Jul 10 14:31:22.300328 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.300305 2571 manager.go:349] Starting recovery of all containers Jul 10 14:31:22.301455 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:22.301433 2571 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 10 14:31:22.301605 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:22.301566 2571 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-101.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 10 14:31:22.306794 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.306767 2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-z9vnc" Jul 10 14:31:22.312008 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.311831 2571 manager.go:354] Recovery completed Jul 10 14:31:22.316916 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.316899 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 14:31:22.320024 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.320007 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasSufficientMemory" Jul 10 14:31:22.320087 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.320034 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 14:31:22.320087 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.320044 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasSufficientPID" Jul 10 14:31:22.320863 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.320850 2571 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 10 14:31:22.320916 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.320862 2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 10 14:31:22.320916 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.320877 2571 state_mem.go:36] "Initialized new in-memory state store" Jul 10 14:31:22.322081 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.322070 2571 policy_none.go:49] "None policy: Start" Jul 10 14:31:22.322128 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.322084 2571 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 10 14:31:22.322128 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.322094 2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 10 14:31:22.323283 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.323269 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 14:31:22.323483 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.323473 2571 policy_none.go:47] "Start" Jul 10 14:31:22.324516 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.324497 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasSufficientMemory" Jul 10 14:31:22.324599 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.324528 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 14:31:22.324599 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.324541 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasSufficientPID" Jul 10 14:31:22.368650 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.368631 2571 manager.go:337] "Starting Device Plugin manager" Jul 10 14:31:22.368762 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:22.368664 2571 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 10 14:31:22.368762 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.368674 2571 server.go:87] "Starting device plugin registration server" Jul 10 14:31:22.368977 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.368951 2571 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 10 14:31:22.369027 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.368989 2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 10 14:31:22.369154 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.369136 2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 10 14:31:22.369256 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.369244 2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 10 14:31:22.369256 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.369254 2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 10 14:31:22.369744 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:22.369716 2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 10 14:31:22.369821 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:22.369767 2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-101.ec2.internal\" not found" Jul 10 14:31:22.455214 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.455180 2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 10 14:31:22.456467 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.456446 2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 10 14:31:22.456561 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.456488 2571 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 10 14:31:22.456561 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.456510 2571 kubelet.go:2448] "Starting kubelet main sync loop" Jul 10 14:31:22.456561 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:22.456551 2571 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 10 14:31:22.458444 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.458423 2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 14:31:22.469414 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.469361 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 14:31:22.470246 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.470230 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasSufficientMemory" Jul 10 14:31:22.470330 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.470258 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 14:31:22.470330 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.470273 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasSufficientPID" Jul 10 14:31:22.470330 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.470297 2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-101.ec2.internal" Jul 10 14:31:22.475740 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.475722 2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-101.ec2.internal" Jul 10 14:31:22.475828 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:22.475746 2571 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-101.ec2.internal\": node \"ip-10-0-137-101.ec2.internal\" not found" Jul 10 14:31:22.489886 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:22.489865 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-101.ec2.internal\" not found" Jul 10 14:31:22.557239 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.557203 2571 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-101.ec2.internal"] Jul 10 14:31:22.557347 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.557299 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 14:31:22.558371 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.558356 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasSufficientMemory" Jul 10 14:31:22.558454 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.558383 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 14:31:22.558454 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.558392 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasSufficientPID" Jul 10 14:31:22.559892 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.559880 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 14:31:22.560020 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.560004 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal" Jul 10 14:31:22.560076 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.560039 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 14:31:22.560639 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.560623 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasSufficientMemory" Jul 10 14:31:22.560715 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.560655 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 14:31:22.560715 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.560623 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasSufficientMemory" Jul 10 14:31:22.560715 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.560666 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasSufficientPID" Jul 10 14:31:22.560715 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.560684 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 14:31:22.560715 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.560696 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasSufficientPID" Jul 10 14:31:22.562099 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.562083 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-101.ec2.internal" Jul 10 14:31:22.562192 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.562113 2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 10 14:31:22.562735 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.562721 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasSufficientMemory" Jul 10 14:31:22.562792 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.562747 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasNoDiskPressure" Jul 10 14:31:22.562792 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.562762 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeHasSufficientPID" Jul 10 14:31:22.582714 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:22.582692 2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-101.ec2.internal\" not found" node="ip-10-0-137-101.ec2.internal" Jul 10 14:31:22.587005 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:22.586988 2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-101.ec2.internal\" not found" node="ip-10-0-137-101.ec2.internal" Jul 10 14:31:22.590250 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:22.590235 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-101.ec2.internal\" not found" Jul 10 14:31:22.601609 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.601580 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4369032deb28c5390acbf881f75e0450-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal\" (UID: \"4369032deb28c5390acbf881f75e0450\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal" Jul 10 14:31:22.601697 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.601652 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/43b50c0f30ea9d35967a41671db4af49-config\") pod \"kube-apiserver-proxy-ip-10-0-137-101.ec2.internal\" (UID: \"43b50c0f30ea9d35967a41671db4af49\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-101.ec2.internal" Jul 10 14:31:22.601739 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.601705 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4369032deb28c5390acbf881f75e0450-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal\" (UID: \"4369032deb28c5390acbf881f75e0450\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal" Jul 10 14:31:22.690756 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:22.690718 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-101.ec2.internal\" not found" Jul 10 14:31:22.702044 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.702019 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4369032deb28c5390acbf881f75e0450-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal\" (UID: \"4369032deb28c5390acbf881f75e0450\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal" Jul 10 14:31:22.702118 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.702063 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4369032deb28c5390acbf881f75e0450-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal\" (UID: \"4369032deb28c5390acbf881f75e0450\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal" Jul 10 14:31:22.702118 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.702082 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/43b50c0f30ea9d35967a41671db4af49-config\") pod \"kube-apiserver-proxy-ip-10-0-137-101.ec2.internal\" (UID: \"43b50c0f30ea9d35967a41671db4af49\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-101.ec2.internal" Jul 10 14:31:22.702118 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.702108 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/43b50c0f30ea9d35967a41671db4af49-config\") pod \"kube-apiserver-proxy-ip-10-0-137-101.ec2.internal\" (UID: \"43b50c0f30ea9d35967a41671db4af49\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-101.ec2.internal" Jul 10 14:31:22.702221 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.702111 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4369032deb28c5390acbf881f75e0450-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal\" (UID: \"4369032deb28c5390acbf881f75e0450\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal" Jul 10 14:31:22.702221 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.702125 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4369032deb28c5390acbf881f75e0450-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal\" (UID: \"4369032deb28c5390acbf881f75e0450\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal" Jul 10 14:31:22.791264 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:22.791181 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-101.ec2.internal\" not found" Jul 10 14:31:22.885706 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.885676 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal" Jul 10 14:31:22.889919 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:22.889721 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-101.ec2.internal" Jul 10 14:31:22.891855 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:22.891837 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-101.ec2.internal\" not found" Jul 10 14:31:22.992534 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:22.992498 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-101.ec2.internal\" not found" Jul 10 14:31:23.093085 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:23.093011 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-101.ec2.internal\" not found" Jul 10 14:31:23.193667 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:23.193631 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-101.ec2.internal\" not found" Jul 10 14:31:23.197667 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:23.197648 2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 14:31:23.222535 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:23.222501 2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 14:31:23.237126 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:23.237094 2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 10 14:31:23.237269 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:23.237251 2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 10 14:31:23.237328 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:23.237293 2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 10 14:31:23.237328 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:23.237309 2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 10 14:31:23.293787 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:23.293755 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-101.ec2.internal\" not found" Jul 10 14:31:23.314056 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:23.314003 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-09 14:26:22 +0000 UTC" deadline="2028-02-22 22:33:06.701223194 +0000 UTC" Jul 10 14:31:23.314056 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:23.314045 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14216h1m43.387181351s" Jul 10 14:31:23.394426 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:23.394344 2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-101.ec2.internal\" not found" Jul 10 14:31:23.412087 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:23.412056 2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 14:31:23.499411 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:23.499387 2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal" Jul 10 14:31:23.513167 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:23.513143 2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 14:31:23.514803 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:23.514788 2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-101.ec2.internal" Jul 10 14:31:23.522470 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:23.522344 2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 10 14:31:23.574813 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:23.574773 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43b50c0f30ea9d35967a41671db4af49.slice/crio-301f4821cdf7d09d1f816be794387bbc540bbc80598045736a0bd156207503fc WatchSource:0}: Error finding container 301f4821cdf7d09d1f816be794387bbc540bbc80598045736a0bd156207503fc: Status 404 returned error can't find the container with id 301f4821cdf7d09d1f816be794387bbc540bbc80598045736a0bd156207503fc Jul 10 14:31:23.575273 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:23.575255 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4369032deb28c5390acbf881f75e0450.slice/crio-a58e3eba0a94021df077b9c792e393c59167c55c3a6696fc4ed276cd1d4840de WatchSource:0}: Error finding container a58e3eba0a94021df077b9c792e393c59167c55c3a6696fc4ed276cd1d4840de: Status 404 returned error can't find the container with id a58e3eba0a94021df077b9c792e393c59167c55c3a6696fc4ed276cd1d4840de Jul 10 14:31:23.581150 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:23.581133 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 14:31:24.139043 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.139011 2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 14:31:24.276886 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.276846 2571 apiserver.go:52] "Watching apiserver" Jul 10 14:31:24.289035 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.289004 2571 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 10 14:31:24.289516 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.289490 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-n5n25","openshift-ovn-kubernetes/ovnkube-node-7clbv","kube-system/global-pull-secret-syncer-tc6vj","kube-system/kube-apiserver-proxy-ip-10-0-137-101.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m58jh","openshift-cluster-node-tuning-operator/tuned-6zjv8","openshift-dns/node-resolver-v8vnr","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal","openshift-multus/multus-additional-cni-plugins-p5ggd","openshift-multus/multus-d22jx","kube-system/konnectivity-agent-blxtv","openshift-image-registry/node-ca-2t8rd","openshift-multus/network-metrics-daemon-x4brx","openshift-network-diagnostics/network-check-target-vs75x"] Jul 10 14:31:24.291091 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.291063 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.292351 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.292331 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:31:24.292452 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:24.292400 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4brx" podUID="ea476f2b-59d7-4272-be5c-30a782f21228" Jul 10 14:31:24.293283 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.293265 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 10 14:31:24.293703 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.293685 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:31:24.293774 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:24.293751 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc6vj" podUID="031289f7-f9ec-407f-8fa5-98afbc1755a3" Jul 10 14:31:24.293829 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.293821 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 10 14:31:24.293900 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.293882 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 10 14:31:24.294086 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.294069 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-srpsq\"" Jul 10 14:31:24.294154 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.294081 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 10 14:31:24.294953 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.294936 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:31:24.295043 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:24.295015 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs75x" podUID="81b8479f-42ac-4f15-8e01-1dd667debc38" Jul 10 14:31:24.296447 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.296430 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m58jh" Jul 10 14:31:24.297635 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.297616 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.298752 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.298733 2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 10 14:31:24.299350 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.299035 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p5ggd" Jul 10 14:31:24.300055 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.300035 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 10 14:31:24.301170 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.301045 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v8vnr" Jul 10 14:31:24.301594 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.301565 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-7fsgc\"" Jul 10 14:31:24.302384 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.302089 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.302384 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.302137 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 10 14:31:24.303082 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.302636 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 10 14:31:24.303082 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.303070 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rthdk\"" Jul 10 14:31:24.303808 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.303319 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 10 14:31:24.303808 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.303612 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 10 14:31:24.303808 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.303766 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n5n25" Jul 10 14:31:24.304277 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.304154 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 10 14:31:24.304277 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.304153 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 10 14:31:24.305615 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.304793 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 10 14:31:24.305615 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.305027 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 10 14:31:24.305615 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.305238 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-blxtv" Jul 10 14:31:24.305615 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.305370 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5574c\"" Jul 10 14:31:24.305906 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.305787 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-m5w69\"" Jul 10 14:31:24.305959 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.305941 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-468w4\"" Jul 10 14:31:24.306275 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.306252 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2t8rd" Jul 10 14:31:24.307765 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.307579 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 10 14:31:24.307765 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.307628 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 10 14:31:24.307907 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.307776 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 10 14:31:24.309884 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.309857 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-host-run-k8s-cni-cncf-io\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.309984 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.309888 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 10 14:31:24.310034 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.309891 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-host-run-netns\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.310068 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310047 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p5ggd\" (UID: \"6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7\") " pod="openshift-multus/multus-additional-cni-plugins-p5ggd" Jul 10 14:31:24.310104 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310074 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p5ggd\" (UID: \"6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7\") " pod="openshift-multus/multus-additional-cni-plugins-p5ggd" Jul 10 14:31:24.310162 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310101 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-host-var-lib-cni-multus\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.310162 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310125 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p5ggd\" (UID: \"6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7\") " pod="openshift-multus/multus-additional-cni-plugins-p5ggd" Jul 10 14:31:24.310162 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310150 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea476f2b-59d7-4272-be5c-30a782f21228-metrics-certs\") pod \"network-metrics-daemon-x4brx\" (UID: \"ea476f2b-59d7-4272-be5c-30a782f21228\") " pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:31:24.310288 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310176 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f7169583-ddb5-4d40-8439-20a12c8caaec-etc-sysctl-conf\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.310288 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310200 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a4590cfe-fd78-40e0-b45e-6752cc4aef69-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m58jh\" (UID: \"a4590cfe-fd78-40e0-b45e-6752cc4aef69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m58jh" Jul 10 14:31:24.310288 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310231 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a4590cfe-fd78-40e0-b45e-6752cc4aef69-sys-fs\") pod \"aws-ebs-csi-driver-node-m58jh\" (UID: \"a4590cfe-fd78-40e0-b45e-6752cc4aef69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m58jh" Jul 10 14:31:24.310288 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310277 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdvtj\" (UniqueName: \"kubernetes.io/projected/ea476f2b-59d7-4272-be5c-30a782f21228-kube-api-access-pdvtj\") pod \"network-metrics-daemon-x4brx\" (UID: \"ea476f2b-59d7-4272-be5c-30a782f21228\") " pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:31:24.310463 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310304 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f7169583-ddb5-4d40-8439-20a12c8caaec-host\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.310463 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310327 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-multus-cni-dir\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.310463 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310368 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/031289f7-f9ec-407f-8fa5-98afbc1755a3-original-pull-secret\") pod \"global-pull-secret-syncer-tc6vj\" (UID: \"031289f7-f9ec-407f-8fa5-98afbc1755a3\") " pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:31:24.310463 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310398 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f7169583-ddb5-4d40-8439-20a12c8caaec-run\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.310463 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310423 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 10 14:31:24.310463 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310427 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7169583-ddb5-4d40-8439-20a12c8caaec-var-lib-kubelet\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.310463 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310429 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 10 14:31:24.310795 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310453 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-host-var-lib-cni-bin\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.310795 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310494 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/345640dc-39fb-4506-bc54-31d2d64a8868-hosts-file\") pod \"node-resolver-v8vnr\" (UID: \"345640dc-39fb-4506-bc54-31d2d64a8868\") " pod="openshift-dns/node-resolver-v8vnr" Jul 10 14:31:24.310795 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310530 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f7169583-ddb5-4d40-8439-20a12c8caaec-etc-sysctl-d\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.310795 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310552 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f7169583-ddb5-4d40-8439-20a12c8caaec-sys\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.310795 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310578 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/20de4a51-a82e-45c4-b3f5-7bc548674778-cni-binary-copy\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.310795 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310623 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-etc-kubernetes\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.310795 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310656 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a4590cfe-fd78-40e0-b45e-6752cc4aef69-etc-selinux\") pod \"aws-ebs-csi-driver-node-m58jh\" (UID: \"a4590cfe-fd78-40e0-b45e-6752cc4aef69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m58jh" Jul 10 14:31:24.310795 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310678 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj7qb\" (UniqueName: \"kubernetes.io/projected/20de4a51-a82e-45c4-b3f5-7bc548674778-kube-api-access-jj7qb\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.310795 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310701 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7-cni-binary-copy\") pod \"multus-additional-cni-plugins-p5ggd\" (UID: \"6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7\") " pod="openshift-multus/multus-additional-cni-plugins-p5ggd" Jul 10 14:31:24.310795 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310726 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/345640dc-39fb-4506-bc54-31d2d64a8868-tmp-dir\") pod \"node-resolver-v8vnr\" (UID: \"345640dc-39fb-4506-bc54-31d2d64a8868\") " pod="openshift-dns/node-resolver-v8vnr" Jul 10 14:31:24.310795 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310748 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f7169583-ddb5-4d40-8439-20a12c8caaec-etc-tuned\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.310795 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310776 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/20de4a51-a82e-45c4-b3f5-7bc548674778-multus-daemon-config\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.311392 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310816 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd6xt\" (UniqueName: \"kubernetes.io/projected/81b8479f-42ac-4f15-8e01-1dd667debc38-kube-api-access-pd6xt\") pod \"network-check-target-vs75x\" (UID: \"81b8479f-42ac-4f15-8e01-1dd667debc38\") " pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:31:24.311392 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310849 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a4590cfe-fd78-40e0-b45e-6752cc4aef69-socket-dir\") pod \"aws-ebs-csi-driver-node-m58jh\" (UID: \"a4590cfe-fd78-40e0-b45e-6752cc4aef69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m58jh" Jul 10 14:31:24.311392 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310876 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7-cnibin\") pod \"multus-additional-cni-plugins-p5ggd\" (UID: \"6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7\") " pod="openshift-multus/multus-additional-cni-plugins-p5ggd" Jul 10 14:31:24.311392 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310900 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/031289f7-f9ec-407f-8fa5-98afbc1755a3-dbus\") pod \"global-pull-secret-syncer-tc6vj\" (UID: \"031289f7-f9ec-407f-8fa5-98afbc1755a3\") " pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:31:24.311392 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310926 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f7169583-ddb5-4d40-8439-20a12c8caaec-tmp\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.311392 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310948 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fshjh\" (UniqueName: \"kubernetes.io/projected/f7169583-ddb5-4d40-8439-20a12c8caaec-kube-api-access-fshjh\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.311392 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.310985 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a4590cfe-fd78-40e0-b45e-6752cc4aef69-device-dir\") pod \"aws-ebs-csi-driver-node-m58jh\" (UID: \"a4590cfe-fd78-40e0-b45e-6752cc4aef69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m58jh" Jul 10 14:31:24.311392 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.311009 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/031289f7-f9ec-407f-8fa5-98afbc1755a3-kubelet-config\") pod \"global-pull-secret-syncer-tc6vj\" (UID: \"031289f7-f9ec-407f-8fa5-98afbc1755a3\") " pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:31:24.311392 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.311031 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f7169583-ddb5-4d40-8439-20a12c8caaec-lib-modules\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.311392 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.311055 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-multus-socket-dir-parent\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.311392 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.311085 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-hostroot\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.311392 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.311107 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7-system-cni-dir\") pod \"multus-additional-cni-plugins-p5ggd\" (UID: \"6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7\") " pod="openshift-multus/multus-additional-cni-plugins-p5ggd" Jul 10 14:31:24.311392 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.311129 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f7169583-ddb5-4d40-8439-20a12c8caaec-etc-sysconfig\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.311392 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.311153 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-host-run-multus-certs\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.311392 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.311201 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7-os-release\") pod \"multus-additional-cni-plugins-p5ggd\" (UID: \"6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7\") " pod="openshift-multus/multus-additional-cni-plugins-p5ggd" Jul 10 14:31:24.311392 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.311243 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f7169583-ddb5-4d40-8439-20a12c8caaec-etc-modprobe-d\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.312287 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.311267 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7169583-ddb5-4d40-8439-20a12c8caaec-etc-kubernetes\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.312287 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.311336 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-system-cni-dir\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.312287 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.311373 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a4590cfe-fd78-40e0-b45e-6752cc4aef69-registration-dir\") pod \"aws-ebs-csi-driver-node-m58jh\" (UID: \"a4590cfe-fd78-40e0-b45e-6752cc4aef69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m58jh" Jul 10 14:31:24.312287 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.311399 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqs5m\" (UniqueName: \"kubernetes.io/projected/345640dc-39fb-4506-bc54-31d2d64a8868-kube-api-access-vqs5m\") pod \"node-resolver-v8vnr\" (UID: \"345640dc-39fb-4506-bc54-31d2d64a8868\") " pod="openshift-dns/node-resolver-v8vnr" Jul 10 14:31:24.312287 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.311421 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f7169583-ddb5-4d40-8439-20a12c8caaec-etc-systemd\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.312287 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.311456 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-os-release\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.312287 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.311488 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-host-var-lib-kubelet\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.312287 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.311521 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-multus-conf-dir\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.312287 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.311549 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttrk7\" (UniqueName: \"kubernetes.io/projected/a4590cfe-fd78-40e0-b45e-6752cc4aef69-kube-api-access-ttrk7\") pod \"aws-ebs-csi-driver-node-m58jh\" (UID: \"a4590cfe-fd78-40e0-b45e-6752cc4aef69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m58jh" Jul 10 14:31:24.312287 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.311577 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4wbk\" (UniqueName: \"kubernetes.io/projected/6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7-kube-api-access-z4wbk\") pod \"multus-additional-cni-plugins-p5ggd\" (UID: \"6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7\") " pod="openshift-multus/multus-additional-cni-plugins-p5ggd" Jul 10 14:31:24.312287 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.311603 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-cnibin\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.312733 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.312368 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 10 14:31:24.312733 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.312496 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 10 14:31:24.315296 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.314926 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7pr2x\"" Jul 10 14:31:24.315296 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.315089 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 10 14:31:24.315296 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.315184 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 10 14:31:24.315478 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.315378 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 10 14:31:24.315478 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.315469 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 10 14:31:24.316908 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.316501 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 10 14:31:24.316908 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.316613 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gb6hm\"" Jul 10 14:31:24.319235 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.317664 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m7nwc\"" Jul 10 14:31:24.330102 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.330077 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 10 14:31:24.332467 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.332443 2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 10 14:31:24.376880 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.376854 2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8xb8j" Jul 10 14:31:24.385322 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.385249 2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8xb8j" Jul 10 14:31:24.400374 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.400295 2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 10 14:31:24.412528 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.412495 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.412684 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.412540 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/58c5a8ee-cb71-42ce-9cfb-a30ce75051f0-iptables-alerter-script\") pod \"iptables-alerter-n5n25\" (UID: \"58c5a8ee-cb71-42ce-9cfb-a30ce75051f0\") " pod="openshift-network-operator/iptables-alerter-n5n25" Jul 10 14:31:24.412684 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.412594 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f7169583-ddb5-4d40-8439-20a12c8caaec-etc-sysctl-conf\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.412684 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.412643 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a4590cfe-fd78-40e0-b45e-6752cc4aef69-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m58jh\" (UID: \"a4590cfe-fd78-40e0-b45e-6752cc4aef69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m58jh" Jul 10 14:31:24.412684 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.412679 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a4590cfe-fd78-40e0-b45e-6752cc4aef69-sys-fs\") pod \"aws-ebs-csi-driver-node-m58jh\" (UID: \"a4590cfe-fd78-40e0-b45e-6752cc4aef69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m58jh" Jul 10 14:31:24.412990 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.412701 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdvtj\" (UniqueName: \"kubernetes.io/projected/ea476f2b-59d7-4272-be5c-30a782f21228-kube-api-access-pdvtj\") pod \"network-metrics-daemon-x4brx\" (UID: \"ea476f2b-59d7-4272-be5c-30a782f21228\") " pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:31:24.412990 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.412763 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a4590cfe-fd78-40e0-b45e-6752cc4aef69-sys-fs\") pod \"aws-ebs-csi-driver-node-m58jh\" (UID: \"a4590cfe-fd78-40e0-b45e-6752cc4aef69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m58jh" Jul 10 14:31:24.412990 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.412790 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f7169583-ddb5-4d40-8439-20a12c8caaec-host\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.412990 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.412816 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-multus-cni-dir\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.412990 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.412852 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/031289f7-f9ec-407f-8fa5-98afbc1755a3-original-pull-secret\") pod \"global-pull-secret-syncer-tc6vj\" (UID: \"031289f7-f9ec-407f-8fa5-98afbc1755a3\") " pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:31:24.412990 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.412877 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-host-run-netns\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.412990 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.412900 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f7169583-ddb5-4d40-8439-20a12c8caaec-run\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.412990 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.412923 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7169583-ddb5-4d40-8439-20a12c8caaec-var-lib-kubelet\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.413388 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.413001 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f7169583-ddb5-4d40-8439-20a12c8caaec-run\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.413388 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.413040 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-host-var-lib-cni-bin\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.413388 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.413065 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/345640dc-39fb-4506-bc54-31d2d64a8868-hosts-file\") pod \"node-resolver-v8vnr\" (UID: \"345640dc-39fb-4506-bc54-31d2d64a8868\") " pod="openshift-dns/node-resolver-v8vnr" Jul 10 14:31:24.413388 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.413074 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a4590cfe-fd78-40e0-b45e-6752cc4aef69-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m58jh\" (UID: \"a4590cfe-fd78-40e0-b45e-6752cc4aef69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m58jh" Jul 10 14:31:24.413388 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.412763 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f7169583-ddb5-4d40-8439-20a12c8caaec-etc-sysctl-conf\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.413388 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.413096 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-host-kubelet\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.413388 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.413119 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5skd\" (UniqueName: \"kubernetes.io/projected/b7c12f35-7b1f-4341-9302-0dfe837776f8-kube-api-access-r5skd\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.413388 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.413144 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f7169583-ddb5-4d40-8439-20a12c8caaec-etc-sysctl-d\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.413388 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:24.413167 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 14:31:24.413388 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.413183 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f7169583-ddb5-4d40-8439-20a12c8caaec-sys\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.413388 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.413205 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/20de4a51-a82e-45c4-b3f5-7bc548674778-cni-binary-copy\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.413388 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:24.413230 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/031289f7-f9ec-407f-8fa5-98afbc1755a3-original-pull-secret podName:031289f7-f9ec-407f-8fa5-98afbc1755a3 nodeName:}" failed. No retries permitted until 2026-07-10 14:31:24.913208841 +0000 UTC m=+2.990870381 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/031289f7-f9ec-407f-8fa5-98afbc1755a3-original-pull-secret") pod "global-pull-secret-syncer-tc6vj" (UID: "031289f7-f9ec-407f-8fa5-98afbc1755a3") : object "kube-system"/"original-pull-secret" not registered Jul 10 14:31:24.413388 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.413254 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-etc-kubernetes\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.413388 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.413279 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a4590cfe-fd78-40e0-b45e-6752cc4aef69-etc-selinux\") pod \"aws-ebs-csi-driver-node-m58jh\" (UID: \"a4590cfe-fd78-40e0-b45e-6752cc4aef69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m58jh" Jul 10 14:31:24.413388 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.413304 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b7c12f35-7b1f-4341-9302-0dfe837776f8-env-overrides\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.413388 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.413348 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/58c5a8ee-cb71-42ce-9cfb-a30ce75051f0-host-slash\") pod \"iptables-alerter-n5n25\" (UID: \"58c5a8ee-cb71-42ce-9cfb-a30ce75051f0\") " pod="openshift-network-operator/iptables-alerter-n5n25" Jul 10 14:31:24.413388 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.413372 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cd58d732-88c2-4445-9682-a34d2488896e-serviceca\") pod \"node-ca-2t8rd\" (UID: \"cd58d732-88c2-4445-9682-a34d2488896e\") " pod="openshift-image-registry/node-ca-2t8rd" Jul 10 14:31:24.414259 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.413413 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj7qb\" (UniqueName: \"kubernetes.io/projected/20de4a51-a82e-45c4-b3f5-7bc548674778-kube-api-access-jj7qb\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.414259 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.413520 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7-cni-binary-copy\") pod \"multus-additional-cni-plugins-p5ggd\" (UID: \"6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7\") " pod="openshift-multus/multus-additional-cni-plugins-p5ggd" Jul 10 14:31:24.414259 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.413566 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/345640dc-39fb-4506-bc54-31d2d64a8868-tmp-dir\") pod \"node-resolver-v8vnr\" (UID: \"345640dc-39fb-4506-bc54-31d2d64a8868\") " pod="openshift-dns/node-resolver-v8vnr" Jul 10 14:31:24.414259 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.413592 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f7169583-ddb5-4d40-8439-20a12c8caaec-etc-tuned\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.414259 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.413621 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/20de4a51-a82e-45c4-b3f5-7bc548674778-multus-daemon-config\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.414259 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.413647 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd6xt\" (UniqueName: \"kubernetes.io/projected/81b8479f-42ac-4f15-8e01-1dd667debc38-kube-api-access-pd6xt\") pod \"network-check-target-vs75x\" (UID: \"81b8479f-42ac-4f15-8e01-1dd667debc38\") " pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:31:24.414259 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.413674 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a4590cfe-fd78-40e0-b45e-6752cc4aef69-socket-dir\") pod \"aws-ebs-csi-driver-node-m58jh\" (UID: \"a4590cfe-fd78-40e0-b45e-6752cc4aef69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m58jh" Jul 10 14:31:24.414259 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.413701 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7-cnibin\") pod \"multus-additional-cni-plugins-p5ggd\" (UID: \"6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7\") " pod="openshift-multus/multus-additional-cni-plugins-p5ggd" Jul 10 14:31:24.414259 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.413727 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/031289f7-f9ec-407f-8fa5-98afbc1755a3-dbus\") pod \"global-pull-secret-syncer-tc6vj\" (UID: \"031289f7-f9ec-407f-8fa5-98afbc1755a3\") " pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:31:24.414259 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.413752 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-etc-openvswitch\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.414259 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.413778 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f7169583-ddb5-4d40-8439-20a12c8caaec-tmp\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.414259 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.413792 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/20de4a51-a82e-45c4-b3f5-7bc548674778-cni-binary-copy\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.414259 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.413805 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fshjh\" (UniqueName: \"kubernetes.io/projected/f7169583-ddb5-4d40-8439-20a12c8caaec-kube-api-access-fshjh\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.414259 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.413895 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7-cnibin\") pod \"multus-additional-cni-plugins-p5ggd\" (UID: \"6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7\") " pod="openshift-multus/multus-additional-cni-plugins-p5ggd" Jul 10 14:31:24.414259 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.413902 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7169583-ddb5-4d40-8439-20a12c8caaec-var-lib-kubelet\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.414259 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.413935 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a4590cfe-fd78-40e0-b45e-6752cc4aef69-device-dir\") pod \"aws-ebs-csi-driver-node-m58jh\" (UID: \"a4590cfe-fd78-40e0-b45e-6752cc4aef69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m58jh" Jul 10 14:31:24.414259 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.413961 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/031289f7-f9ec-407f-8fa5-98afbc1755a3-kubelet-config\") pod \"global-pull-secret-syncer-tc6vj\" (UID: \"031289f7-f9ec-407f-8fa5-98afbc1755a3\") " pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:31:24.415050 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.414013 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-run-openvswitch\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.415050 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.414037 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cd58d732-88c2-4445-9682-a34d2488896e-host\") pod \"node-ca-2t8rd\" (UID: \"cd58d732-88c2-4445-9682-a34d2488896e\") " pod="openshift-image-registry/node-ca-2t8rd" Jul 10 14:31:24.415050 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.414068 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f7169583-ddb5-4d40-8439-20a12c8caaec-lib-modules\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.415050 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.414092 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-multus-socket-dir-parent\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.415050 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.414126 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-hostroot\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.415050 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.414170 2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 10 14:31:24.415050 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.414180 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-hostroot\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.415050 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.414246 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a4590cfe-fd78-40e0-b45e-6752cc4aef69-etc-selinux\") pod \"aws-ebs-csi-driver-node-m58jh\" (UID: \"a4590cfe-fd78-40e0-b45e-6752cc4aef69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m58jh" Jul 10 14:31:24.415050 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.414259 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a4590cfe-fd78-40e0-b45e-6752cc4aef69-device-dir\") pod \"aws-ebs-csi-driver-node-m58jh\" (UID: \"a4590cfe-fd78-40e0-b45e-6752cc4aef69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m58jh" Jul 10 14:31:24.415050 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.414316 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-multus-cni-dir\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.415050 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.414350 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7-system-cni-dir\") pod \"multus-additional-cni-plugins-p5ggd\" (UID: \"6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7\") " pod="openshift-multus/multus-additional-cni-plugins-p5ggd" Jul 10 14:31:24.415050 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.414620 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f7169583-ddb5-4d40-8439-20a12c8caaec-host\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.415050 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.414629 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/20de4a51-a82e-45c4-b3f5-7bc548674778-multus-daemon-config\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.415050 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.414657 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/345640dc-39fb-4506-bc54-31d2d64a8868-hosts-file\") pod \"node-resolver-v8vnr\" (UID: \"345640dc-39fb-4506-bc54-31d2d64a8868\") " pod="openshift-dns/node-resolver-v8vnr" Jul 10 14:31:24.415050 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.414771 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f7169583-ddb5-4d40-8439-20a12c8caaec-etc-sysctl-d\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.415050 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.414799 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f7169583-ddb5-4d40-8439-20a12c8caaec-lib-modules\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.415050 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.414807 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-etc-kubernetes\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.415050 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.414821 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7-cni-binary-copy\") pod \"multus-additional-cni-plugins-p5ggd\" (UID: \"6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7\") " pod="openshift-multus/multus-additional-cni-plugins-p5ggd" Jul 10 14:31:24.415861 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.414836 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-host-var-lib-cni-bin\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.415861 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.414858 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/031289f7-f9ec-407f-8fa5-98afbc1755a3-kubelet-config\") pod \"global-pull-secret-syncer-tc6vj\" (UID: \"031289f7-f9ec-407f-8fa5-98afbc1755a3\") " pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:31:24.415861 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.414861 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/345640dc-39fb-4506-bc54-31d2d64a8868-tmp-dir\") pod \"node-resolver-v8vnr\" (UID: \"345640dc-39fb-4506-bc54-31d2d64a8868\") " pod="openshift-dns/node-resolver-v8vnr" Jul 10 14:31:24.415861 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.414873 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-run-ovn\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.415861 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.414899 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-node-log\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.415861 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.414906 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7-system-cni-dir\") pod \"multus-additional-cni-plugins-p5ggd\" (UID: \"6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7\") " pod="openshift-multus/multus-additional-cni-plugins-p5ggd" Jul 10 14:31:24.415861 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.414914 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-multus-socket-dir-parent\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.415861 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.414922 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-log-socket\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.415861 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.414871 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f7169583-ddb5-4d40-8439-20a12c8caaec-sys\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.415861 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415023 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/031289f7-f9ec-407f-8fa5-98afbc1755a3-dbus\") pod \"global-pull-secret-syncer-tc6vj\" (UID: \"031289f7-f9ec-407f-8fa5-98afbc1755a3\") " pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:31:24.415861 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415037 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a4590cfe-fd78-40e0-b45e-6752cc4aef69-socket-dir\") pod \"aws-ebs-csi-driver-node-m58jh\" (UID: \"a4590cfe-fd78-40e0-b45e-6752cc4aef69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m58jh" Jul 10 14:31:24.415861 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415063 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm8mp\" (UniqueName: \"kubernetes.io/projected/58c5a8ee-cb71-42ce-9cfb-a30ce75051f0-kube-api-access-cm8mp\") pod \"iptables-alerter-n5n25\" (UID: \"58c5a8ee-cb71-42ce-9cfb-a30ce75051f0\") " pod="openshift-network-operator/iptables-alerter-n5n25" Jul 10 14:31:24.415861 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415090 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f7169583-ddb5-4d40-8439-20a12c8caaec-etc-sysconfig\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.415861 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415129 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-host-run-multus-certs\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.415861 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415158 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f7169583-ddb5-4d40-8439-20a12c8caaec-etc-sysconfig\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.415861 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415161 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7-os-release\") pod \"multus-additional-cni-plugins-p5ggd\" (UID: \"6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7\") " pod="openshift-multus/multus-additional-cni-plugins-p5ggd" Jul 10 14:31:24.415861 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415189 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-systemd-units\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.416678 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415196 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-host-run-multus-certs\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.416678 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415213 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-host-slash\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.416678 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415238 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f7169583-ddb5-4d40-8439-20a12c8caaec-etc-modprobe-d\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.416678 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415252 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7-os-release\") pod \"multus-additional-cni-plugins-p5ggd\" (UID: \"6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7\") " pod="openshift-multus/multus-additional-cni-plugins-p5ggd" Jul 10 14:31:24.416678 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415264 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7169583-ddb5-4d40-8439-20a12c8caaec-etc-kubernetes\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.416678 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415286 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-system-cni-dir\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.416678 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415310 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a4590cfe-fd78-40e0-b45e-6752cc4aef69-registration-dir\") pod \"aws-ebs-csi-driver-node-m58jh\" (UID: \"a4590cfe-fd78-40e0-b45e-6752cc4aef69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m58jh" Jul 10 14:31:24.416678 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415324 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f7169583-ddb5-4d40-8439-20a12c8caaec-etc-kubernetes\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.416678 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415336 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqs5m\" (UniqueName: \"kubernetes.io/projected/345640dc-39fb-4506-bc54-31d2d64a8868-kube-api-access-vqs5m\") pod \"node-resolver-v8vnr\" (UID: \"345640dc-39fb-4506-bc54-31d2d64a8868\") " pod="openshift-dns/node-resolver-v8vnr" Jul 10 14:31:24.416678 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415362 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b7c12f35-7b1f-4341-9302-0dfe837776f8-ovn-node-metrics-cert\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.416678 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415326 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f7169583-ddb5-4d40-8439-20a12c8caaec-etc-modprobe-d\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.416678 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415385 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a4590cfe-fd78-40e0-b45e-6752cc4aef69-registration-dir\") pod \"aws-ebs-csi-driver-node-m58jh\" (UID: \"a4590cfe-fd78-40e0-b45e-6752cc4aef69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m58jh" Jul 10 14:31:24.416678 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415388 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f7169583-ddb5-4d40-8439-20a12c8caaec-etc-systemd\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.416678 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415413 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-os-release\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.416678 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415438 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-host-var-lib-kubelet\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.416678 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415366 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-system-cni-dir\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.416678 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415434 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f7169583-ddb5-4d40-8439-20a12c8caaec-etc-systemd\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.417492 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415478 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b7c12f35-7b1f-4341-9302-0dfe837776f8-ovnkube-script-lib\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.417492 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415503 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d133399-fc4f-49c3-9dca-7fd75f87add1-agent-certs\") pod \"konnectivity-agent-blxtv\" (UID: \"7d133399-fc4f-49c3-9dca-7fd75f87add1\") " pod="kube-system/konnectivity-agent-blxtv" Jul 10 14:31:24.417492 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415516 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-host-var-lib-kubelet\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.417492 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415525 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-os-release\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.417492 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415527 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d133399-fc4f-49c3-9dca-7fd75f87add1-konnectivity-ca\") pod \"konnectivity-agent-blxtv\" (UID: \"7d133399-fc4f-49c3-9dca-7fd75f87add1\") " pod="kube-system/konnectivity-agent-blxtv" Jul 10 14:31:24.417492 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415568 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-multus-conf-dir\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.417492 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415601 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttrk7\" (UniqueName: \"kubernetes.io/projected/a4590cfe-fd78-40e0-b45e-6752cc4aef69-kube-api-access-ttrk7\") pod \"aws-ebs-csi-driver-node-m58jh\" (UID: \"a4590cfe-fd78-40e0-b45e-6752cc4aef69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m58jh" Jul 10 14:31:24.417492 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415634 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-multus-conf-dir\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.417492 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415675 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4wbk\" (UniqueName: \"kubernetes.io/projected/6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7-kube-api-access-z4wbk\") pod \"multus-additional-cni-plugins-p5ggd\" (UID: \"6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7\") " pod="openshift-multus/multus-additional-cni-plugins-p5ggd" Jul 10 14:31:24.417492 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415802 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-host-run-ovn-kubernetes\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.417492 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415904 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-cnibin\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.417492 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415976 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-cnibin\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.417492 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.415960 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-run-systemd\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.417492 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.416017 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-var-lib-openvswitch\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.417492 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.416055 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-host-cni-netd\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.417492 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.416088 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b7c12f35-7b1f-4341-9302-0dfe837776f8-ovnkube-config\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.417492 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.416114 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-host-run-k8s-cni-cncf-io\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.419078 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.416138 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-host-run-netns\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.419078 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.416163 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p5ggd\" (UID: \"6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7\") " pod="openshift-multus/multus-additional-cni-plugins-p5ggd" Jul 10 14:31:24.419078 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.416166 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-host-run-k8s-cni-cncf-io\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.419078 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.416200 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p5ggd\" (UID: \"6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7\") " pod="openshift-multus/multus-additional-cni-plugins-p5ggd" Jul 10 14:31:24.419078 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.416218 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-host-run-netns\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.419078 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.416255 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6k7w\" (UniqueName: \"kubernetes.io/projected/cd58d732-88c2-4445-9682-a34d2488896e-kube-api-access-d6k7w\") pod \"node-ca-2t8rd\" (UID: \"cd58d732-88c2-4445-9682-a34d2488896e\") " pod="openshift-image-registry/node-ca-2t8rd" Jul 10 14:31:24.419078 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.416284 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-host-var-lib-cni-multus\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.419078 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.416309 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p5ggd\" (UID: \"6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7\") " pod="openshift-multus/multus-additional-cni-plugins-p5ggd" Jul 10 14:31:24.419078 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.416333 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea476f2b-59d7-4272-be5c-30a782f21228-metrics-certs\") pod \"network-metrics-daemon-x4brx\" (UID: \"ea476f2b-59d7-4272-be5c-30a782f21228\") " pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:31:24.419078 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.416357 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-host-cni-bin\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.419078 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.416377 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/20de4a51-a82e-45c4-b3f5-7bc548674778-host-var-lib-cni-multus\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.419078 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:24.416471 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:31:24.419078 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.416516 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p5ggd\" (UID: \"6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7\") " pod="openshift-multus/multus-additional-cni-plugins-p5ggd" Jul 10 14:31:24.419078 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:24.416535 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea476f2b-59d7-4272-be5c-30a782f21228-metrics-certs podName:ea476f2b-59d7-4272-be5c-30a782f21228 nodeName:}" failed. No retries permitted until 2026-07-10 14:31:24.916515608 +0000 UTC m=+2.994177132 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea476f2b-59d7-4272-be5c-30a782f21228-metrics-certs") pod "network-metrics-daemon-x4brx" (UID: "ea476f2b-59d7-4272-be5c-30a782f21228") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:31:24.419078 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.416654 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p5ggd\" (UID: \"6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7\") " pod="openshift-multus/multus-additional-cni-plugins-p5ggd" Jul 10 14:31:24.419078 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.416667 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p5ggd\" (UID: \"6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7\") " pod="openshift-multus/multus-additional-cni-plugins-p5ggd" Jul 10 14:31:24.419078 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.417984 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f7169583-ddb5-4d40-8439-20a12c8caaec-tmp\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.419863 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.418126 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f7169583-ddb5-4d40-8439-20a12c8caaec-etc-tuned\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.423817 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:24.423795 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 14:31:24.423963 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:24.423820 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 14:31:24.423963 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:24.423834 2571 projected.go:196] Error preparing data for projected volume kube-api-access-pd6xt for pod openshift-network-diagnostics/network-check-target-vs75x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:31:24.423963 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:24.423904 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81b8479f-42ac-4f15-8e01-1dd667debc38-kube-api-access-pd6xt podName:81b8479f-42ac-4f15-8e01-1dd667debc38 nodeName:}" failed. No retries permitted until 2026-07-10 14:31:24.923885468 +0000 UTC m=+3.001546992 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pd6xt" (UniqueName: "kubernetes.io/projected/81b8479f-42ac-4f15-8e01-1dd667debc38-kube-api-access-pd6xt") pod "network-check-target-vs75x" (UID: "81b8479f-42ac-4f15-8e01-1dd667debc38") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:31:24.428337 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.428223 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdvtj\" (UniqueName: \"kubernetes.io/projected/ea476f2b-59d7-4272-be5c-30a782f21228-kube-api-access-pdvtj\") pod \"network-metrics-daemon-x4brx\" (UID: \"ea476f2b-59d7-4272-be5c-30a782f21228\") " pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:31:24.435644 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.435612 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj7qb\" (UniqueName: \"kubernetes.io/projected/20de4a51-a82e-45c4-b3f5-7bc548674778-kube-api-access-jj7qb\") pod \"multus-d22jx\" (UID: \"20de4a51-a82e-45c4-b3f5-7bc548674778\") " pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.436168 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.436144 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4wbk\" (UniqueName: \"kubernetes.io/projected/6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7-kube-api-access-z4wbk\") pod \"multus-additional-cni-plugins-p5ggd\" (UID: \"6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7\") " pod="openshift-multus/multus-additional-cni-plugins-p5ggd" Jul 10 14:31:24.436876 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.436852 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttrk7\" (UniqueName: \"kubernetes.io/projected/a4590cfe-fd78-40e0-b45e-6752cc4aef69-kube-api-access-ttrk7\") pod \"aws-ebs-csi-driver-node-m58jh\" (UID: \"a4590cfe-fd78-40e0-b45e-6752cc4aef69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m58jh" Jul 10 14:31:24.437496 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.437450 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqs5m\" (UniqueName: \"kubernetes.io/projected/345640dc-39fb-4506-bc54-31d2d64a8868-kube-api-access-vqs5m\") pod \"node-resolver-v8vnr\" (UID: \"345640dc-39fb-4506-bc54-31d2d64a8868\") " pod="openshift-dns/node-resolver-v8vnr" Jul 10 14:31:24.437784 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.437764 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fshjh\" (UniqueName: \"kubernetes.io/projected/f7169583-ddb5-4d40-8439-20a12c8caaec-kube-api-access-fshjh\") pod \"tuned-6zjv8\" (UID: \"f7169583-ddb5-4d40-8439-20a12c8caaec\") " pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.463484 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.463427 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-101.ec2.internal" event={"ID":"43b50c0f30ea9d35967a41671db4af49","Type":"ContainerStarted","Data":"301f4821cdf7d09d1f816be794387bbc540bbc80598045736a0bd156207503fc"} Jul 10 14:31:24.466084 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.466052 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal" event={"ID":"4369032deb28c5390acbf881f75e0450","Type":"ContainerStarted","Data":"a58e3eba0a94021df077b9c792e393c59167c55c3a6696fc4ed276cd1d4840de"} Jul 10 14:31:24.516908 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.516869 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-host-run-netns\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.517109 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.516919 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-host-kubelet\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.517109 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.516945 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5skd\" (UniqueName: \"kubernetes.io/projected/b7c12f35-7b1f-4341-9302-0dfe837776f8-kube-api-access-r5skd\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.517109 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.516985 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b7c12f35-7b1f-4341-9302-0dfe837776f8-env-overrides\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.517109 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.517010 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/58c5a8ee-cb71-42ce-9cfb-a30ce75051f0-host-slash\") pod \"iptables-alerter-n5n25\" (UID: \"58c5a8ee-cb71-42ce-9cfb-a30ce75051f0\") " pod="openshift-network-operator/iptables-alerter-n5n25" Jul 10 14:31:24.517109 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.517032 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cd58d732-88c2-4445-9682-a34d2488896e-serviceca\") pod \"node-ca-2t8rd\" (UID: \"cd58d732-88c2-4445-9682-a34d2488896e\") " pod="openshift-image-registry/node-ca-2t8rd" Jul 10 14:31:24.517109 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.517072 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-etc-openvswitch\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.517109 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.517098 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-run-openvswitch\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.517458 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.517120 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cd58d732-88c2-4445-9682-a34d2488896e-host\") pod \"node-ca-2t8rd\" (UID: \"cd58d732-88c2-4445-9682-a34d2488896e\") " pod="openshift-image-registry/node-ca-2t8rd" Jul 10 14:31:24.517458 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.517146 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-run-ovn\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.517458 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.517168 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-node-log\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.517458 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.517190 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-log-socket\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.517458 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.517212 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm8mp\" (UniqueName: \"kubernetes.io/projected/58c5a8ee-cb71-42ce-9cfb-a30ce75051f0-kube-api-access-cm8mp\") pod \"iptables-alerter-n5n25\" (UID: \"58c5a8ee-cb71-42ce-9cfb-a30ce75051f0\") " pod="openshift-network-operator/iptables-alerter-n5n25" Jul 10 14:31:24.517458 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.517238 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-systemd-units\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.517458 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.517261 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-host-slash\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.517458 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.517315 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b7c12f35-7b1f-4341-9302-0dfe837776f8-ovn-node-metrics-cert\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.517458 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.517315 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-etc-openvswitch\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.517458 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.517344 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b7c12f35-7b1f-4341-9302-0dfe837776f8-ovnkube-script-lib\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.517458 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.517368 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d133399-fc4f-49c3-9dca-7fd75f87add1-agent-certs\") pod \"konnectivity-agent-blxtv\" (UID: \"7d133399-fc4f-49c3-9dca-7fd75f87add1\") " pod="kube-system/konnectivity-agent-blxtv" Jul 10 14:31:24.517458 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.517376 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-host-run-netns\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.517458 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.517394 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d133399-fc4f-49c3-9dca-7fd75f87add1-konnectivity-ca\") pod \"konnectivity-agent-blxtv\" (UID: \"7d133399-fc4f-49c3-9dca-7fd75f87add1\") " pod="kube-system/konnectivity-agent-blxtv" Jul 10 14:31:24.517458 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.517418 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-host-kubelet\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.517458 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.517421 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-host-run-ovn-kubernetes\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.517458 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.517455 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-run-systemd\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.518214 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.517473 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-host-run-ovn-kubernetes\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.518214 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.517480 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-var-lib-openvswitch\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.518214 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.517519 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-host-cni-netd\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.518214 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.517514 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-var-lib-openvswitch\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.518214 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.517545 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b7c12f35-7b1f-4341-9302-0dfe837776f8-ovnkube-config\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.518214 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.517590 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6k7w\" (UniqueName: \"kubernetes.io/projected/cd58d732-88c2-4445-9682-a34d2488896e-kube-api-access-d6k7w\") pod \"node-ca-2t8rd\" (UID: \"cd58d732-88c2-4445-9682-a34d2488896e\") " pod="openshift-image-registry/node-ca-2t8rd" Jul 10 14:31:24.518214 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.517631 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-host-cni-bin\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.518214 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.517657 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.518214 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.517682 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/58c5a8ee-cb71-42ce-9cfb-a30ce75051f0-iptables-alerter-script\") pod \"iptables-alerter-n5n25\" (UID: \"58c5a8ee-cb71-42ce-9cfb-a30ce75051f0\") " pod="openshift-network-operator/iptables-alerter-n5n25" Jul 10 14:31:24.518214 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.518192 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b7c12f35-7b1f-4341-9302-0dfe837776f8-ovnkube-config\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.518708 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.518252 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-run-openvswitch\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.518708 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.518289 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cd58d732-88c2-4445-9682-a34d2488896e-host\") pod \"node-ca-2t8rd\" (UID: \"cd58d732-88c2-4445-9682-a34d2488896e\") " pod="openshift-image-registry/node-ca-2t8rd" Jul 10 14:31:24.518708 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.518295 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/58c5a8ee-cb71-42ce-9cfb-a30ce75051f0-iptables-alerter-script\") pod \"iptables-alerter-n5n25\" (UID: \"58c5a8ee-cb71-42ce-9cfb-a30ce75051f0\") " pod="openshift-network-operator/iptables-alerter-n5n25" Jul 10 14:31:24.518708 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.518329 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-run-ovn\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.518708 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.518354 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-run-systemd\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.518708 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.518367 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-node-log\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.518708 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.518396 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.518708 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.518411 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-log-socket\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.518708 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.518428 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-host-cni-bin\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.518708 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.518464 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cd58d732-88c2-4445-9682-a34d2488896e-serviceca\") pod \"node-ca-2t8rd\" (UID: \"cd58d732-88c2-4445-9682-a34d2488896e\") " pod="openshift-image-registry/node-ca-2t8rd" Jul 10 14:31:24.518708 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.518525 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/58c5a8ee-cb71-42ce-9cfb-a30ce75051f0-host-slash\") pod \"iptables-alerter-n5n25\" (UID: \"58c5a8ee-cb71-42ce-9cfb-a30ce75051f0\") " pod="openshift-network-operator/iptables-alerter-n5n25" Jul 10 14:31:24.518708 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.518637 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-systemd-units\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.519203 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.518742 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b7c12f35-7b1f-4341-9302-0dfe837776f8-env-overrides\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.519203 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.518938 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-host-slash\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.519203 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.519010 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b7c12f35-7b1f-4341-9302-0dfe837776f8-host-cni-netd\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.519358 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.519336 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b7c12f35-7b1f-4341-9302-0dfe837776f8-ovnkube-script-lib\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.519493 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.519470 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d133399-fc4f-49c3-9dca-7fd75f87add1-konnectivity-ca\") pod \"konnectivity-agent-blxtv\" (UID: \"7d133399-fc4f-49c3-9dca-7fd75f87add1\") " pod="kube-system/konnectivity-agent-blxtv" Jul 10 14:31:24.521730 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.521704 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b7c12f35-7b1f-4341-9302-0dfe837776f8-ovn-node-metrics-cert\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.522127 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.522108 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d133399-fc4f-49c3-9dca-7fd75f87add1-agent-certs\") pod \"konnectivity-agent-blxtv\" (UID: \"7d133399-fc4f-49c3-9dca-7fd75f87add1\") " pod="kube-system/konnectivity-agent-blxtv" Jul 10 14:31:24.529386 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.529348 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm8mp\" (UniqueName: \"kubernetes.io/projected/58c5a8ee-cb71-42ce-9cfb-a30ce75051f0-kube-api-access-cm8mp\") pod \"iptables-alerter-n5n25\" (UID: \"58c5a8ee-cb71-42ce-9cfb-a30ce75051f0\") " pod="openshift-network-operator/iptables-alerter-n5n25" Jul 10 14:31:24.529780 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.529755 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5skd\" (UniqueName: \"kubernetes.io/projected/b7c12f35-7b1f-4341-9302-0dfe837776f8-kube-api-access-r5skd\") pod \"ovnkube-node-7clbv\" (UID: \"b7c12f35-7b1f-4341-9302-0dfe837776f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.531615 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.531589 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6k7w\" (UniqueName: \"kubernetes.io/projected/cd58d732-88c2-4445-9682-a34d2488896e-kube-api-access-d6k7w\") pod \"node-ca-2t8rd\" (UID: \"cd58d732-88c2-4445-9682-a34d2488896e\") " pod="openshift-image-registry/node-ca-2t8rd" Jul 10 14:31:24.604775 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.604733 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-d22jx" Jul 10 14:31:24.612928 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:24.612902 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20de4a51_a82e_45c4_b3f5_7bc548674778.slice/crio-973ea3678d92dde6626ec1e4bb900bfc1f913bdc8a93df6dfd6591f8fc30d3d5 WatchSource:0}: Error finding container 973ea3678d92dde6626ec1e4bb900bfc1f913bdc8a93df6dfd6591f8fc30d3d5: Status 404 returned error can't find the container with id 973ea3678d92dde6626ec1e4bb900bfc1f913bdc8a93df6dfd6591f8fc30d3d5 Jul 10 14:31:24.614685 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.614664 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m58jh" Jul 10 14:31:24.623071 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:24.623004 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4590cfe_fd78_40e0_b45e_6752cc4aef69.slice/crio-ecdd0d3a736716d4b7d124aed58de394d5fe5ae00f75b7afbbebab2ee6fa072d WatchSource:0}: Error finding container ecdd0d3a736716d4b7d124aed58de394d5fe5ae00f75b7afbbebab2ee6fa072d: Status 404 returned error can't find the container with id ecdd0d3a736716d4b7d124aed58de394d5fe5ae00f75b7afbbebab2ee6fa072d Jul 10 14:31:24.627776 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.627756 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" Jul 10 14:31:24.635273 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.635248 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p5ggd" Jul 10 14:31:24.641352 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.641325 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v8vnr" Jul 10 14:31:24.650316 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.650284 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:24.659248 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.659225 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n5n25" Jul 10 14:31:24.668342 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.668312 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-blxtv" Jul 10 14:31:24.672458 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.672440 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2t8rd" Jul 10 14:31:24.920253 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.920170 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea476f2b-59d7-4272-be5c-30a782f21228-metrics-certs\") pod \"network-metrics-daemon-x4brx\" (UID: \"ea476f2b-59d7-4272-be5c-30a782f21228\") " pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:31:24.920253 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:24.920213 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/031289f7-f9ec-407f-8fa5-98afbc1755a3-original-pull-secret\") pod \"global-pull-secret-syncer-tc6vj\" (UID: \"031289f7-f9ec-407f-8fa5-98afbc1755a3\") " pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:31:24.920461 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:24.920322 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 14:31:24.920461 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:24.920377 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/031289f7-f9ec-407f-8fa5-98afbc1755a3-original-pull-secret podName:031289f7-f9ec-407f-8fa5-98afbc1755a3 nodeName:}" failed. No retries permitted until 2026-07-10 14:31:25.92036363 +0000 UTC m=+3.998025154 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/031289f7-f9ec-407f-8fa5-98afbc1755a3-original-pull-secret") pod "global-pull-secret-syncer-tc6vj" (UID: "031289f7-f9ec-407f-8fa5-98afbc1755a3") : object "kube-system"/"original-pull-secret" not registered Jul 10 14:31:24.920461 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:24.920322 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:31:24.920461 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:24.920454 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea476f2b-59d7-4272-be5c-30a782f21228-metrics-certs podName:ea476f2b-59d7-4272-be5c-30a782f21228 nodeName:}" failed. No retries permitted until 2026-07-10 14:31:25.920441675 +0000 UTC m=+3.998103210 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea476f2b-59d7-4272-be5c-30a782f21228-metrics-certs") pod "network-metrics-daemon-x4brx" (UID: "ea476f2b-59d7-4272-be5c-30a782f21228") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:31:25.021501 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:25.021463 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd6xt\" (UniqueName: \"kubernetes.io/projected/81b8479f-42ac-4f15-8e01-1dd667debc38-kube-api-access-pd6xt\") pod \"network-check-target-vs75x\" (UID: \"81b8479f-42ac-4f15-8e01-1dd667debc38\") " pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:31:25.021692 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:25.021657 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 14:31:25.021692 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:25.021684 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 14:31:25.021799 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:25.021698 2571 projected.go:196] Error preparing data for projected volume kube-api-access-pd6xt for pod openshift-network-diagnostics/network-check-target-vs75x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:31:25.021799 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:25.021762 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81b8479f-42ac-4f15-8e01-1dd667debc38-kube-api-access-pd6xt podName:81b8479f-42ac-4f15-8e01-1dd667debc38 nodeName:}" failed. No retries permitted until 2026-07-10 14:31:26.021743893 +0000 UTC m=+4.099405435 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pd6xt" (UniqueName: "kubernetes.io/projected/81b8479f-42ac-4f15-8e01-1dd667debc38-kube-api-access-pd6xt") pod "network-check-target-vs75x" (UID: "81b8479f-42ac-4f15-8e01-1dd667debc38") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:31:25.359339 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:25.359311 2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 14:31:25.387566 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:25.387531 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 14:26:24 +0000 UTC" deadline="2028-03-20 21:40:05.933590078 +0000 UTC" Jul 10 14:31:25.387566 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:25.387561 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14863h8m40.546032235s" Jul 10 14:31:25.453738 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:25.453708 2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 10 14:31:25.456853 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:25.456830 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:31:25.456961 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:25.456928 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc6vj" podUID="031289f7-f9ec-407f-8fa5-98afbc1755a3" Jul 10 14:31:25.457035 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:25.456988 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:31:25.457093 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:25.457076 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs75x" podUID="81b8479f-42ac-4f15-8e01-1dd667debc38" Jul 10 14:31:25.468950 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:25.468885 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m58jh" event={"ID":"a4590cfe-fd78-40e0-b45e-6752cc4aef69","Type":"ContainerStarted","Data":"ecdd0d3a736716d4b7d124aed58de394d5fe5ae00f75b7afbbebab2ee6fa072d"} Jul 10 14:31:25.470090 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:25.470067 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d22jx" event={"ID":"20de4a51-a82e-45c4-b3f5-7bc548674778","Type":"ContainerStarted","Data":"973ea3678d92dde6626ec1e4bb900bfc1f913bdc8a93df6dfd6591f8fc30d3d5"} Jul 10 14:31:25.623847 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:25.623810 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7169583_ddb5_4d40_8439_20a12c8caaec.slice/crio-efda0294490e976ef6969edb2773cbd52660d24b36d5869c5b583efb3781efaf WatchSource:0}: Error finding container efda0294490e976ef6969edb2773cbd52660d24b36d5869c5b583efb3781efaf: Status 404 returned error can't find the container with id efda0294490e976ef6969edb2773cbd52660d24b36d5869c5b583efb3781efaf Jul 10 14:31:25.631659 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:25.631627 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58c5a8ee_cb71_42ce_9cfb_a30ce75051f0.slice/crio-c0e41ef497fb397985b6ca310a6c6dca6ef3b03ca2f700755bc077dad03a7705 WatchSource:0}: Error finding container c0e41ef497fb397985b6ca310a6c6dca6ef3b03ca2f700755bc077dad03a7705: Status 404 returned error can't find the container with id c0e41ef497fb397985b6ca310a6c6dca6ef3b03ca2f700755bc077dad03a7705 Jul 10 14:31:25.632828 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:25.632807 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd58d732_88c2_4445_9682_a34d2488896e.slice/crio-7052c6396cf16f274290a67380f9fa45847ab287ff0088ab278ca483577df6a5 WatchSource:0}: Error finding container 7052c6396cf16f274290a67380f9fa45847ab287ff0088ab278ca483577df6a5: Status 404 returned error can't find the container with id 7052c6396cf16f274290a67380f9fa45847ab287ff0088ab278ca483577df6a5 Jul 10 14:31:25.633509 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:25.633278 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7c12f35_7b1f_4341_9302_0dfe837776f8.slice/crio-47b9d0ddb4261b9190b27c5c792ba932fba8c52cbb75e330e9c26aa5f88ba7e8 WatchSource:0}: Error finding container 47b9d0ddb4261b9190b27c5c792ba932fba8c52cbb75e330e9c26aa5f88ba7e8: Status 404 returned error can't find the container with id 47b9d0ddb4261b9190b27c5c792ba932fba8c52cbb75e330e9c26aa5f88ba7e8 Jul 10 14:31:25.635616 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:25.635531 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bc21e9c_43f2_47eb_a6a3_7e4ea43e55c7.slice/crio-0d6594f4172fde61cad1561e92b63ee0f9c0ae04dbf5acd7fac30d2e371c33ef WatchSource:0}: Error finding container 0d6594f4172fde61cad1561e92b63ee0f9c0ae04dbf5acd7fac30d2e371c33ef: Status 404 returned error can't find the container with id 0d6594f4172fde61cad1561e92b63ee0f9c0ae04dbf5acd7fac30d2e371c33ef Jul 10 14:31:25.636113 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:25.636013 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod345640dc_39fb_4506_bc54_31d2d64a8868.slice/crio-6c9c493e1297103aa6ba9bbab7ed5a8a19cfdc5466b5adca0ac9a98f48056328 WatchSource:0}: Error finding container 6c9c493e1297103aa6ba9bbab7ed5a8a19cfdc5466b5adca0ac9a98f48056328: Status 404 returned error can't find the container with id 6c9c493e1297103aa6ba9bbab7ed5a8a19cfdc5466b5adca0ac9a98f48056328 Jul 10 14:31:25.636741 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:31:25.636566 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d133399_fc4f_49c3_9dca_7fd75f87add1.slice/crio-b1a3edf5d18ae24fa8be00c2992121a89fb72061b73dab80728fa90d82efcc3b WatchSource:0}: Error finding container b1a3edf5d18ae24fa8be00c2992121a89fb72061b73dab80728fa90d82efcc3b: Status 404 returned error can't find the container with id b1a3edf5d18ae24fa8be00c2992121a89fb72061b73dab80728fa90d82efcc3b Jul 10 14:31:25.929601 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:25.929375 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea476f2b-59d7-4272-be5c-30a782f21228-metrics-certs\") pod \"network-metrics-daemon-x4brx\" (UID: \"ea476f2b-59d7-4272-be5c-30a782f21228\") " pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:31:25.929601 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:25.929588 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:31:25.929828 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:25.929630 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/031289f7-f9ec-407f-8fa5-98afbc1755a3-original-pull-secret\") pod \"global-pull-secret-syncer-tc6vj\" (UID: \"031289f7-f9ec-407f-8fa5-98afbc1755a3\") " pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:31:25.929828 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:25.929667 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea476f2b-59d7-4272-be5c-30a782f21228-metrics-certs podName:ea476f2b-59d7-4272-be5c-30a782f21228 nodeName:}" failed. No retries permitted until 2026-07-10 14:31:27.929644915 +0000 UTC m=+6.007306444 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea476f2b-59d7-4272-be5c-30a782f21228-metrics-certs") pod "network-metrics-daemon-x4brx" (UID: "ea476f2b-59d7-4272-be5c-30a782f21228") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:31:25.929828 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:25.929715 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 14:31:25.929828 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:25.929772 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/031289f7-f9ec-407f-8fa5-98afbc1755a3-original-pull-secret podName:031289f7-f9ec-407f-8fa5-98afbc1755a3 nodeName:}" failed. No retries permitted until 2026-07-10 14:31:27.929748829 +0000 UTC m=+6.007410369 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/031289f7-f9ec-407f-8fa5-98afbc1755a3-original-pull-secret") pod "global-pull-secret-syncer-tc6vj" (UID: "031289f7-f9ec-407f-8fa5-98afbc1755a3") : object "kube-system"/"original-pull-secret" not registered Jul 10 14:31:26.030459 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:26.030420 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd6xt\" (UniqueName: \"kubernetes.io/projected/81b8479f-42ac-4f15-8e01-1dd667debc38-kube-api-access-pd6xt\") pod \"network-check-target-vs75x\" (UID: \"81b8479f-42ac-4f15-8e01-1dd667debc38\") " pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:31:26.030641 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:26.030607 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 14:31:26.030641 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:26.030627 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 14:31:26.030641 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:26.030640 2571 projected.go:196] Error preparing data for projected volume kube-api-access-pd6xt for pod openshift-network-diagnostics/network-check-target-vs75x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:31:26.030806 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:26.030700 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81b8479f-42ac-4f15-8e01-1dd667debc38-kube-api-access-pd6xt podName:81b8479f-42ac-4f15-8e01-1dd667debc38 nodeName:}" failed. No retries permitted until 2026-07-10 14:31:28.030681865 +0000 UTC m=+6.108343411 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pd6xt" (UniqueName: "kubernetes.io/projected/81b8479f-42ac-4f15-8e01-1dd667debc38-kube-api-access-pd6xt") pod "network-check-target-vs75x" (UID: "81b8479f-42ac-4f15-8e01-1dd667debc38") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:31:26.388091 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:26.387961 2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-09 14:26:24 +0000 UTC" deadline="2028-04-08 08:58:35.605998762 +0000 UTC" Jul 10 14:31:26.388091 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:26.388035 2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15306h27m9.217968042s" Jul 10 14:31:26.460095 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:26.460061 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:31:26.460272 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:26.460205 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4brx" podUID="ea476f2b-59d7-4272-be5c-30a782f21228" Jul 10 14:31:26.483185 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:26.483149 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" event={"ID":"b7c12f35-7b1f-4341-9302-0dfe837776f8","Type":"ContainerStarted","Data":"47b9d0ddb4261b9190b27c5c792ba932fba8c52cbb75e330e9c26aa5f88ba7e8"} Jul 10 14:31:26.494928 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:26.494891 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n5n25" event={"ID":"58c5a8ee-cb71-42ce-9cfb-a30ce75051f0","Type":"ContainerStarted","Data":"c0e41ef497fb397985b6ca310a6c6dca6ef3b03ca2f700755bc077dad03a7705"} Jul 10 14:31:26.509428 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:26.509388 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" event={"ID":"f7169583-ddb5-4d40-8439-20a12c8caaec","Type":"ContainerStarted","Data":"efda0294490e976ef6969edb2773cbd52660d24b36d5869c5b583efb3781efaf"} Jul 10 14:31:26.516259 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:26.516223 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-101.ec2.internal" event={"ID":"43b50c0f30ea9d35967a41671db4af49","Type":"ContainerStarted","Data":"be69982941f520b78aebee19128e19360b736330d7b2256e9fbbaf4e88fbc6e6"} Jul 10 14:31:26.534888 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:26.534442 2571 generic.go:356] "Generic (PLEG): container finished" podID="4369032deb28c5390acbf881f75e0450" containerID="902159cd2daefacf77af740a8d3483c82b63dc2794d19eb9454d95daee94487a" exitCode=0 Jul 10 14:31:26.534888 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:26.534549 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal" event={"ID":"4369032deb28c5390acbf881f75e0450","Type":"ContainerDied","Data":"902159cd2daefacf77af740a8d3483c82b63dc2794d19eb9454d95daee94487a"} Jul 10 14:31:26.551712 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:26.551626 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2t8rd" event={"ID":"cd58d732-88c2-4445-9682-a34d2488896e","Type":"ContainerStarted","Data":"7052c6396cf16f274290a67380f9fa45847ab287ff0088ab278ca483577df6a5"} Jul 10 14:31:26.552501 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:26.552458 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-101.ec2.internal" podStartSLOduration=3.552444024 podStartE2EDuration="3.552444024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:31:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:31:26.533541613 +0000 UTC m=+4.611203160" watchObservedRunningTime="2026-07-10 14:31:26.552444024 +0000 UTC m=+4.630105568" Jul 10 14:31:26.588473 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:26.588435 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-blxtv" event={"ID":"7d133399-fc4f-49c3-9dca-7fd75f87add1","Type":"ContainerStarted","Data":"b1a3edf5d18ae24fa8be00c2992121a89fb72061b73dab80728fa90d82efcc3b"} Jul 10 14:31:26.603737 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:26.603580 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v8vnr" event={"ID":"345640dc-39fb-4506-bc54-31d2d64a8868","Type":"ContainerStarted","Data":"6c9c493e1297103aa6ba9bbab7ed5a8a19cfdc5466b5adca0ac9a98f48056328"} Jul 10 14:31:26.616848 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:26.616801 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p5ggd" event={"ID":"6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7","Type":"ContainerStarted","Data":"0d6594f4172fde61cad1561e92b63ee0f9c0ae04dbf5acd7fac30d2e371c33ef"} Jul 10 14:31:27.457593 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:27.457133 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:31:27.457593 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:27.457245 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs75x" podUID="81b8479f-42ac-4f15-8e01-1dd667debc38" Jul 10 14:31:27.457593 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:27.457448 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:31:27.457593 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:27.457535 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc6vj" podUID="031289f7-f9ec-407f-8fa5-98afbc1755a3" Jul 10 14:31:27.639084 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:27.639044 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal" event={"ID":"4369032deb28c5390acbf881f75e0450","Type":"ContainerStarted","Data":"51ed4b9a0bf4472e1e8f9e7f6b2b72930ae37bda155346c42a8c15ee9ae156ea"} Jul 10 14:31:27.946256 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:27.945377 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/031289f7-f9ec-407f-8fa5-98afbc1755a3-original-pull-secret\") pod \"global-pull-secret-syncer-tc6vj\" (UID: \"031289f7-f9ec-407f-8fa5-98afbc1755a3\") " pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:31:27.946256 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:27.945493 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea476f2b-59d7-4272-be5c-30a782f21228-metrics-certs\") pod \"network-metrics-daemon-x4brx\" (UID: \"ea476f2b-59d7-4272-be5c-30a782f21228\") " pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:31:27.946256 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:27.945648 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:31:27.946256 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:27.945712 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea476f2b-59d7-4272-be5c-30a782f21228-metrics-certs podName:ea476f2b-59d7-4272-be5c-30a782f21228 nodeName:}" failed. No retries permitted until 2026-07-10 14:31:31.945693561 +0000 UTC m=+10.023355106 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea476f2b-59d7-4272-be5c-30a782f21228-metrics-certs") pod "network-metrics-daemon-x4brx" (UID: "ea476f2b-59d7-4272-be5c-30a782f21228") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:31:27.946256 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:27.946135 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 14:31:27.946256 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:27.946192 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/031289f7-f9ec-407f-8fa5-98afbc1755a3-original-pull-secret podName:031289f7-f9ec-407f-8fa5-98afbc1755a3 nodeName:}" failed. No retries permitted until 2026-07-10 14:31:31.946174447 +0000 UTC m=+10.023835977 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/031289f7-f9ec-407f-8fa5-98afbc1755a3-original-pull-secret") pod "global-pull-secret-syncer-tc6vj" (UID: "031289f7-f9ec-407f-8fa5-98afbc1755a3") : object "kube-system"/"original-pull-secret" not registered Jul 10 14:31:28.046377 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:28.046338 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd6xt\" (UniqueName: \"kubernetes.io/projected/81b8479f-42ac-4f15-8e01-1dd667debc38-kube-api-access-pd6xt\") pod \"network-check-target-vs75x\" (UID: \"81b8479f-42ac-4f15-8e01-1dd667debc38\") " pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:31:28.046559 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:28.046516 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 14:31:28.046559 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:28.046539 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 14:31:28.046559 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:28.046552 2571 projected.go:196] Error preparing data for projected volume kube-api-access-pd6xt for pod openshift-network-diagnostics/network-check-target-vs75x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:31:28.046810 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:28.046629 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81b8479f-42ac-4f15-8e01-1dd667debc38-kube-api-access-pd6xt podName:81b8479f-42ac-4f15-8e01-1dd667debc38 nodeName:}" failed. No retries permitted until 2026-07-10 14:31:32.046608208 +0000 UTC m=+10.124269743 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pd6xt" (UniqueName: "kubernetes.io/projected/81b8479f-42ac-4f15-8e01-1dd667debc38-kube-api-access-pd6xt") pod "network-check-target-vs75x" (UID: "81b8479f-42ac-4f15-8e01-1dd667debc38") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:31:28.459399 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:28.459364 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:31:28.459944 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:28.459529 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4brx" podUID="ea476f2b-59d7-4272-be5c-30a782f21228" Jul 10 14:31:29.457385 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:29.457345 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:31:29.457563 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:29.457365 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:31:29.457563 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:29.457483 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs75x" podUID="81b8479f-42ac-4f15-8e01-1dd667debc38" Jul 10 14:31:29.457685 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:29.457615 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc6vj" podUID="031289f7-f9ec-407f-8fa5-98afbc1755a3" Jul 10 14:31:30.457765 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:30.457734 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:31:30.458269 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:30.457874 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4brx" podUID="ea476f2b-59d7-4272-be5c-30a782f21228" Jul 10 14:31:31.457716 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:31.457677 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:31:31.457890 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:31.457723 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:31:31.457890 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:31.457818 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc6vj" podUID="031289f7-f9ec-407f-8fa5-98afbc1755a3" Jul 10 14:31:31.458310 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:31.457945 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs75x" podUID="81b8479f-42ac-4f15-8e01-1dd667debc38" Jul 10 14:31:31.975054 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:31.975017 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea476f2b-59d7-4272-be5c-30a782f21228-metrics-certs\") pod \"network-metrics-daemon-x4brx\" (UID: \"ea476f2b-59d7-4272-be5c-30a782f21228\") " pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:31:31.975249 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:31.975073 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/031289f7-f9ec-407f-8fa5-98afbc1755a3-original-pull-secret\") pod \"global-pull-secret-syncer-tc6vj\" (UID: \"031289f7-f9ec-407f-8fa5-98afbc1755a3\") " pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:31:31.975249 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:31.975183 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:31:31.975249 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:31.975195 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 14:31:31.975405 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:31.975254 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/031289f7-f9ec-407f-8fa5-98afbc1755a3-original-pull-secret podName:031289f7-f9ec-407f-8fa5-98afbc1755a3 nodeName:}" failed. No retries permitted until 2026-07-10 14:31:39.975234937 +0000 UTC m=+18.052896478 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/031289f7-f9ec-407f-8fa5-98afbc1755a3-original-pull-secret") pod "global-pull-secret-syncer-tc6vj" (UID: "031289f7-f9ec-407f-8fa5-98afbc1755a3") : object "kube-system"/"original-pull-secret" not registered Jul 10 14:31:31.975405 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:31.975276 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea476f2b-59d7-4272-be5c-30a782f21228-metrics-certs podName:ea476f2b-59d7-4272-be5c-30a782f21228 nodeName:}" failed. No retries permitted until 2026-07-10 14:31:39.975266459 +0000 UTC m=+18.052927982 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea476f2b-59d7-4272-be5c-30a782f21228-metrics-certs") pod "network-metrics-daemon-x4brx" (UID: "ea476f2b-59d7-4272-be5c-30a782f21228") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:31:32.076156 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:32.076110 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd6xt\" (UniqueName: \"kubernetes.io/projected/81b8479f-42ac-4f15-8e01-1dd667debc38-kube-api-access-pd6xt\") pod \"network-check-target-vs75x\" (UID: \"81b8479f-42ac-4f15-8e01-1dd667debc38\") " pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:31:32.076329 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:32.076286 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 14:31:32.076329 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:32.076307 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 14:31:32.076329 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:32.076320 2571 projected.go:196] Error preparing data for projected volume kube-api-access-pd6xt for pod openshift-network-diagnostics/network-check-target-vs75x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:31:32.076473 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:32.076380 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81b8479f-42ac-4f15-8e01-1dd667debc38-kube-api-access-pd6xt podName:81b8479f-42ac-4f15-8e01-1dd667debc38 nodeName:}" failed. No retries permitted until 2026-07-10 14:31:40.07636121 +0000 UTC m=+18.154022744 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pd6xt" (UniqueName: "kubernetes.io/projected/81b8479f-42ac-4f15-8e01-1dd667debc38-kube-api-access-pd6xt") pod "network-check-target-vs75x" (UID: "81b8479f-42ac-4f15-8e01-1dd667debc38") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:31:32.460837 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:32.460808 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:31:32.461328 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:32.460940 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4brx" podUID="ea476f2b-59d7-4272-be5c-30a782f21228" Jul 10 14:31:33.457042 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:33.457003 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:31:33.457216 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:33.457134 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs75x" podUID="81b8479f-42ac-4f15-8e01-1dd667debc38" Jul 10 14:31:33.457354 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:33.457271 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:31:33.457470 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:33.457400 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc6vj" podUID="031289f7-f9ec-407f-8fa5-98afbc1755a3" Jul 10 14:31:34.457672 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:34.457635 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:31:34.458154 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:34.457787 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4brx" podUID="ea476f2b-59d7-4272-be5c-30a782f21228" Jul 10 14:31:35.457289 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:35.457042 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:31:35.457289 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:35.457067 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:31:35.457289 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:35.457188 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc6vj" podUID="031289f7-f9ec-407f-8fa5-98afbc1755a3" Jul 10 14:31:35.457289 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:35.457311 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs75x" podUID="81b8479f-42ac-4f15-8e01-1dd667debc38" Jul 10 14:31:36.456751 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:36.456719 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:31:36.457234 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:36.456860 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4brx" podUID="ea476f2b-59d7-4272-be5c-30a782f21228" Jul 10 14:31:37.457338 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:37.457214 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:31:37.457338 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:37.457233 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:31:37.457835 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:37.457353 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs75x" podUID="81b8479f-42ac-4f15-8e01-1dd667debc38" Jul 10 14:31:37.457835 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:37.457463 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc6vj" podUID="031289f7-f9ec-407f-8fa5-98afbc1755a3" Jul 10 14:31:38.460326 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:38.458175 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:31:38.460326 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:38.458388 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4brx" podUID="ea476f2b-59d7-4272-be5c-30a782f21228" Jul 10 14:31:39.457393 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:39.457362 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:31:39.457617 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:39.457420 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:31:39.457617 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:39.457562 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc6vj" podUID="031289f7-f9ec-407f-8fa5-98afbc1755a3" Jul 10 14:31:39.457742 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:39.457715 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs75x" podUID="81b8479f-42ac-4f15-8e01-1dd667debc38" Jul 10 14:31:40.040316 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:40.040208 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/031289f7-f9ec-407f-8fa5-98afbc1755a3-original-pull-secret\") pod \"global-pull-secret-syncer-tc6vj\" (UID: \"031289f7-f9ec-407f-8fa5-98afbc1755a3\") " pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:31:40.040316 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:40.040312 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea476f2b-59d7-4272-be5c-30a782f21228-metrics-certs\") pod \"network-metrics-daemon-x4brx\" (UID: \"ea476f2b-59d7-4272-be5c-30a782f21228\") " pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:31:40.040910 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:40.040332 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 14:31:40.040910 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:40.040391 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:31:40.040910 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:40.040398 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/031289f7-f9ec-407f-8fa5-98afbc1755a3-original-pull-secret podName:031289f7-f9ec-407f-8fa5-98afbc1755a3 nodeName:}" failed. No retries permitted until 2026-07-10 14:31:56.040378494 +0000 UTC m=+34.118040036 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/031289f7-f9ec-407f-8fa5-98afbc1755a3-original-pull-secret") pod "global-pull-secret-syncer-tc6vj" (UID: "031289f7-f9ec-407f-8fa5-98afbc1755a3") : object "kube-system"/"original-pull-secret" not registered Jul 10 14:31:40.040910 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:40.040426 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea476f2b-59d7-4272-be5c-30a782f21228-metrics-certs podName:ea476f2b-59d7-4272-be5c-30a782f21228 nodeName:}" failed. No retries permitted until 2026-07-10 14:31:56.040413741 +0000 UTC m=+34.118075266 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea476f2b-59d7-4272-be5c-30a782f21228-metrics-certs") pod "network-metrics-daemon-x4brx" (UID: "ea476f2b-59d7-4272-be5c-30a782f21228") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:31:40.140684 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:40.140645 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd6xt\" (UniqueName: \"kubernetes.io/projected/81b8479f-42ac-4f15-8e01-1dd667debc38-kube-api-access-pd6xt\") pod \"network-check-target-vs75x\" (UID: \"81b8479f-42ac-4f15-8e01-1dd667debc38\") " pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:31:40.140868 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:40.140830 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 14:31:40.140868 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:40.140858 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 14:31:40.140998 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:40.140872 2571 projected.go:196] Error preparing data for projected volume kube-api-access-pd6xt for pod openshift-network-diagnostics/network-check-target-vs75x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:31:40.140998 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:40.140931 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81b8479f-42ac-4f15-8e01-1dd667debc38-kube-api-access-pd6xt podName:81b8479f-42ac-4f15-8e01-1dd667debc38 nodeName:}" failed. No retries permitted until 2026-07-10 14:31:56.140911471 +0000 UTC m=+34.218573013 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pd6xt" (UniqueName: "kubernetes.io/projected/81b8479f-42ac-4f15-8e01-1dd667debc38-kube-api-access-pd6xt") pod "network-check-target-vs75x" (UID: "81b8479f-42ac-4f15-8e01-1dd667debc38") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:31:40.457039 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:40.457002 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:31:40.457218 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:40.457153 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4brx" podUID="ea476f2b-59d7-4272-be5c-30a782f21228" Jul 10 14:31:41.457284 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:41.457251 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:31:41.457739 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:41.457263 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:31:41.457739 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:41.457388 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs75x" podUID="81b8479f-42ac-4f15-8e01-1dd667debc38" Jul 10 14:31:41.457739 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:41.457518 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc6vj" podUID="031289f7-f9ec-407f-8fa5-98afbc1755a3" Jul 10 14:31:42.460283 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:42.459042 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:31:42.460283 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:42.459205 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4brx" podUID="ea476f2b-59d7-4272-be5c-30a782f21228" Jul 10 14:31:43.457418 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:43.457378 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:31:43.457594 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:43.457376 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:31:43.457594 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:43.457528 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc6vj" podUID="031289f7-f9ec-407f-8fa5-98afbc1755a3" Jul 10 14:31:43.457594 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:43.457579 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs75x" podUID="81b8479f-42ac-4f15-8e01-1dd667debc38" Jul 10 14:31:44.457913 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:44.457756 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:31:44.458401 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:44.458055 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4brx" podUID="ea476f2b-59d7-4272-be5c-30a782f21228" Jul 10 14:31:44.673867 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:44.673829 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m58jh" event={"ID":"a4590cfe-fd78-40e0-b45e-6752cc4aef69","Type":"ContainerStarted","Data":"dd1051819e8bd42ae4d24cdb949c09689e3da0ffae96637111c1ed96f569462d"} Jul 10 14:31:44.675199 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:44.675171 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-d22jx" event={"ID":"20de4a51-a82e-45c4-b3f5-7bc548674778","Type":"ContainerStarted","Data":"c2b677ccf8ec938ec5434174475fb2cb8ff1f92060323cae12b993593cf03a5d"} Jul 10 14:31:44.676556 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:44.676535 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2t8rd" event={"ID":"cd58d732-88c2-4445-9682-a34d2488896e","Type":"ContainerStarted","Data":"dd5e30d0f69eb0afb0676155ba0c3d7cfcedd4c837b41a3a720fa4a5e1b039fd"} Jul 10 14:31:44.677828 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:44.677809 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-blxtv" event={"ID":"7d133399-fc4f-49c3-9dca-7fd75f87add1","Type":"ContainerStarted","Data":"8669a2103ababe62acba1bf9947b02a2cacd27ee320839a7b59daed9f023ffb1"} Jul 10 14:31:44.679179 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:44.679160 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v8vnr" event={"ID":"345640dc-39fb-4506-bc54-31d2d64a8868","Type":"ContainerStarted","Data":"ac0666204c949e24a8dbd099a79b9e2eb46a27a845655f968224a274971a3392"} Jul 10 14:31:44.680609 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:44.680585 2571 generic.go:356] "Generic (PLEG): container finished" podID="6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7" containerID="62f09b34a75c546b275cc9aa5c01be2163b89768dff37ce10f6821b4d19a860f" exitCode=0 Jul 10 14:31:44.680689 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:44.680659 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p5ggd" event={"ID":"6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7","Type":"ContainerDied","Data":"62f09b34a75c546b275cc9aa5c01be2163b89768dff37ce10f6821b4d19a860f"} Jul 10 14:31:44.683433 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:44.683419 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7clbv_b7c12f35-7b1f-4341-9302-0dfe837776f8/ovn-acl-logging/0.log" Jul 10 14:31:44.683750 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:44.683732 2571 generic.go:356] "Generic (PLEG): container finished" podID="b7c12f35-7b1f-4341-9302-0dfe837776f8" containerID="50f4fe91ea5788f2045856e9bb0e3c0c0d565bfd162d3884396375aebb58ba68" exitCode=1 Jul 10 14:31:44.683827 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:44.683800 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" event={"ID":"b7c12f35-7b1f-4341-9302-0dfe837776f8","Type":"ContainerStarted","Data":"9a604e1573532e7ba87c5a136664b9ebf79f268883328f624e56a6b1441749b6"} Jul 10 14:31:44.683887 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:44.683868 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" event={"ID":"b7c12f35-7b1f-4341-9302-0dfe837776f8","Type":"ContainerStarted","Data":"8cc5e008a2ef15c44d00c0c473370148537fe521d7e50e9eeea803fe82cfff39"} Jul 10 14:31:44.683948 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:44.683908 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" event={"ID":"b7c12f35-7b1f-4341-9302-0dfe837776f8","Type":"ContainerStarted","Data":"1eac1e3c799f5b908a8d7275adc2ccae3b4af5472fb35dc6744fdaf32624e7cc"} Jul 10 14:31:44.684019 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:44.683952 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" event={"ID":"b7c12f35-7b1f-4341-9302-0dfe837776f8","Type":"ContainerStarted","Data":"37dc060572d5514fe5a6eebbf864a387e110f1b24a5dd9ff983b8cb8e9aac3d3"} Jul 10 14:31:44.684019 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:44.684013 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" event={"ID":"b7c12f35-7b1f-4341-9302-0dfe837776f8","Type":"ContainerDied","Data":"50f4fe91ea5788f2045856e9bb0e3c0c0d565bfd162d3884396375aebb58ba68"} Jul 10 14:31:44.684095 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:44.684062 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" event={"ID":"b7c12f35-7b1f-4341-9302-0dfe837776f8","Type":"ContainerStarted","Data":"de9d63597b191211ad5e83ebf5c259d29703f8db4a53ebd737b3a97781bf67f2"} Jul 10 14:31:44.685060 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:44.685023 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" event={"ID":"f7169583-ddb5-4d40-8439-20a12c8caaec","Type":"ContainerStarted","Data":"153c0b7b644c412f8c134b32c10708f939adafd8a44192ff7359095321e9f5e8"} Jul 10 14:31:44.692712 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:44.692675 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-101.ec2.internal" podStartSLOduration=21.692663275 podStartE2EDuration="21.692663275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:31:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:31:27.656541692 +0000 UTC m=+5.734203239" watchObservedRunningTime="2026-07-10 14:31:44.692663275 +0000 UTC m=+22.770324820" Jul 10 14:31:44.692814 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:44.692796 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-d22jx" podStartSLOduration=3.317588197 podStartE2EDuration="22.692792466s" totalImagesPullingTime="19.375204269s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:31:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:31:44.692502179 +0000 UTC m=+22.770163725" watchObservedRunningTime="2026-07-10 14:31:44.692792466 +0000 UTC m=+22.770454045" Jul 10 14:31:44.709916 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:44.709870 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6zjv8" podStartSLOduration=4.393957192 podStartE2EDuration="22.709853492s" totalImagesPullingTime="18.3158963s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:31:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:31:44.709448783 +0000 UTC m=+22.787110331" watchObservedRunningTime="2026-07-10 14:31:44.709853492 +0000 UTC m=+22.787515036" Jul 10 14:31:44.723659 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:44.723617 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-v8vnr" podStartSLOduration=4.418252267 podStartE2EDuration="22.723603058s" totalImagesPullingTime="18.305350791s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:31:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:31:44.723356724 +0000 UTC m=+22.801018282" watchObservedRunningTime="2026-07-10 14:31:44.723603058 +0000 UTC m=+22.801264603" Jul 10 14:31:44.758072 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:44.758029 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-blxtv" podStartSLOduration=4.453738221 podStartE2EDuration="22.758012675s" totalImagesPullingTime="18.304274454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:31:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:31:44.757751953 +0000 UTC m=+22.835413499" watchObservedRunningTime="2026-07-10 14:31:44.758012675 +0000 UTC m=+22.835674219" Jul 10 14:31:44.775614 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:44.775550 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2t8rd" podStartSLOduration=4.467841726 podStartE2EDuration="22.775532054s" totalImagesPullingTime="18.307690328s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:31:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:31:44.77443033 +0000 UTC m=+22.852091877" watchObservedRunningTime="2026-07-10 14:31:44.775532054 +0000 UTC m=+22.853193599" Jul 10 14:31:45.457536 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:45.457508 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:31:45.457718 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:45.457549 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:31:45.457718 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:45.457634 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc6vj" podUID="031289f7-f9ec-407f-8fa5-98afbc1755a3" Jul 10 14:31:45.457813 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:45.457722 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs75x" podUID="81b8479f-42ac-4f15-8e01-1dd667debc38" Jul 10 14:31:45.605891 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:45.605869 2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 10 14:31:45.684861 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:45.684783 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-blxtv" Jul 10 14:31:45.685942 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:45.685924 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-blxtv" Jul 10 14:31:45.691819 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:45.691786 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m58jh" event={"ID":"a4590cfe-fd78-40e0-b45e-6752cc4aef69","Type":"ContainerStarted","Data":"7266a86db274a376cc347265bf8787b1a70aac94d6d08ce8564475d6076a5e01"} Jul 10 14:31:45.693346 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:45.693321 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n5n25" event={"ID":"58c5a8ee-cb71-42ce-9cfb-a30ce75051f0","Type":"ContainerStarted","Data":"2afadffaf662436f4d02a29fd0d8248397fed7d0c41876d308b4aa81c0c3097a"} Jul 10 14:31:45.694181 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:45.694164 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-blxtv" Jul 10 14:31:45.694612 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:45.694586 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-blxtv" Jul 10 14:31:45.724097 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:45.724049 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-n5n25" podStartSLOduration=5.41488589 podStartE2EDuration="23.724034342s" totalImagesPullingTime="18.309148452s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:31:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:31:45.723958556 +0000 UTC m=+23.801620102" watchObservedRunningTime="2026-07-10 14:31:45.724034342 +0000 UTC m=+23.801695889" Jul 10 14:31:46.381100 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:46.380993 2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-10T14:31:45.605887562Z","UUID":"93492bca-e809-4967-a61b-15fb3a3ff0ce","Handler":null,"Name":"","Endpoint":""} Jul 10 14:31:46.382899 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:46.382844 2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 10 14:31:46.382899 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:46.382894 2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 10 14:31:46.457233 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:46.457202 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:31:46.457391 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:46.457339 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4brx" podUID="ea476f2b-59d7-4272-be5c-30a782f21228" Jul 10 14:31:47.457653 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:47.457624 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:31:47.458217 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:47.457624 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:31:47.458217 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:47.457736 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc6vj" podUID="031289f7-f9ec-407f-8fa5-98afbc1755a3" Jul 10 14:31:47.458217 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:47.457797 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs75x" podUID="81b8479f-42ac-4f15-8e01-1dd667debc38" Jul 10 14:31:47.701568 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:47.701542 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7clbv_b7c12f35-7b1f-4341-9302-0dfe837776f8/ovn-acl-logging/0.log" Jul 10 14:31:47.702026 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:47.701998 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" event={"ID":"b7c12f35-7b1f-4341-9302-0dfe837776f8","Type":"ContainerStarted","Data":"77a30f99bc78f645274a6314af39f2ec9fbe185fee01b6a6463fab345315f56d"} Jul 10 14:31:47.704221 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:47.704192 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m58jh" event={"ID":"a4590cfe-fd78-40e0-b45e-6752cc4aef69","Type":"ContainerStarted","Data":"06a82f63802e19cd98b34f7fb4841c5fead70743236702d8579f22d0f1557be4"} Jul 10 14:31:47.723617 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:47.723540 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m58jh" podStartSLOduration=12.142123657 podStartE2EDuration="25.723523428s" totalImagesPullingTime="13.581399771s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:31:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:31:47.723100029 +0000 UTC m=+25.800761573" watchObservedRunningTime="2026-07-10 14:31:47.723523428 +0000 UTC m=+25.801184974" Jul 10 14:31:48.457414 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:48.457221 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:31:48.457580 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:48.457524 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4brx" podUID="ea476f2b-59d7-4272-be5c-30a782f21228" Jul 10 14:31:49.457276 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:49.457117 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:31:49.458079 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:49.457155 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:31:49.458079 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:49.457380 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs75x" podUID="81b8479f-42ac-4f15-8e01-1dd667debc38" Jul 10 14:31:49.458079 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:49.457425 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc6vj" podUID="031289f7-f9ec-407f-8fa5-98afbc1755a3" Jul 10 14:31:49.710093 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:49.709986 2571 generic.go:356] "Generic (PLEG): container finished" podID="6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7" containerID="138cd0fea23bdd65b8c7b81fa23a87ecbe4cc506ea1110f16194a68027ac21e4" exitCode=0 Jul 10 14:31:49.710093 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:49.710066 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p5ggd" event={"ID":"6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7","Type":"ContainerDied","Data":"138cd0fea23bdd65b8c7b81fa23a87ecbe4cc506ea1110f16194a68027ac21e4"} Jul 10 14:31:49.715454 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:49.715429 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7clbv_b7c12f35-7b1f-4341-9302-0dfe837776f8/ovn-acl-logging/0.log" Jul 10 14:31:49.715808 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:49.715787 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" event={"ID":"b7c12f35-7b1f-4341-9302-0dfe837776f8","Type":"ContainerStarted","Data":"55dfb76c50c5ec19e1f1391f6f856ab2eb8cdcbbeb5d2a841395885fb94effea"} Jul 10 14:31:49.719768 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:49.716353 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:49.719768 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:49.716459 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:49.719768 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:49.716617 2571 scope.go:117] "RemoveContainer" containerID="50f4fe91ea5788f2045856e9bb0e3c0c0d565bfd162d3884396375aebb58ba68" Jul 10 14:31:49.734490 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:49.734470 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:50.457540 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:50.457510 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:31:50.458093 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:50.457666 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4brx" podUID="ea476f2b-59d7-4272-be5c-30a782f21228" Jul 10 14:31:50.721449 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:50.721381 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7clbv_b7c12f35-7b1f-4341-9302-0dfe837776f8/ovn-acl-logging/0.log" Jul 10 14:31:50.721709 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:50.721683 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" event={"ID":"b7c12f35-7b1f-4341-9302-0dfe837776f8","Type":"ContainerStarted","Data":"e85e4782c2356f32f7f6031c27395eca3aa012e52ff642ec6fd13416bb33a106"} Jul 10 14:31:50.721936 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:50.721916 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:50.736557 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:50.736537 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:31:50.754531 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:50.754490 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" podStartSLOduration=10.371984641 podStartE2EDuration="28.754477294s" totalImagesPullingTime="18.382492653s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:31:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:31:50.753105 +0000 UTC m=+28.830766544" watchObservedRunningTime="2026-07-10 14:31:50.754477294 +0000 UTC m=+28.832138838" Jul 10 14:31:51.457686 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:51.457654 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:31:51.458147 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:51.457654 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:31:51.458147 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:51.457780 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc6vj" podUID="031289f7-f9ec-407f-8fa5-98afbc1755a3" Jul 10 14:31:51.458147 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:51.457866 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs75x" podUID="81b8479f-42ac-4f15-8e01-1dd667debc38" Jul 10 14:31:51.725908 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:51.725822 2571 generic.go:356] "Generic (PLEG): container finished" podID="6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7" containerID="bd47ca246da3701c5d16f825a613a7a0cabea712f839cf3c5f7af012606e8141" exitCode=0 Jul 10 14:31:51.726088 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:51.725915 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p5ggd" event={"ID":"6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7","Type":"ContainerDied","Data":"bd47ca246da3701c5d16f825a613a7a0cabea712f839cf3c5f7af012606e8141"} Jul 10 14:31:52.458853 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:52.458821 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:31:52.459295 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:52.458946 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4brx" podUID="ea476f2b-59d7-4272-be5c-30a782f21228" Jul 10 14:31:53.457461 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:53.457429 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:31:53.457625 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:53.457541 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs75x" podUID="81b8479f-42ac-4f15-8e01-1dd667debc38" Jul 10 14:31:53.457625 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:53.457591 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:31:53.457755 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:53.457673 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc6vj" podUID="031289f7-f9ec-407f-8fa5-98afbc1755a3" Jul 10 14:31:53.732469 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:53.732388 2571 generic.go:356] "Generic (PLEG): container finished" podID="6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7" containerID="1adc92a42082ba2d15be44d3ff4f890232cd0c2efabddf5b7a90f205c7d8bfe9" exitCode=0 Jul 10 14:31:53.732469 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:53.732450 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p5ggd" event={"ID":"6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7","Type":"ContainerDied","Data":"1adc92a42082ba2d15be44d3ff4f890232cd0c2efabddf5b7a90f205c7d8bfe9"} Jul 10 14:31:54.457731 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:54.457694 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:31:54.457918 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:54.457854 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4brx" podUID="ea476f2b-59d7-4272-be5c-30a782f21228" Jul 10 14:31:55.457469 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:55.457437 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:31:55.457910 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:55.457559 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs75x" podUID="81b8479f-42ac-4f15-8e01-1dd667debc38" Jul 10 14:31:55.457910 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:55.457625 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:31:55.457910 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:55.457732 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc6vj" podUID="031289f7-f9ec-407f-8fa5-98afbc1755a3" Jul 10 14:31:56.060081 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:56.060049 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea476f2b-59d7-4272-be5c-30a782f21228-metrics-certs\") pod \"network-metrics-daemon-x4brx\" (UID: \"ea476f2b-59d7-4272-be5c-30a782f21228\") " pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:31:56.060262 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:56.060092 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/031289f7-f9ec-407f-8fa5-98afbc1755a3-original-pull-secret\") pod \"global-pull-secret-syncer-tc6vj\" (UID: \"031289f7-f9ec-407f-8fa5-98afbc1755a3\") " pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:31:56.060262 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:56.060213 2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 10 14:31:56.060262 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:56.060216 2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:31:56.060400 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:56.060272 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/031289f7-f9ec-407f-8fa5-98afbc1755a3-original-pull-secret podName:031289f7-f9ec-407f-8fa5-98afbc1755a3 nodeName:}" failed. No retries permitted until 2026-07-10 14:32:28.060255678 +0000 UTC m=+66.137917203 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/031289f7-f9ec-407f-8fa5-98afbc1755a3-original-pull-secret") pod "global-pull-secret-syncer-tc6vj" (UID: "031289f7-f9ec-407f-8fa5-98afbc1755a3") : object "kube-system"/"original-pull-secret" not registered Jul 10 14:31:56.060400 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:56.060291 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea476f2b-59d7-4272-be5c-30a782f21228-metrics-certs podName:ea476f2b-59d7-4272-be5c-30a782f21228 nodeName:}" failed. No retries permitted until 2026-07-10 14:32:28.060281255 +0000 UTC m=+66.137942785 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ea476f2b-59d7-4272-be5c-30a782f21228-metrics-certs") pod "network-metrics-daemon-x4brx" (UID: "ea476f2b-59d7-4272-be5c-30a782f21228") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 10 14:31:56.161323 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:56.161292 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd6xt\" (UniqueName: \"kubernetes.io/projected/81b8479f-42ac-4f15-8e01-1dd667debc38-kube-api-access-pd6xt\") pod \"network-check-target-vs75x\" (UID: \"81b8479f-42ac-4f15-8e01-1dd667debc38\") " pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:31:56.161468 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:56.161402 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 10 14:31:56.161468 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:56.161415 2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 10 14:31:56.161468 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:56.161423 2571 projected.go:196] Error preparing data for projected volume kube-api-access-pd6xt for pod openshift-network-diagnostics/network-check-target-vs75x: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:31:56.161468 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:56.161464 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/81b8479f-42ac-4f15-8e01-1dd667debc38-kube-api-access-pd6xt podName:81b8479f-42ac-4f15-8e01-1dd667debc38 nodeName:}" failed. No retries permitted until 2026-07-10 14:32:28.161451827 +0000 UTC m=+66.239113350 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pd6xt" (UniqueName: "kubernetes.io/projected/81b8479f-42ac-4f15-8e01-1dd667debc38-kube-api-access-pd6xt") pod "network-check-target-vs75x" (UID: "81b8479f-42ac-4f15-8e01-1dd667debc38") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 10 14:31:56.460470 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:56.460446 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:31:56.460819 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:56.460537 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4brx" podUID="ea476f2b-59d7-4272-be5c-30a782f21228" Jul 10 14:31:57.457573 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:57.457538 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:31:57.457573 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:57.457566 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:31:57.457809 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:57.457677 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs75x" podUID="81b8479f-42ac-4f15-8e01-1dd667debc38" Jul 10 14:31:57.457809 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:57.457788 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc6vj" podUID="031289f7-f9ec-407f-8fa5-98afbc1755a3" Jul 10 14:31:58.459982 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:58.459941 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:31:58.460312 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:58.460055 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4brx" podUID="ea476f2b-59d7-4272-be5c-30a782f21228" Jul 10 14:31:58.747246 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:58.747159 2571 generic.go:356] "Generic (PLEG): container finished" podID="6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7" containerID="964de12bbe60d1ddec0a3ee40220b58db88fbe57c7102376a9201dbe5c493e7d" exitCode=0 Jul 10 14:31:58.747246 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:58.747219 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p5ggd" event={"ID":"6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7","Type":"ContainerDied","Data":"964de12bbe60d1ddec0a3ee40220b58db88fbe57c7102376a9201dbe5c493e7d"} Jul 10 14:31:59.456873 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:59.456844 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:31:59.457040 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:59.456934 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs75x" podUID="81b8479f-42ac-4f15-8e01-1dd667debc38" Jul 10 14:31:59.457040 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:59.456991 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:31:59.457110 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:31:59.457077 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc6vj" podUID="031289f7-f9ec-407f-8fa5-98afbc1755a3" Jul 10 14:31:59.752454 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:59.752380 2571 generic.go:356] "Generic (PLEG): container finished" podID="6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7" containerID="c73439cd136eb0c1a343e923ddea5ec989d03fc2763797bd0c2aa1e6330888f5" exitCode=0 Jul 10 14:31:59.752454 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:31:59.752444 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p5ggd" event={"ID":"6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7","Type":"ContainerDied","Data":"c73439cd136eb0c1a343e923ddea5ec989d03fc2763797bd0c2aa1e6330888f5"} Jul 10 14:32:00.457535 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:00.457506 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:32:00.457696 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:32:00.457611 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4brx" podUID="ea476f2b-59d7-4272-be5c-30a782f21228" Jul 10 14:32:00.757588 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:00.757512 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p5ggd" event={"ID":"6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7","Type":"ContainerStarted","Data":"f466895660766bb24e7e4d80142ef0cc71b85f64bfe017c1a4e849e1db1251c1"} Jul 10 14:32:00.783794 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:00.783751 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-p5ggd" podStartSLOduration=8.889693181 podStartE2EDuration="38.783735714s" totalImagesPullingTime="29.894042533s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:31:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:32:00.783718904 +0000 UTC m=+38.861380453" watchObservedRunningTime="2026-07-10 14:32:00.783735714 +0000 UTC m=+38.861397253" Jul 10 14:32:01.457094 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:01.457065 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:32:01.457094 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:01.457099 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:32:01.457288 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:32:01.457176 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs75x" podUID="81b8479f-42ac-4f15-8e01-1dd667debc38" Jul 10 14:32:01.457349 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:32:01.457290 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc6vj" podUID="031289f7-f9ec-407f-8fa5-98afbc1755a3" Jul 10 14:32:02.458585 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:02.458421 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:32:02.458963 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:32:02.458642 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4brx" podUID="ea476f2b-59d7-4272-be5c-30a782f21228" Jul 10 14:32:03.456784 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:03.456756 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:32:03.456784 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:03.456786 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:32:03.457032 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:32:03.456859 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs75x" podUID="81b8479f-42ac-4f15-8e01-1dd667debc38" Jul 10 14:32:03.457032 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:32:03.457012 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc6vj" podUID="031289f7-f9ec-407f-8fa5-98afbc1755a3" Jul 10 14:32:04.457819 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:04.457781 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:32:04.458187 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:32:04.457905 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4brx" podUID="ea476f2b-59d7-4272-be5c-30a782f21228" Jul 10 14:32:05.457132 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:05.457096 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:32:05.457315 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:05.457096 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:32:05.457315 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:32:05.457198 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs75x" podUID="81b8479f-42ac-4f15-8e01-1dd667debc38" Jul 10 14:32:05.457315 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:32:05.457293 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc6vj" podUID="031289f7-f9ec-407f-8fa5-98afbc1755a3" Jul 10 14:32:06.457624 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:06.457590 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:32:06.458104 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:32:06.457707 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4brx" podUID="ea476f2b-59d7-4272-be5c-30a782f21228" Jul 10 14:32:07.381091 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:07.381056 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vs75x"] Jul 10 14:32:07.381291 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:07.381164 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:32:07.381291 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:32:07.381252 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs75x" podUID="81b8479f-42ac-4f15-8e01-1dd667debc38" Jul 10 14:32:07.383383 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:07.383359 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tc6vj"] Jul 10 14:32:07.383633 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:07.383614 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:32:07.383755 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:32:07.383712 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc6vj" podUID="031289f7-f9ec-407f-8fa5-98afbc1755a3" Jul 10 14:32:07.383963 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:07.383944 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x4brx"] Jul 10 14:32:07.384050 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:07.384027 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:32:07.384130 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:32:07.384110 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4brx" podUID="ea476f2b-59d7-4272-be5c-30a782f21228" Jul 10 14:32:09.456851 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:09.456819 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:32:09.456851 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:09.456852 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:32:09.457803 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:09.456902 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:32:09.457803 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:32:09.456916 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc6vj" podUID="031289f7-f9ec-407f-8fa5-98afbc1755a3" Jul 10 14:32:09.457803 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:32:09.456987 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4brx" podUID="ea476f2b-59d7-4272-be5c-30a782f21228" Jul 10 14:32:09.457803 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:32:09.457034 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs75x" podUID="81b8479f-42ac-4f15-8e01-1dd667debc38" Jul 10 14:32:11.456935 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.456901 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:32:11.456935 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.456926 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:32:11.457358 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.456926 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:32:11.457358 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:32:11.457050 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vs75x" podUID="81b8479f-42ac-4f15-8e01-1dd667debc38" Jul 10 14:32:11.457358 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:32:11.457156 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tc6vj" podUID="031289f7-f9ec-407f-8fa5-98afbc1755a3" Jul 10 14:32:11.457358 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:32:11.457223 2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-x4brx" podUID="ea476f2b-59d7-4272-be5c-30a782f21228" Jul 10 14:32:11.789605 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.789533 2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-101.ec2.internal" event="NodeReady" Jul 10 14:32:11.789775 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.789640 2571 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 10 14:32:11.833611 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.833578 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wdx2d"] Jul 10 14:32:11.843078 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.843048 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-n84n4"] Jul 10 14:32:11.843215 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.843165 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wdx2d" Jul 10 14:32:11.846060 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.846034 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 10 14:32:11.846210 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.846146 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-g8rnp\"" Jul 10 14:32:11.846210 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.846164 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 10 14:32:11.846336 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.846307 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 10 14:32:11.852284 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.852262 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wdx2d"] Jul 10 14:32:11.852395 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.852373 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n84n4" Jul 10 14:32:11.852918 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.852897 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n84n4"] Jul 10 14:32:11.855087 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.855066 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 10 14:32:11.855673 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.855309 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 10 14:32:11.855673 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.855433 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2nt82\"" Jul 10 14:32:11.855673 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.855561 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 10 14:32:11.855871 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.855730 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 10 14:32:11.858437 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.858416 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jfwz6"] Jul 10 14:32:11.867246 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.867228 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jfwz6" Jul 10 14:32:11.869706 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.869686 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 10 14:32:11.869797 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.869714 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2n5mh\"" Jul 10 14:32:11.869797 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.869784 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 10 14:32:11.873363 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.873333 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jfwz6"] Jul 10 14:32:11.981062 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.981012 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5e7585d6-9ee5-4459-a03d-87525c804667-crio-socket\") pod \"insights-runtime-extractor-n84n4\" (UID: \"5e7585d6-9ee5-4459-a03d-87525c804667\") " pod="openshift-insights/insights-runtime-extractor-n84n4" Jul 10 14:32:11.981062 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.981063 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmv7b\" (UniqueName: \"kubernetes.io/projected/5e7585d6-9ee5-4459-a03d-87525c804667-kube-api-access-bmv7b\") pod \"insights-runtime-extractor-n84n4\" (UID: \"5e7585d6-9ee5-4459-a03d-87525c804667\") " pod="openshift-insights/insights-runtime-extractor-n84n4" Jul 10 14:32:11.981303 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.981093 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f947\" (UniqueName: \"kubernetes.io/projected/13ee1d4e-21f9-4af1-80db-98bd57925107-kube-api-access-2f947\") pod \"ingress-canary-wdx2d\" (UID: \"13ee1d4e-21f9-4af1-80db-98bd57925107\") " pod="openshift-ingress-canary/ingress-canary-wdx2d" Jul 10 14:32:11.981303 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.981119 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e7585d6-9ee5-4459-a03d-87525c804667-data-volume\") pod \"insights-runtime-extractor-n84n4\" (UID: \"5e7585d6-9ee5-4459-a03d-87525c804667\") " pod="openshift-insights/insights-runtime-extractor-n84n4" Jul 10 14:32:11.981303 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.981138 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e7585d6-9ee5-4459-a03d-87525c804667-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n84n4\" (UID: \"5e7585d6-9ee5-4459-a03d-87525c804667\") " pod="openshift-insights/insights-runtime-extractor-n84n4" Jul 10 14:32:11.981303 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.981165 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e7585d6-9ee5-4459-a03d-87525c804667-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n84n4\" (UID: \"5e7585d6-9ee5-4459-a03d-87525c804667\") " pod="openshift-insights/insights-runtime-extractor-n84n4" Jul 10 14:32:11.981303 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.981206 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48f012e8-1e12-4df9-a332-889d32b19f44-tmp-dir\") pod \"dns-default-jfwz6\" (UID: \"48f012e8-1e12-4df9-a332-889d32b19f44\") " pod="openshift-dns/dns-default-jfwz6" Jul 10 14:32:11.981303 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.981230 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2lmk\" (UniqueName: \"kubernetes.io/projected/48f012e8-1e12-4df9-a332-889d32b19f44-kube-api-access-h2lmk\") pod \"dns-default-jfwz6\" (UID: \"48f012e8-1e12-4df9-a332-889d32b19f44\") " pod="openshift-dns/dns-default-jfwz6" Jul 10 14:32:11.981303 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.981251 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13ee1d4e-21f9-4af1-80db-98bd57925107-cert\") pod \"ingress-canary-wdx2d\" (UID: \"13ee1d4e-21f9-4af1-80db-98bd57925107\") " pod="openshift-ingress-canary/ingress-canary-wdx2d" Jul 10 14:32:11.981539 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.981314 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/48f012e8-1e12-4df9-a332-889d32b19f44-config-volume\") pod \"dns-default-jfwz6\" (UID: \"48f012e8-1e12-4df9-a332-889d32b19f44\") " pod="openshift-dns/dns-default-jfwz6" Jul 10 14:32:11.981539 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:11.981342 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/48f012e8-1e12-4df9-a332-889d32b19f44-metrics-tls\") pod \"dns-default-jfwz6\" (UID: \"48f012e8-1e12-4df9-a332-889d32b19f44\") " pod="openshift-dns/dns-default-jfwz6" Jul 10 14:32:12.082374 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:12.082280 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5e7585d6-9ee5-4459-a03d-87525c804667-crio-socket\") pod \"insights-runtime-extractor-n84n4\" (UID: \"5e7585d6-9ee5-4459-a03d-87525c804667\") " pod="openshift-insights/insights-runtime-extractor-n84n4" Jul 10 14:32:12.082374 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:12.082321 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmv7b\" (UniqueName: \"kubernetes.io/projected/5e7585d6-9ee5-4459-a03d-87525c804667-kube-api-access-bmv7b\") pod \"insights-runtime-extractor-n84n4\" (UID: \"5e7585d6-9ee5-4459-a03d-87525c804667\") " pod="openshift-insights/insights-runtime-extractor-n84n4" Jul 10 14:32:12.082592 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:12.082444 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f947\" (UniqueName: \"kubernetes.io/projected/13ee1d4e-21f9-4af1-80db-98bd57925107-kube-api-access-2f947\") pod \"ingress-canary-wdx2d\" (UID: \"13ee1d4e-21f9-4af1-80db-98bd57925107\") " pod="openshift-ingress-canary/ingress-canary-wdx2d" Jul 10 14:32:12.082592 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:12.082490 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e7585d6-9ee5-4459-a03d-87525c804667-data-volume\") pod \"insights-runtime-extractor-n84n4\" (UID: \"5e7585d6-9ee5-4459-a03d-87525c804667\") " pod="openshift-insights/insights-runtime-extractor-n84n4" Jul 10 14:32:12.082592 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:12.082508 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e7585d6-9ee5-4459-a03d-87525c804667-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n84n4\" (UID: \"5e7585d6-9ee5-4459-a03d-87525c804667\") " pod="openshift-insights/insights-runtime-extractor-n84n4" Jul 10 14:32:12.082592 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:12.082506 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5e7585d6-9ee5-4459-a03d-87525c804667-crio-socket\") pod \"insights-runtime-extractor-n84n4\" (UID: \"5e7585d6-9ee5-4459-a03d-87525c804667\") " pod="openshift-insights/insights-runtime-extractor-n84n4" Jul 10 14:32:12.082760 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:12.082624 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e7585d6-9ee5-4459-a03d-87525c804667-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n84n4\" (UID: \"5e7585d6-9ee5-4459-a03d-87525c804667\") " pod="openshift-insights/insights-runtime-extractor-n84n4" Jul 10 14:32:12.082760 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:12.082701 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48f012e8-1e12-4df9-a332-889d32b19f44-tmp-dir\") pod \"dns-default-jfwz6\" (UID: \"48f012e8-1e12-4df9-a332-889d32b19f44\") " pod="openshift-dns/dns-default-jfwz6" Jul 10 14:32:12.082760 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:12.082727 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2lmk\" (UniqueName: \"kubernetes.io/projected/48f012e8-1e12-4df9-a332-889d32b19f44-kube-api-access-h2lmk\") pod \"dns-default-jfwz6\" (UID: \"48f012e8-1e12-4df9-a332-889d32b19f44\") " pod="openshift-dns/dns-default-jfwz6" Jul 10 14:32:12.082760 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:12.082757 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13ee1d4e-21f9-4af1-80db-98bd57925107-cert\") pod \"ingress-canary-wdx2d\" (UID: \"13ee1d4e-21f9-4af1-80db-98bd57925107\") " pod="openshift-ingress-canary/ingress-canary-wdx2d" Jul 10 14:32:12.082953 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:12.082809 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/48f012e8-1e12-4df9-a332-889d32b19f44-config-volume\") pod \"dns-default-jfwz6\" (UID: \"48f012e8-1e12-4df9-a332-889d32b19f44\") " pod="openshift-dns/dns-default-jfwz6" Jul 10 14:32:12.082953 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:12.082822 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5e7585d6-9ee5-4459-a03d-87525c804667-data-volume\") pod \"insights-runtime-extractor-n84n4\" (UID: \"5e7585d6-9ee5-4459-a03d-87525c804667\") " pod="openshift-insights/insights-runtime-extractor-n84n4" Jul 10 14:32:12.082953 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:12.082831 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/48f012e8-1e12-4df9-a332-889d32b19f44-metrics-tls\") pod \"dns-default-jfwz6\" (UID: \"48f012e8-1e12-4df9-a332-889d32b19f44\") " pod="openshift-dns/dns-default-jfwz6" Jul 10 14:32:12.083141 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:12.083120 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/48f012e8-1e12-4df9-a332-889d32b19f44-tmp-dir\") pod \"dns-default-jfwz6\" (UID: \"48f012e8-1e12-4df9-a332-889d32b19f44\") " pod="openshift-dns/dns-default-jfwz6" Jul 10 14:32:12.083181 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:12.083158 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5e7585d6-9ee5-4459-a03d-87525c804667-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n84n4\" (UID: \"5e7585d6-9ee5-4459-a03d-87525c804667\") " pod="openshift-insights/insights-runtime-extractor-n84n4" Jul 10 14:32:12.083360 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:12.083342 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/48f012e8-1e12-4df9-a332-889d32b19f44-config-volume\") pod \"dns-default-jfwz6\" (UID: \"48f012e8-1e12-4df9-a332-889d32b19f44\") " pod="openshift-dns/dns-default-jfwz6" Jul 10 14:32:12.086783 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:12.086669 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/48f012e8-1e12-4df9-a332-889d32b19f44-metrics-tls\") pod \"dns-default-jfwz6\" (UID: \"48f012e8-1e12-4df9-a332-889d32b19f44\") " pod="openshift-dns/dns-default-jfwz6" Jul 10 14:32:12.086909 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:12.086734 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5e7585d6-9ee5-4459-a03d-87525c804667-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n84n4\" (UID: \"5e7585d6-9ee5-4459-a03d-87525c804667\") " pod="openshift-insights/insights-runtime-extractor-n84n4" Jul 10 14:32:12.086909 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:12.086891 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13ee1d4e-21f9-4af1-80db-98bd57925107-cert\") pod \"ingress-canary-wdx2d\" (UID: \"13ee1d4e-21f9-4af1-80db-98bd57925107\") " pod="openshift-ingress-canary/ingress-canary-wdx2d" Jul 10 14:32:12.091082 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:12.091058 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmv7b\" (UniqueName: \"kubernetes.io/projected/5e7585d6-9ee5-4459-a03d-87525c804667-kube-api-access-bmv7b\") pod \"insights-runtime-extractor-n84n4\" (UID: \"5e7585d6-9ee5-4459-a03d-87525c804667\") " pod="openshift-insights/insights-runtime-extractor-n84n4" Jul 10 14:32:12.091214 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:12.091068 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f947\" (UniqueName: \"kubernetes.io/projected/13ee1d4e-21f9-4af1-80db-98bd57925107-kube-api-access-2f947\") pod \"ingress-canary-wdx2d\" (UID: \"13ee1d4e-21f9-4af1-80db-98bd57925107\") " pod="openshift-ingress-canary/ingress-canary-wdx2d" Jul 10 14:32:12.091265 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:12.091214 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2lmk\" (UniqueName: \"kubernetes.io/projected/48f012e8-1e12-4df9-a332-889d32b19f44-kube-api-access-h2lmk\") pod \"dns-default-jfwz6\" (UID: \"48f012e8-1e12-4df9-a332-889d32b19f44\") " pod="openshift-dns/dns-default-jfwz6" Jul 10 14:32:12.154055 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:12.154020 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wdx2d" Jul 10 14:32:12.175784 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:12.175762 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n84n4" Jul 10 14:32:12.189909 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:12.189859 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jfwz6" Jul 10 14:32:12.345783 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:12.345673 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n84n4"] Jul 10 14:32:12.348548 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:12.348527 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wdx2d"] Jul 10 14:32:12.360049 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:12.360029 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jfwz6"] Jul 10 14:32:12.363286 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:32:12.363263 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48f012e8_1e12_4df9_a332_889d32b19f44.slice/crio-40f15083000a48bbc60574a83ef5f3ab8a144c6462fc3986e282ad7bba0f6afb WatchSource:0}: Error finding container 40f15083000a48bbc60574a83ef5f3ab8a144c6462fc3986e282ad7bba0f6afb: Status 404 returned error can't find the container with id 40f15083000a48bbc60574a83ef5f3ab8a144c6462fc3986e282ad7bba0f6afb Jul 10 14:32:12.786376 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:12.786338 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n84n4" event={"ID":"5e7585d6-9ee5-4459-a03d-87525c804667","Type":"ContainerStarted","Data":"7ed571c8c4a10ce9e0d4d1bfdf4d2d7efe4b4588e97f9df54b9144d0d6624e0e"} Jul 10 14:32:12.787287 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:12.787263 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jfwz6" event={"ID":"48f012e8-1e12-4df9-a332-889d32b19f44","Type":"ContainerStarted","Data":"40f15083000a48bbc60574a83ef5f3ab8a144c6462fc3986e282ad7bba0f6afb"} Jul 10 14:32:12.788239 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:12.788219 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wdx2d" event={"ID":"13ee1d4e-21f9-4af1-80db-98bd57925107","Type":"ContainerStarted","Data":"1415454fbb6752623a3dd2e3d243ac0ce7435c32fe1b1caed85fc63de456fe6d"} Jul 10 14:32:13.458377 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:13.456694 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:32:13.458377 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:13.457188 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:32:13.458377 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:13.457591 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:32:13.460287 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:13.460265 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 14:32:13.463956 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:13.462465 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 14:32:13.463956 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:13.462691 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 14:32:13.463956 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:13.462929 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pxtsm\"" Jul 10 14:32:13.463956 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:13.463136 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-42vlj\"" Jul 10 14:32:13.463956 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:13.463349 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 14:32:14.986661 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:14.986627 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5dbd779cbf-gmzpn"] Jul 10 14:32:14.999886 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:14.999854 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dbd779cbf-gmzpn" Jul 10 14:32:15.000058 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:14.999947 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dbd779cbf-gmzpn"] Jul 10 14:32:15.002642 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:15.002618 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 10 14:32:15.002642 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:15.002629 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 10 14:32:15.003563 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:15.003542 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 10 14:32:15.003809 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:15.003787 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wvx2q\"" Jul 10 14:32:15.003902 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:15.003814 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 10 14:32:15.003902 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:15.003821 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 10 14:32:15.003902 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:15.003856 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 10 14:32:15.004098 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:15.003798 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 10 14:32:15.010092 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:15.010067 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8564e38c-6574-457e-88d5-f07579c4ce3a-console-config\") pod \"console-5dbd779cbf-gmzpn\" (UID: \"8564e38c-6574-457e-88d5-f07579c4ce3a\") " pod="openshift-console/console-5dbd779cbf-gmzpn" Jul 10 14:32:15.010194 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:15.010110 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8564e38c-6574-457e-88d5-f07579c4ce3a-service-ca\") pod \"console-5dbd779cbf-gmzpn\" (UID: \"8564e38c-6574-457e-88d5-f07579c4ce3a\") " pod="openshift-console/console-5dbd779cbf-gmzpn" Jul 10 14:32:15.010253 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:15.010182 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8564e38c-6574-457e-88d5-f07579c4ce3a-oauth-serving-cert\") pod \"console-5dbd779cbf-gmzpn\" (UID: \"8564e38c-6574-457e-88d5-f07579c4ce3a\") " pod="openshift-console/console-5dbd779cbf-gmzpn" Jul 10 14:32:15.010314 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:15.010291 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8564e38c-6574-457e-88d5-f07579c4ce3a-console-oauth-config\") pod \"console-5dbd779cbf-gmzpn\" (UID: \"8564e38c-6574-457e-88d5-f07579c4ce3a\") " pod="openshift-console/console-5dbd779cbf-gmzpn" Jul 10 14:32:15.010361 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:15.010329 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84xhr\" (UniqueName: \"kubernetes.io/projected/8564e38c-6574-457e-88d5-f07579c4ce3a-kube-api-access-84xhr\") pod \"console-5dbd779cbf-gmzpn\" (UID: \"8564e38c-6574-457e-88d5-f07579c4ce3a\") " pod="openshift-console/console-5dbd779cbf-gmzpn" Jul 10 14:32:15.010423 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:15.010375 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8564e38c-6574-457e-88d5-f07579c4ce3a-console-serving-cert\") pod \"console-5dbd779cbf-gmzpn\" (UID: \"8564e38c-6574-457e-88d5-f07579c4ce3a\") " pod="openshift-console/console-5dbd779cbf-gmzpn" Jul 10 14:32:15.111006 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:15.110945 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8564e38c-6574-457e-88d5-f07579c4ce3a-oauth-serving-cert\") pod \"console-5dbd779cbf-gmzpn\" (UID: \"8564e38c-6574-457e-88d5-f07579c4ce3a\") " pod="openshift-console/console-5dbd779cbf-gmzpn" Jul 10 14:32:15.111163 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:15.111055 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8564e38c-6574-457e-88d5-f07579c4ce3a-console-oauth-config\") pod \"console-5dbd779cbf-gmzpn\" (UID: \"8564e38c-6574-457e-88d5-f07579c4ce3a\") " pod="openshift-console/console-5dbd779cbf-gmzpn" Jul 10 14:32:15.111163 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:15.111088 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84xhr\" (UniqueName: \"kubernetes.io/projected/8564e38c-6574-457e-88d5-f07579c4ce3a-kube-api-access-84xhr\") pod \"console-5dbd779cbf-gmzpn\" (UID: \"8564e38c-6574-457e-88d5-f07579c4ce3a\") " pod="openshift-console/console-5dbd779cbf-gmzpn" Jul 10 14:32:15.111163 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:15.111139 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8564e38c-6574-457e-88d5-f07579c4ce3a-console-serving-cert\") pod \"console-5dbd779cbf-gmzpn\" (UID: \"8564e38c-6574-457e-88d5-f07579c4ce3a\") " pod="openshift-console/console-5dbd779cbf-gmzpn" Jul 10 14:32:15.111334 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:15.111167 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8564e38c-6574-457e-88d5-f07579c4ce3a-console-config\") pod \"console-5dbd779cbf-gmzpn\" (UID: \"8564e38c-6574-457e-88d5-f07579c4ce3a\") " pod="openshift-console/console-5dbd779cbf-gmzpn" Jul 10 14:32:15.111334 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:15.111202 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8564e38c-6574-457e-88d5-f07579c4ce3a-service-ca\") pod \"console-5dbd779cbf-gmzpn\" (UID: \"8564e38c-6574-457e-88d5-f07579c4ce3a\") " pod="openshift-console/console-5dbd779cbf-gmzpn" Jul 10 14:32:15.111822 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:15.111796 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8564e38c-6574-457e-88d5-f07579c4ce3a-oauth-serving-cert\") pod \"console-5dbd779cbf-gmzpn\" (UID: \"8564e38c-6574-457e-88d5-f07579c4ce3a\") " pod="openshift-console/console-5dbd779cbf-gmzpn" Jul 10 14:32:15.112096 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:15.112071 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8564e38c-6574-457e-88d5-f07579c4ce3a-service-ca\") pod \"console-5dbd779cbf-gmzpn\" (UID: \"8564e38c-6574-457e-88d5-f07579c4ce3a\") " pod="openshift-console/console-5dbd779cbf-gmzpn" Jul 10 14:32:15.112346 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:15.112323 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8564e38c-6574-457e-88d5-f07579c4ce3a-console-config\") pod \"console-5dbd779cbf-gmzpn\" (UID: \"8564e38c-6574-457e-88d5-f07579c4ce3a\") " pod="openshift-console/console-5dbd779cbf-gmzpn" Jul 10 14:32:15.115112 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:15.115090 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8564e38c-6574-457e-88d5-f07579c4ce3a-console-oauth-config\") pod \"console-5dbd779cbf-gmzpn\" (UID: \"8564e38c-6574-457e-88d5-f07579c4ce3a\") " pod="openshift-console/console-5dbd779cbf-gmzpn" Jul 10 14:32:15.115215 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:15.115200 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8564e38c-6574-457e-88d5-f07579c4ce3a-console-serving-cert\") pod \"console-5dbd779cbf-gmzpn\" (UID: \"8564e38c-6574-457e-88d5-f07579c4ce3a\") " pod="openshift-console/console-5dbd779cbf-gmzpn" Jul 10 14:32:15.119739 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:15.119714 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84xhr\" (UniqueName: \"kubernetes.io/projected/8564e38c-6574-457e-88d5-f07579c4ce3a-kube-api-access-84xhr\") pod \"console-5dbd779cbf-gmzpn\" (UID: \"8564e38c-6574-457e-88d5-f07579c4ce3a\") " pod="openshift-console/console-5dbd779cbf-gmzpn" Jul 10 14:32:15.311702 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:15.311449 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dbd779cbf-gmzpn" Jul 10 14:32:17.934827 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:17.928659 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dbd779cbf-gmzpn"] Jul 10 14:32:18.740626 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:18.740597 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-p44lx"] Jul 10 14:32:18.742529 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:18.742513 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-p44lx" Jul 10 14:32:18.745099 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:18.745078 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-jlns7\"" Jul 10 14:32:18.746315 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:18.746297 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 10 14:32:18.746315 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:18.746304 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 10 14:32:18.746464 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:18.746329 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 10 14:32:18.746464 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:18.746300 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 10 14:32:18.746464 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:18.746357 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 10 14:32:18.753904 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:18.753886 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-p44lx"] Jul 10 14:32:18.809962 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:18.809937 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n84n4" event={"ID":"5e7585d6-9ee5-4459-a03d-87525c804667","Type":"ContainerStarted","Data":"cc32d95eea6e7ecc5f16a24730543c52fff53700ddde924737931d440a609eb7"} Jul 10 14:32:18.810081 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:18.810004 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n84n4" event={"ID":"5e7585d6-9ee5-4459-a03d-87525c804667","Type":"ContainerStarted","Data":"adb63fc9d77e8837876032b872548961852bdd8acf0ebcc31d68d3d8464d29f3"} Jul 10 14:32:18.811599 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:18.811579 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jfwz6" event={"ID":"48f012e8-1e12-4df9-a332-889d32b19f44","Type":"ContainerStarted","Data":"c0f7d365798e218f26cd4911282f08fb11a29ddf06f758a7ef66fd6a5fedf972"} Jul 10 14:32:18.811676 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:18.811618 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jfwz6" event={"ID":"48f012e8-1e12-4df9-a332-889d32b19f44","Type":"ContainerStarted","Data":"d147cec498d9afed3fe0f11eed205294e840eb03fce258f5fdc2f41f164dfe8e"} Jul 10 14:32:18.811728 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:18.811699 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jfwz6" Jul 10 14:32:18.813076 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:18.813048 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wdx2d" event={"ID":"13ee1d4e-21f9-4af1-80db-98bd57925107","Type":"ContainerStarted","Data":"da82d6dd6f3d3e77b76858a3cdb5e57d36548546a94c058076e0392adf4bd982"} Jul 10 14:32:18.814236 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:18.814217 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dbd779cbf-gmzpn" event={"ID":"8564e38c-6574-457e-88d5-f07579c4ce3a","Type":"ContainerStarted","Data":"bedf7602f7c46e4bc04ef45b7708ce3e7a6a882b32247aa96534c2a3b80e2dd8"} Jul 10 14:32:18.829190 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:18.829141 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jfwz6" podStartSLOduration=2.4098774 podStartE2EDuration="7.829125921s" totalImagesPullingTime="5.419248521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:32:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:32:18.828110318 +0000 UTC m=+56.905771864" watchObservedRunningTime="2026-07-10 14:32:18.829125921 +0000 UTC m=+56.906787473" Jul 10 14:32:18.837668 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:18.837640 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84f8c\" (UniqueName: \"kubernetes.io/projected/cf383efe-1048-46b7-9024-288da2f39ef7-kube-api-access-84f8c\") pod \"prometheus-operator-64785b6675-p44lx\" (UID: \"cf383efe-1048-46b7-9024-288da2f39ef7\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p44lx" Jul 10 14:32:18.837771 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:18.837736 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf383efe-1048-46b7-9024-288da2f39ef7-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-p44lx\" (UID: \"cf383efe-1048-46b7-9024-288da2f39ef7\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p44lx" Jul 10 14:32:18.837838 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:18.837814 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf383efe-1048-46b7-9024-288da2f39ef7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-p44lx\" (UID: \"cf383efe-1048-46b7-9024-288da2f39ef7\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p44lx" Jul 10 14:32:18.837981 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:18.837849 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf383efe-1048-46b7-9024-288da2f39ef7-metrics-client-ca\") pod \"prometheus-operator-64785b6675-p44lx\" (UID: \"cf383efe-1048-46b7-9024-288da2f39ef7\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p44lx" Jul 10 14:32:18.843707 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:18.843663 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wdx2d" podStartSLOduration=2.412456587 podStartE2EDuration="7.843646279s" totalImagesPullingTime="5.431189692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:32:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:32:18.842700865 +0000 UTC m=+56.920362410" watchObservedRunningTime="2026-07-10 14:32:18.843646279 +0000 UTC m=+56.921307826" Jul 10 14:32:18.938520 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:18.938481 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf383efe-1048-46b7-9024-288da2f39ef7-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-p44lx\" (UID: \"cf383efe-1048-46b7-9024-288da2f39ef7\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p44lx" Jul 10 14:32:18.938957 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:18.938555 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf383efe-1048-46b7-9024-288da2f39ef7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-p44lx\" (UID: \"cf383efe-1048-46b7-9024-288da2f39ef7\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p44lx" Jul 10 14:32:18.938957 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:18.938584 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf383efe-1048-46b7-9024-288da2f39ef7-metrics-client-ca\") pod \"prometheus-operator-64785b6675-p44lx\" (UID: \"cf383efe-1048-46b7-9024-288da2f39ef7\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p44lx" Jul 10 14:32:18.938957 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:18.938630 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84f8c\" (UniqueName: \"kubernetes.io/projected/cf383efe-1048-46b7-9024-288da2f39ef7-kube-api-access-84f8c\") pod \"prometheus-operator-64785b6675-p44lx\" (UID: \"cf383efe-1048-46b7-9024-288da2f39ef7\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p44lx" Jul 10 14:32:18.938957 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:32:18.938699 2571 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 10 14:32:18.938957 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:32:18.938776 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf383efe-1048-46b7-9024-288da2f39ef7-prometheus-operator-tls podName:cf383efe-1048-46b7-9024-288da2f39ef7 nodeName:}" failed. No retries permitted until 2026-07-10 14:32:19.438752866 +0000 UTC m=+57.516414389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/cf383efe-1048-46b7-9024-288da2f39ef7-prometheus-operator-tls") pod "prometheus-operator-64785b6675-p44lx" (UID: "cf383efe-1048-46b7-9024-288da2f39ef7") : secret "prometheus-operator-tls" not found Jul 10 14:32:18.939523 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:18.939499 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf383efe-1048-46b7-9024-288da2f39ef7-metrics-client-ca\") pod \"prometheus-operator-64785b6675-p44lx\" (UID: \"cf383efe-1048-46b7-9024-288da2f39ef7\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p44lx" Jul 10 14:32:18.941636 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:18.941609 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf383efe-1048-46b7-9024-288da2f39ef7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-p44lx\" (UID: \"cf383efe-1048-46b7-9024-288da2f39ef7\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p44lx" Jul 10 14:32:18.947995 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:18.947957 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84f8c\" (UniqueName: \"kubernetes.io/projected/cf383efe-1048-46b7-9024-288da2f39ef7-kube-api-access-84f8c\") pod \"prometheus-operator-64785b6675-p44lx\" (UID: \"cf383efe-1048-46b7-9024-288da2f39ef7\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p44lx" Jul 10 14:32:19.442755 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:19.442716 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf383efe-1048-46b7-9024-288da2f39ef7-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-p44lx\" (UID: \"cf383efe-1048-46b7-9024-288da2f39ef7\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p44lx" Jul 10 14:32:19.445727 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:19.445701 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf383efe-1048-46b7-9024-288da2f39ef7-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-p44lx\" (UID: \"cf383efe-1048-46b7-9024-288da2f39ef7\") " pod="openshift-monitoring/prometheus-operator-64785b6675-p44lx" Jul 10 14:32:19.651245 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:19.651195 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-p44lx" Jul 10 14:32:19.798326 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:19.798105 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-p44lx"] Jul 10 14:32:19.802986 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:32:19.802479 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf383efe_1048_46b7_9024_288da2f39ef7.slice/crio-5bfca39d97cfc75208fa0712c18769a30b09bd91a2449b1afa20b2c1be92fecc WatchSource:0}: Error finding container 5bfca39d97cfc75208fa0712c18769a30b09bd91a2449b1afa20b2c1be92fecc: Status 404 returned error can't find the container with id 5bfca39d97cfc75208fa0712c18769a30b09bd91a2449b1afa20b2c1be92fecc Jul 10 14:32:19.820394 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:19.820351 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-p44lx" event={"ID":"cf383efe-1048-46b7-9024-288da2f39ef7","Type":"ContainerStarted","Data":"5bfca39d97cfc75208fa0712c18769a30b09bd91a2449b1afa20b2c1be92fecc"} Jul 10 14:32:22.746874 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:22.746846 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7clbv" Jul 10 14:32:23.834649 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:23.834612 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n84n4" event={"ID":"5e7585d6-9ee5-4459-a03d-87525c804667","Type":"ContainerStarted","Data":"bdcb12e6e30851533c3fa208ec90eb1faab70c3e9b70617922b73b208a0763bc"} Jul 10 14:32:23.836169 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:23.836136 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dbd779cbf-gmzpn" event={"ID":"8564e38c-6574-457e-88d5-f07579c4ce3a","Type":"ContainerStarted","Data":"f523e81ec193f640171a2bd2ed88cbd976341a354e892bf95bd5b4146b4e6a20"} Jul 10 14:32:23.837817 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:23.837793 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-p44lx" event={"ID":"cf383efe-1048-46b7-9024-288da2f39ef7","Type":"ContainerStarted","Data":"f7b0e0c9d05165357385258b6cd81101206857f76f90dfe0c3a234a17ea0672e"} Jul 10 14:32:23.837915 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:23.837841 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-p44lx" event={"ID":"cf383efe-1048-46b7-9024-288da2f39ef7","Type":"ContainerStarted","Data":"e0962e71d920654b7f5ec3b2270b8eb24dfefd7079619c88cfc9dc6404af097e"} Jul 10 14:32:23.853768 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:23.853725 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-n84n4" podStartSLOduration=2.576903843 podStartE2EDuration="12.853710408s" totalImagesPullingTime="10.276806565s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:32:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:32:23.852937283 +0000 UTC m=+61.930598829" watchObservedRunningTime="2026-07-10 14:32:23.853710408 +0000 UTC m=+61.931371956" Jul 10 14:32:23.869897 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:23.869852 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5dbd779cbf-gmzpn" podStartSLOduration=5.015981226 podStartE2EDuration="9.869838559s" totalImagesPullingTime="4.853857333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:32:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:32:23.869302659 +0000 UTC m=+61.946964200" watchObservedRunningTime="2026-07-10 14:32:23.869838559 +0000 UTC m=+61.947500104" Jul 10 14:32:23.886444 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:23.886394 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-p44lx" podStartSLOduration=2.772376013 podStartE2EDuration="5.886381915s" totalImagesPullingTime="3.114005902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:32:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:32:23.886336166 +0000 UTC m=+61.963997710" watchObservedRunningTime="2026-07-10 14:32:23.886381915 +0000 UTC m=+61.964043460" Jul 10 14:32:25.312095 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:25.312048 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5dbd779cbf-gmzpn" Jul 10 14:32:25.312470 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:25.312113 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5dbd779cbf-gmzpn" Jul 10 14:32:25.313385 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:25.313362 2571 patch_prober.go:28] interesting pod/console-5dbd779cbf-gmzpn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.9:8443/health\": dial tcp 10.133.0.9:8443: connect: connection refused" start-of-body= Jul 10 14:32:25.313434 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:25.313405 2571 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5dbd779cbf-gmzpn" podUID="8564e38c-6574-457e-88d5-f07579c4ce3a" containerName="console" probeResult="failure" output="Get \"https://10.133.0.9:8443/health\": dial tcp 10.133.0.9:8443: connect: connection refused" Jul 10 14:32:26.081471 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.081438 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mg4gr"] Jul 10 14:32:26.084477 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.084451 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mg4gr" Jul 10 14:32:26.087054 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.087028 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 10 14:32:26.087054 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.087042 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nmp5h\"" Jul 10 14:32:26.087324 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.087300 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 10 14:32:26.087429 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.087385 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 10 14:32:26.198869 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.198839 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/85833fc3-8c9e-41a7-94bc-aba18096e17d-node-exporter-tls\") pod \"node-exporter-mg4gr\" (UID: \"85833fc3-8c9e-41a7-94bc-aba18096e17d\") " pod="openshift-monitoring/node-exporter-mg4gr" Jul 10 14:32:26.199020 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.198894 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/85833fc3-8c9e-41a7-94bc-aba18096e17d-node-exporter-textfile\") pod \"node-exporter-mg4gr\" (UID: \"85833fc3-8c9e-41a7-94bc-aba18096e17d\") " pod="openshift-monitoring/node-exporter-mg4gr" Jul 10 14:32:26.199020 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.198942 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/85833fc3-8c9e-41a7-94bc-aba18096e17d-root\") pod \"node-exporter-mg4gr\" (UID: \"85833fc3-8c9e-41a7-94bc-aba18096e17d\") " pod="openshift-monitoring/node-exporter-mg4gr" Jul 10 14:32:26.199099 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.199017 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/85833fc3-8c9e-41a7-94bc-aba18096e17d-node-exporter-wtmp\") pod \"node-exporter-mg4gr\" (UID: \"85833fc3-8c9e-41a7-94bc-aba18096e17d\") " pod="openshift-monitoring/node-exporter-mg4gr" Jul 10 14:32:26.199099 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.199046 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85833fc3-8c9e-41a7-94bc-aba18096e17d-metrics-client-ca\") pod \"node-exporter-mg4gr\" (UID: \"85833fc3-8c9e-41a7-94bc-aba18096e17d\") " pod="openshift-monitoring/node-exporter-mg4gr" Jul 10 14:32:26.199099 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.199075 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/85833fc3-8c9e-41a7-94bc-aba18096e17d-node-exporter-accelerators-collector-config\") pod \"node-exporter-mg4gr\" (UID: \"85833fc3-8c9e-41a7-94bc-aba18096e17d\") " pod="openshift-monitoring/node-exporter-mg4gr" Jul 10 14:32:26.199099 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.199097 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6z8h\" (UniqueName: \"kubernetes.io/projected/85833fc3-8c9e-41a7-94bc-aba18096e17d-kube-api-access-k6z8h\") pod \"node-exporter-mg4gr\" (UID: \"85833fc3-8c9e-41a7-94bc-aba18096e17d\") " pod="openshift-monitoring/node-exporter-mg4gr" Jul 10 14:32:26.199220 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.199121 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85833fc3-8c9e-41a7-94bc-aba18096e17d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mg4gr\" (UID: \"85833fc3-8c9e-41a7-94bc-aba18096e17d\") " pod="openshift-monitoring/node-exporter-mg4gr" Jul 10 14:32:26.199220 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.199184 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/85833fc3-8c9e-41a7-94bc-aba18096e17d-sys\") pod \"node-exporter-mg4gr\" (UID: \"85833fc3-8c9e-41a7-94bc-aba18096e17d\") " pod="openshift-monitoring/node-exporter-mg4gr" Jul 10 14:32:26.300417 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.300392 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/85833fc3-8c9e-41a7-94bc-aba18096e17d-sys\") pod \"node-exporter-mg4gr\" (UID: \"85833fc3-8c9e-41a7-94bc-aba18096e17d\") " pod="openshift-monitoring/node-exporter-mg4gr" Jul 10 14:32:26.300549 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.300433 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/85833fc3-8c9e-41a7-94bc-aba18096e17d-node-exporter-tls\") pod \"node-exporter-mg4gr\" (UID: \"85833fc3-8c9e-41a7-94bc-aba18096e17d\") " pod="openshift-monitoring/node-exporter-mg4gr" Jul 10 14:32:26.300549 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.300464 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/85833fc3-8c9e-41a7-94bc-aba18096e17d-node-exporter-textfile\") pod \"node-exporter-mg4gr\" (UID: \"85833fc3-8c9e-41a7-94bc-aba18096e17d\") " pod="openshift-monitoring/node-exporter-mg4gr" Jul 10 14:32:26.300549 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.300481 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/85833fc3-8c9e-41a7-94bc-aba18096e17d-root\") pod \"node-exporter-mg4gr\" (UID: \"85833fc3-8c9e-41a7-94bc-aba18096e17d\") " pod="openshift-monitoring/node-exporter-mg4gr" Jul 10 14:32:26.300549 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.300500 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/85833fc3-8c9e-41a7-94bc-aba18096e17d-sys\") pod \"node-exporter-mg4gr\" (UID: \"85833fc3-8c9e-41a7-94bc-aba18096e17d\") " pod="openshift-monitoring/node-exporter-mg4gr" Jul 10 14:32:26.300549 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.300529 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/85833fc3-8c9e-41a7-94bc-aba18096e17d-root\") pod \"node-exporter-mg4gr\" (UID: \"85833fc3-8c9e-41a7-94bc-aba18096e17d\") " pod="openshift-monitoring/node-exporter-mg4gr" Jul 10 14:32:26.300800 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:32:26.300552 2571 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 10 14:32:26.300800 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.300586 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/85833fc3-8c9e-41a7-94bc-aba18096e17d-node-exporter-wtmp\") pod \"node-exporter-mg4gr\" (UID: \"85833fc3-8c9e-41a7-94bc-aba18096e17d\") " pod="openshift-monitoring/node-exporter-mg4gr" Jul 10 14:32:26.300800 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:32:26.300617 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85833fc3-8c9e-41a7-94bc-aba18096e17d-node-exporter-tls podName:85833fc3-8c9e-41a7-94bc-aba18096e17d nodeName:}" failed. No retries permitted until 2026-07-10 14:32:26.800597757 +0000 UTC m=+64.878259281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/85833fc3-8c9e-41a7-94bc-aba18096e17d-node-exporter-tls") pod "node-exporter-mg4gr" (UID: "85833fc3-8c9e-41a7-94bc-aba18096e17d") : secret "node-exporter-tls" not found Jul 10 14:32:26.300800 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.300645 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85833fc3-8c9e-41a7-94bc-aba18096e17d-metrics-client-ca\") pod \"node-exporter-mg4gr\" (UID: \"85833fc3-8c9e-41a7-94bc-aba18096e17d\") " pod="openshift-monitoring/node-exporter-mg4gr" Jul 10 14:32:26.300800 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.300668 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/85833fc3-8c9e-41a7-94bc-aba18096e17d-node-exporter-accelerators-collector-config\") pod \"node-exporter-mg4gr\" (UID: \"85833fc3-8c9e-41a7-94bc-aba18096e17d\") " pod="openshift-monitoring/node-exporter-mg4gr" Jul 10 14:32:26.300800 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.300700 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/85833fc3-8c9e-41a7-94bc-aba18096e17d-node-exporter-wtmp\") pod \"node-exporter-mg4gr\" (UID: \"85833fc3-8c9e-41a7-94bc-aba18096e17d\") " pod="openshift-monitoring/node-exporter-mg4gr" Jul 10 14:32:26.300800 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.300709 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6z8h\" (UniqueName: \"kubernetes.io/projected/85833fc3-8c9e-41a7-94bc-aba18096e17d-kube-api-access-k6z8h\") pod \"node-exporter-mg4gr\" (UID: \"85833fc3-8c9e-41a7-94bc-aba18096e17d\") " pod="openshift-monitoring/node-exporter-mg4gr" Jul 10 14:32:26.300800 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.300743 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85833fc3-8c9e-41a7-94bc-aba18096e17d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mg4gr\" (UID: \"85833fc3-8c9e-41a7-94bc-aba18096e17d\") " pod="openshift-monitoring/node-exporter-mg4gr" Jul 10 14:32:26.301116 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.300830 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/85833fc3-8c9e-41a7-94bc-aba18096e17d-node-exporter-textfile\") pod \"node-exporter-mg4gr\" (UID: \"85833fc3-8c9e-41a7-94bc-aba18096e17d\") " pod="openshift-monitoring/node-exporter-mg4gr" Jul 10 14:32:26.301151 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.301122 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85833fc3-8c9e-41a7-94bc-aba18096e17d-metrics-client-ca\") pod \"node-exporter-mg4gr\" (UID: \"85833fc3-8c9e-41a7-94bc-aba18096e17d\") " pod="openshift-monitoring/node-exporter-mg4gr" Jul 10 14:32:26.301186 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.301170 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/85833fc3-8c9e-41a7-94bc-aba18096e17d-node-exporter-accelerators-collector-config\") pod \"node-exporter-mg4gr\" (UID: \"85833fc3-8c9e-41a7-94bc-aba18096e17d\") " pod="openshift-monitoring/node-exporter-mg4gr" Jul 10 14:32:26.303076 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.303051 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85833fc3-8c9e-41a7-94bc-aba18096e17d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mg4gr\" (UID: \"85833fc3-8c9e-41a7-94bc-aba18096e17d\") " pod="openshift-monitoring/node-exporter-mg4gr" Jul 10 14:32:26.308634 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.308611 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6z8h\" (UniqueName: \"kubernetes.io/projected/85833fc3-8c9e-41a7-94bc-aba18096e17d-kube-api-access-k6z8h\") pod \"node-exporter-mg4gr\" (UID: \"85833fc3-8c9e-41a7-94bc-aba18096e17d\") " pod="openshift-monitoring/node-exporter-mg4gr" Jul 10 14:32:26.805724 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.805690 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/85833fc3-8c9e-41a7-94bc-aba18096e17d-node-exporter-tls\") pod \"node-exporter-mg4gr\" (UID: \"85833fc3-8c9e-41a7-94bc-aba18096e17d\") " pod="openshift-monitoring/node-exporter-mg4gr" Jul 10 14:32:26.807846 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.807827 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/85833fc3-8c9e-41a7-94bc-aba18096e17d-node-exporter-tls\") pod \"node-exporter-mg4gr\" (UID: \"85833fc3-8c9e-41a7-94bc-aba18096e17d\") " pod="openshift-monitoring/node-exporter-mg4gr" Jul 10 14:32:26.992828 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:26.992795 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mg4gr" Jul 10 14:32:27.002331 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:32:27.002308 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85833fc3_8c9e_41a7_94bc_aba18096e17d.slice/crio-69ed5d2035e30e75f2782d2a4595183c22a88f457a3a76a431362df4669a913d WatchSource:0}: Error finding container 69ed5d2035e30e75f2782d2a4595183c22a88f457a3a76a431362df4669a913d: Status 404 returned error can't find the container with id 69ed5d2035e30e75f2782d2a4595183c22a88f457a3a76a431362df4669a913d Jul 10 14:32:27.156996 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.156952 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 14:32:27.160173 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.160149 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.163148 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.163127 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 10 14:32:27.163282 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.163128 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-sml8n\"" Jul 10 14:32:27.163282 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.163127 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 10 14:32:27.163282 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.163236 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 10 14:32:27.163480 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.163461 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 10 14:32:27.163565 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.163527 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 10 14:32:27.163624 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.163592 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 10 14:32:27.163624 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.163610 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 10 14:32:27.163722 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.163660 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 10 14:32:27.163889 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.163877 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 10 14:32:27.176625 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.176608 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 14:32:27.211661 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.211641 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e0d7efcd-121d-48e7-82f6-cc405e907258-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.211762 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.211668 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0d7efcd-121d-48e7-82f6-cc405e907258-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.211762 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.211688 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-config-volume\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.211762 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.211708 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e0d7efcd-121d-48e7-82f6-cc405e907258-config-out\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.211762 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.211760 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0d7efcd-121d-48e7-82f6-cc405e907258-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.211893 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.211793 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.211893 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.211814 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-web-config\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.211893 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.211835 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e0d7efcd-121d-48e7-82f6-cc405e907258-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.211893 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.211857 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.211893 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.211872 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.212074 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.211896 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.212074 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.211953 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.212074 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.211981 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk52c\" (UniqueName: \"kubernetes.io/projected/e0d7efcd-121d-48e7-82f6-cc405e907258-kube-api-access-kk52c\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.312774 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.312691 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.312774 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.312727 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk52c\" (UniqueName: \"kubernetes.io/projected/e0d7efcd-121d-48e7-82f6-cc405e907258-kube-api-access-kk52c\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.312774 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.312771 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e0d7efcd-121d-48e7-82f6-cc405e907258-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.313077 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.312790 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0d7efcd-121d-48e7-82f6-cc405e907258-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.313077 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.312820 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-config-volume\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.313077 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.312837 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e0d7efcd-121d-48e7-82f6-cc405e907258-config-out\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.313077 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:32:27.312841 2571 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 10 14:32:27.313077 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:32:27.312914 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-secret-alertmanager-main-tls podName:e0d7efcd-121d-48e7-82f6-cc405e907258 nodeName:}" failed. No retries permitted until 2026-07-10 14:32:27.812892824 +0000 UTC m=+65.890554351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "e0d7efcd-121d-48e7-82f6-cc405e907258") : secret "alertmanager-main-tls" not found Jul 10 14:32:27.313077 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.313023 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0d7efcd-121d-48e7-82f6-cc405e907258-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.313077 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.313068 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.313415 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.313103 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-web-config\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.313415 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.313154 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e0d7efcd-121d-48e7-82f6-cc405e907258-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.313415 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:32:27.313212 2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e0d7efcd-121d-48e7-82f6-cc405e907258-alertmanager-trusted-ca-bundle podName:e0d7efcd-121d-48e7-82f6-cc405e907258 nodeName:}" failed. No retries permitted until 2026-07-10 14:32:27.813193893 +0000 UTC m=+65.890855436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/e0d7efcd-121d-48e7-82f6-cc405e907258-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "e0d7efcd-121d-48e7-82f6-cc405e907258") : configmap references non-existent config key: ca-bundle.crt Jul 10 14:32:27.313415 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.313195 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.313415 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.313302 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e0d7efcd-121d-48e7-82f6-cc405e907258-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.313415 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.313357 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.313415 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.313395 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.313757 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.313624 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0d7efcd-121d-48e7-82f6-cc405e907258-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.315642 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.315617 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e0d7efcd-121d-48e7-82f6-cc405e907258-config-out\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.316113 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.316087 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-config-volume\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.316214 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.316198 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e0d7efcd-121d-48e7-82f6-cc405e907258-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.316363 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.316341 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.316446 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.316358 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-web-config\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.316446 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.316411 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.316547 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.316532 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.316580 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.316565 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.323036 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.322952 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk52c\" (UniqueName: \"kubernetes.io/projected/e0d7efcd-121d-48e7-82f6-cc405e907258-kube-api-access-kk52c\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.817292 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.817260 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0d7efcd-121d-48e7-82f6-cc405e907258-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.817694 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.817355 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.818049 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.818030 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0d7efcd-121d-48e7-82f6-cc405e907258-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.819743 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.819724 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:27.856617 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:27.856577 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mg4gr" event={"ID":"85833fc3-8c9e-41a7-94bc-aba18096e17d","Type":"ContainerStarted","Data":"69ed5d2035e30e75f2782d2a4595183c22a88f457a3a76a431362df4669a913d"} Jul 10 14:32:28.070172 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:28.070127 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:32:28.121933 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:28.121453 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/031289f7-f9ec-407f-8fa5-98afbc1755a3-original-pull-secret\") pod \"global-pull-secret-syncer-tc6vj\" (UID: \"031289f7-f9ec-407f-8fa5-98afbc1755a3\") " pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:32:28.121933 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:28.121537 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea476f2b-59d7-4272-be5c-30a782f21228-metrics-certs\") pod \"network-metrics-daemon-x4brx\" (UID: \"ea476f2b-59d7-4272-be5c-30a782f21228\") " pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:32:28.124163 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:28.124140 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 10 14:32:28.124272 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:28.124235 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 10 14:32:28.135184 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:28.135126 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea476f2b-59d7-4272-be5c-30a782f21228-metrics-certs\") pod \"network-metrics-daemon-x4brx\" (UID: \"ea476f2b-59d7-4272-be5c-30a782f21228\") " pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:32:28.135484 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:28.135457 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/031289f7-f9ec-407f-8fa5-98afbc1755a3-original-pull-secret\") pod \"global-pull-secret-syncer-tc6vj\" (UID: \"031289f7-f9ec-407f-8fa5-98afbc1755a3\") " pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:32:28.178527 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:28.178500 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pxtsm\"" Jul 10 14:32:28.186545 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:28.186519 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-x4brx" Jul 10 14:32:28.186673 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:28.186591 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tc6vj" Jul 10 14:32:28.212208 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:28.212186 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 14:32:28.223061 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:28.223026 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd6xt\" (UniqueName: \"kubernetes.io/projected/81b8479f-42ac-4f15-8e01-1dd667debc38-kube-api-access-pd6xt\") pod \"network-check-target-vs75x\" (UID: \"81b8479f-42ac-4f15-8e01-1dd667debc38\") " pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:32:28.225730 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:28.225707 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 10 14:32:28.234802 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:32:28.234770 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0d7efcd_121d_48e7_82f6_cc405e907258.slice/crio-cd504ac81b15c3580c51acaab91ffc1ff3ca01c08c1d80dbd10a0159e268be19 WatchSource:0}: Error finding container cd504ac81b15c3580c51acaab91ffc1ff3ca01c08c1d80dbd10a0159e268be19: Status 404 returned error can't find the container with id cd504ac81b15c3580c51acaab91ffc1ff3ca01c08c1d80dbd10a0159e268be19 Jul 10 14:32:28.236148 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:28.236123 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 10 14:32:28.246787 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:28.246732 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd6xt\" (UniqueName: \"kubernetes.io/projected/81b8479f-42ac-4f15-8e01-1dd667debc38-kube-api-access-pd6xt\") pod \"network-check-target-vs75x\" (UID: \"81b8479f-42ac-4f15-8e01-1dd667debc38\") " pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:32:28.318109 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:28.318075 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tc6vj"] Jul 10 14:32:28.321778 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:32:28.321716 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod031289f7_f9ec_407f_8fa5_98afbc1755a3.slice/crio-babfecfed9ce18889660239f22adfd014d295e12b7b8f41bee20cc9d1fef7e45 WatchSource:0}: Error finding container babfecfed9ce18889660239f22adfd014d295e12b7b8f41bee20cc9d1fef7e45: Status 404 returned error can't find the container with id babfecfed9ce18889660239f22adfd014d295e12b7b8f41bee20cc9d1fef7e45 Jul 10 14:32:28.337698 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:28.337625 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-x4brx"] Jul 10 14:32:28.340770 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:32:28.340747 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea476f2b_59d7_4272_be5c_30a782f21228.slice/crio-5bb66b9378bf1fdeba780eff78953d46d4a78ab2a3f131b201de60ba4e9e4c83 WatchSource:0}: Error finding container 5bb66b9378bf1fdeba780eff78953d46d4a78ab2a3f131b201de60ba4e9e4c83: Status 404 returned error can't find the container with id 5bb66b9378bf1fdeba780eff78953d46d4a78ab2a3f131b201de60ba4e9e4c83 Jul 10 14:32:28.512586 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:28.512557 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-42vlj\"" Jul 10 14:32:28.521401 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:28.521382 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:32:28.640727 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:28.640694 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vs75x"] Jul 10 14:32:28.643253 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:32:28.643222 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81b8479f_42ac_4f15_8e01_1dd667debc38.slice/crio-4635beeff20feef99807363bfadd297e045f534496ab6851917857abe267f0cf WatchSource:0}: Error finding container 4635beeff20feef99807363bfadd297e045f534496ab6851917857abe267f0cf: Status 404 returned error can't find the container with id 4635beeff20feef99807363bfadd297e045f534496ab6851917857abe267f0cf Jul 10 14:32:28.823460 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:28.823429 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jfwz6" Jul 10 14:32:28.863816 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:28.863727 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vs75x" event={"ID":"81b8479f-42ac-4f15-8e01-1dd667debc38","Type":"ContainerStarted","Data":"4635beeff20feef99807363bfadd297e045f534496ab6851917857abe267f0cf"} Jul 10 14:32:28.865412 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:28.865384 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x4brx" event={"ID":"ea476f2b-59d7-4272-be5c-30a782f21228","Type":"ContainerStarted","Data":"5bb66b9378bf1fdeba780eff78953d46d4a78ab2a3f131b201de60ba4e9e4c83"} Jul 10 14:32:28.867276 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:28.867253 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e0d7efcd-121d-48e7-82f6-cc405e907258","Type":"ContainerStarted","Data":"cd504ac81b15c3580c51acaab91ffc1ff3ca01c08c1d80dbd10a0159e268be19"} Jul 10 14:32:28.868567 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:28.868540 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tc6vj" event={"ID":"031289f7-f9ec-407f-8fa5-98afbc1755a3","Type":"ContainerStarted","Data":"babfecfed9ce18889660239f22adfd014d295e12b7b8f41bee20cc9d1fef7e45"} Jul 10 14:32:28.871182 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:28.871143 2571 generic.go:356] "Generic (PLEG): container finished" podID="85833fc3-8c9e-41a7-94bc-aba18096e17d" containerID="805dcab414bd01cfc559bfc60685422ad54c8dd54cc47895cdb6533215bc57b5" exitCode=0 Jul 10 14:32:28.871287 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:28.871200 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mg4gr" event={"ID":"85833fc3-8c9e-41a7-94bc-aba18096e17d","Type":"ContainerDied","Data":"805dcab414bd01cfc559bfc60685422ad54c8dd54cc47895cdb6533215bc57b5"} Jul 10 14:32:29.075512 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.075447 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd"] Jul 10 14:32:29.088922 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.088904 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" Jul 10 14:32:29.092036 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.091803 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd"] Jul 10 14:32:29.092219 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.092201 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 10 14:32:29.092268 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.092218 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 10 14:32:29.092321 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.092201 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 10 14:32:29.092371 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.092346 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-frx9l\"" Jul 10 14:32:29.092439 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.092419 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 10 14:32:29.092495 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.092460 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-s92fsd18rr9o\"" Jul 10 14:32:29.092763 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.092746 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 10 14:32:29.129162 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.129111 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b83f2b41-b0c7-4516-a51d-e28730a1de64-secret-thanos-querier-tls\") pod \"thanos-querier-6c6d66b8b7-t7dsd\" (UID: \"b83f2b41-b0c7-4516-a51d-e28730a1de64\") " pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" Jul 10 14:32:29.129162 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.129149 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b83f2b41-b0c7-4516-a51d-e28730a1de64-secret-grpc-tls\") pod \"thanos-querier-6c6d66b8b7-t7dsd\" (UID: \"b83f2b41-b0c7-4516-a51d-e28730a1de64\") " pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" Jul 10 14:32:29.129324 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.129178 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b83f2b41-b0c7-4516-a51d-e28730a1de64-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c6d66b8b7-t7dsd\" (UID: \"b83f2b41-b0c7-4516-a51d-e28730a1de64\") " pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" Jul 10 14:32:29.129324 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.129210 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b83f2b41-b0c7-4516-a51d-e28730a1de64-metrics-client-ca\") pod \"thanos-querier-6c6d66b8b7-t7dsd\" (UID: \"b83f2b41-b0c7-4516-a51d-e28730a1de64\") " pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" Jul 10 14:32:29.129324 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.129280 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b83f2b41-b0c7-4516-a51d-e28730a1de64-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c6d66b8b7-t7dsd\" (UID: \"b83f2b41-b0c7-4516-a51d-e28730a1de64\") " pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" Jul 10 14:32:29.129324 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.129321 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b83f2b41-b0c7-4516-a51d-e28730a1de64-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c6d66b8b7-t7dsd\" (UID: \"b83f2b41-b0c7-4516-a51d-e28730a1de64\") " pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" Jul 10 14:32:29.129487 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.129349 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b83f2b41-b0c7-4516-a51d-e28730a1de64-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c6d66b8b7-t7dsd\" (UID: \"b83f2b41-b0c7-4516-a51d-e28730a1de64\") " pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" Jul 10 14:32:29.129487 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.129417 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccrg4\" (UniqueName: \"kubernetes.io/projected/b83f2b41-b0c7-4516-a51d-e28730a1de64-kube-api-access-ccrg4\") pod \"thanos-querier-6c6d66b8b7-t7dsd\" (UID: \"b83f2b41-b0c7-4516-a51d-e28730a1de64\") " pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" Jul 10 14:32:29.230589 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.230536 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b83f2b41-b0c7-4516-a51d-e28730a1de64-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c6d66b8b7-t7dsd\" (UID: \"b83f2b41-b0c7-4516-a51d-e28730a1de64\") " pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" Jul 10 14:32:29.230589 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.230581 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b83f2b41-b0c7-4516-a51d-e28730a1de64-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c6d66b8b7-t7dsd\" (UID: \"b83f2b41-b0c7-4516-a51d-e28730a1de64\") " pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" Jul 10 14:32:29.230783 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.230612 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b83f2b41-b0c7-4516-a51d-e28730a1de64-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c6d66b8b7-t7dsd\" (UID: \"b83f2b41-b0c7-4516-a51d-e28730a1de64\") " pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" Jul 10 14:32:29.230783 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.230661 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccrg4\" (UniqueName: \"kubernetes.io/projected/b83f2b41-b0c7-4516-a51d-e28730a1de64-kube-api-access-ccrg4\") pod \"thanos-querier-6c6d66b8b7-t7dsd\" (UID: \"b83f2b41-b0c7-4516-a51d-e28730a1de64\") " pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" Jul 10 14:32:29.230783 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.230697 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b83f2b41-b0c7-4516-a51d-e28730a1de64-secret-thanos-querier-tls\") pod \"thanos-querier-6c6d66b8b7-t7dsd\" (UID: \"b83f2b41-b0c7-4516-a51d-e28730a1de64\") " pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" Jul 10 14:32:29.230783 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.230720 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b83f2b41-b0c7-4516-a51d-e28730a1de64-secret-grpc-tls\") pod \"thanos-querier-6c6d66b8b7-t7dsd\" (UID: \"b83f2b41-b0c7-4516-a51d-e28730a1de64\") " pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" Jul 10 14:32:29.230783 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.230748 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b83f2b41-b0c7-4516-a51d-e28730a1de64-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c6d66b8b7-t7dsd\" (UID: \"b83f2b41-b0c7-4516-a51d-e28730a1de64\") " pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" Jul 10 14:32:29.230783 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.230780 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b83f2b41-b0c7-4516-a51d-e28730a1de64-metrics-client-ca\") pod \"thanos-querier-6c6d66b8b7-t7dsd\" (UID: \"b83f2b41-b0c7-4516-a51d-e28730a1de64\") " pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" Jul 10 14:32:29.231620 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.231593 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b83f2b41-b0c7-4516-a51d-e28730a1de64-metrics-client-ca\") pod \"thanos-querier-6c6d66b8b7-t7dsd\" (UID: \"b83f2b41-b0c7-4516-a51d-e28730a1de64\") " pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" Jul 10 14:32:29.236277 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.236227 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b83f2b41-b0c7-4516-a51d-e28730a1de64-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c6d66b8b7-t7dsd\" (UID: \"b83f2b41-b0c7-4516-a51d-e28730a1de64\") " pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" Jul 10 14:32:29.238237 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.238189 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b83f2b41-b0c7-4516-a51d-e28730a1de64-secret-grpc-tls\") pod \"thanos-querier-6c6d66b8b7-t7dsd\" (UID: \"b83f2b41-b0c7-4516-a51d-e28730a1de64\") " pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" Jul 10 14:32:29.239494 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.239471 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b83f2b41-b0c7-4516-a51d-e28730a1de64-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c6d66b8b7-t7dsd\" (UID: \"b83f2b41-b0c7-4516-a51d-e28730a1de64\") " pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" Jul 10 14:32:29.239609 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.239532 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/b83f2b41-b0c7-4516-a51d-e28730a1de64-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c6d66b8b7-t7dsd\" (UID: \"b83f2b41-b0c7-4516-a51d-e28730a1de64\") " pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" Jul 10 14:32:29.239932 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.239883 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/b83f2b41-b0c7-4516-a51d-e28730a1de64-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c6d66b8b7-t7dsd\" (UID: \"b83f2b41-b0c7-4516-a51d-e28730a1de64\") " pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" Jul 10 14:32:29.240151 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.240128 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccrg4\" (UniqueName: \"kubernetes.io/projected/b83f2b41-b0c7-4516-a51d-e28730a1de64-kube-api-access-ccrg4\") pod \"thanos-querier-6c6d66b8b7-t7dsd\" (UID: \"b83f2b41-b0c7-4516-a51d-e28730a1de64\") " pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" Jul 10 14:32:29.242310 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.242259 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/b83f2b41-b0c7-4516-a51d-e28730a1de64-secret-thanos-querier-tls\") pod \"thanos-querier-6c6d66b8b7-t7dsd\" (UID: \"b83f2b41-b0c7-4516-a51d-e28730a1de64\") " pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" Jul 10 14:32:29.399055 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.398956 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" Jul 10 14:32:29.878991 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.878939 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mg4gr" event={"ID":"85833fc3-8c9e-41a7-94bc-aba18096e17d","Type":"ContainerStarted","Data":"1d89198f2e555c46f8a3080a2d9812bbe65bc8cafa849b8c8e25b650a79f0e4a"} Jul 10 14:32:29.879438 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.879025 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mg4gr" event={"ID":"85833fc3-8c9e-41a7-94bc-aba18096e17d","Type":"ContainerStarted","Data":"77a91cf56ea37f6dd2955fa59d2a0ae0a2394880dfd76342ddd9f4701998d057"} Jul 10 14:32:29.900179 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:29.900130 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mg4gr" podStartSLOduration=2.780721795 podStartE2EDuration="3.900110427s" totalImagesPullingTime="1.047455256s" totalInitContainerRuntime="71.933376ms" isStatefulPod=true podCreationTimestamp="2026-07-10 14:32:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:32:29.898362931 +0000 UTC m=+67.976024514" watchObservedRunningTime="2026-07-10 14:32:29.900110427 +0000 UTC m=+67.977771973" Jul 10 14:32:30.606751 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:30.606648 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd"] Jul 10 14:32:30.640416 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:32:30.640387 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb83f2b41_b0c7_4516_a51d_e28730a1de64.slice/crio-db0c61b0f7ba010f7878adbd761acbc81ebcee2e6a1e98676684992a700ad0b0 WatchSource:0}: Error finding container db0c61b0f7ba010f7878adbd761acbc81ebcee2e6a1e98676684992a700ad0b0: Status 404 returned error can't find the container with id db0c61b0f7ba010f7878adbd761acbc81ebcee2e6a1e98676684992a700ad0b0 Jul 10 14:32:30.885062 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:30.884922 2571 generic.go:356] "Generic (PLEG): container finished" podID="e0d7efcd-121d-48e7-82f6-cc405e907258" containerID="c2d8117957d5cc6148025df46617d39187ef062d2549d2773682c5ac60182e81" exitCode=0 Jul 10 14:32:30.885482 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:30.885089 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e0d7efcd-121d-48e7-82f6-cc405e907258","Type":"ContainerDied","Data":"c2d8117957d5cc6148025df46617d39187ef062d2549d2773682c5ac60182e81"} Jul 10 14:32:30.886946 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:30.886917 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" event={"ID":"b83f2b41-b0c7-4516-a51d-e28730a1de64","Type":"ContainerStarted","Data":"db0c61b0f7ba010f7878adbd761acbc81ebcee2e6a1e98676684992a700ad0b0"} Jul 10 14:32:30.889298 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:30.889274 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x4brx" event={"ID":"ea476f2b-59d7-4272-be5c-30a782f21228","Type":"ContainerStarted","Data":"83d1cbf32f12f39393383409b9e3eeeed749389750b53ce4bafc29f7eae67319"} Jul 10 14:32:30.889380 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:30.889328 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-x4brx" event={"ID":"ea476f2b-59d7-4272-be5c-30a782f21228","Type":"ContainerStarted","Data":"d3dac5c9ec540f30c1e1c34b2dea93feba9c6920576cf48bc5ec800d10368156"} Jul 10 14:32:30.900652 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:30.900630 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-jhqqr"] Jul 10 14:32:30.902897 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:30.902849 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jhqqr" Jul 10 14:32:30.905660 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:30.905636 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 10 14:32:30.906212 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:30.906190 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dbd779cbf-gmzpn"] Jul 10 14:32:30.906459 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:30.906443 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-fwhp9\"" Jul 10 14:32:30.920211 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:30.920190 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-jhqqr"] Jul 10 14:32:30.948536 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:30.948511 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c11e10d3-bb73-455b-b57b-3e88b4cc3855-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-jhqqr\" (UID: \"c11e10d3-bb73-455b-b57b-3e88b4cc3855\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jhqqr" Jul 10 14:32:30.948660 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:30.948551 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8fpj\" (UniqueName: \"kubernetes.io/projected/c11e10d3-bb73-455b-b57b-3e88b4cc3855-kube-api-access-n8fpj\") pod \"monitoring-plugin-5f68df7f58-jhqqr\" (UID: \"c11e10d3-bb73-455b-b57b-3e88b4cc3855\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jhqqr" Jul 10 14:32:30.973722 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:30.973672 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-x4brx" podStartSLOduration=66.880725525 podStartE2EDuration="1m8.973640345s" totalImagesPullingTime="2.09291482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:31:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:32:30.973258222 +0000 UTC m=+69.050919768" watchObservedRunningTime="2026-07-10 14:32:30.973640345 +0000 UTC m=+69.051301894" Jul 10 14:32:31.050608 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:31.050569 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c11e10d3-bb73-455b-b57b-3e88b4cc3855-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-jhqqr\" (UID: \"c11e10d3-bb73-455b-b57b-3e88b4cc3855\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jhqqr" Jul 10 14:32:31.050608 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:31.050606 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8fpj\" (UniqueName: \"kubernetes.io/projected/c11e10d3-bb73-455b-b57b-3e88b4cc3855-kube-api-access-n8fpj\") pod \"monitoring-plugin-5f68df7f58-jhqqr\" (UID: \"c11e10d3-bb73-455b-b57b-3e88b4cc3855\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jhqqr" Jul 10 14:32:31.053734 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:31.053689 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c11e10d3-bb73-455b-b57b-3e88b4cc3855-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-jhqqr\" (UID: \"c11e10d3-bb73-455b-b57b-3e88b4cc3855\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jhqqr" Jul 10 14:32:31.058591 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:31.058568 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8fpj\" (UniqueName: \"kubernetes.io/projected/c11e10d3-bb73-455b-b57b-3e88b4cc3855-kube-api-access-n8fpj\") pod \"monitoring-plugin-5f68df7f58-jhqqr\" (UID: \"c11e10d3-bb73-455b-b57b-3e88b4cc3855\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jhqqr" Jul 10 14:32:31.214506 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:31.214474 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jhqqr" Jul 10 14:32:31.362685 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:31.362612 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-jhqqr"] Jul 10 14:32:32.313094 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.313061 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 14:32:32.317955 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.317317 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.320939 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.320902 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 10 14:32:32.322657 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.322632 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 10 14:32:32.322861 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.322845 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 10 14:32:32.323392 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.323374 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 10 14:32:32.323662 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.323646 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 10 14:32:32.323851 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.323835 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 10 14:32:32.324714 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.324056 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 10 14:32:32.324714 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.324331 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 10 14:32:32.324714 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.324384 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 10 14:32:32.324714 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.324524 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bbp1treer3j08\"" Jul 10 14:32:32.324714 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.324578 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 10 14:32:32.325009 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.324739 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 10 14:32:32.325009 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.324866 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tw7v5\"" Jul 10 14:32:32.325009 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.324923 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 10 14:32:32.325161 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.325062 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 10 14:32:32.325161 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.325072 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 10 14:32:32.327253 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.327213 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 10 14:32:32.338106 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.338014 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 14:32:32.361942 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.361854 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c4b49723-ad26-4643-8531-0612a454b10c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.361942 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.361891 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.361942 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.361926 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-config\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.362171 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.362018 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.362171 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.362075 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.362171 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.362104 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.362171 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.362149 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.362360 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.362191 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c4b49723-ad26-4643-8531-0612a454b10c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.362360 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.362229 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.362360 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.362285 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.362360 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.362331 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.362549 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.362372 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.362549 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.362421 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn92b\" (UniqueName: \"kubernetes.io/projected/c4b49723-ad26-4643-8531-0612a454b10c-kube-api-access-gn92b\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.362549 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.362454 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.362549 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.362514 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.362724 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.362550 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.362724 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.362591 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.362724 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.362615 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.362724 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.362651 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c4b49723-ad26-4643-8531-0612a454b10c-config-out\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.363096 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.363069 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-web-config\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.466841 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.466419 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.466841 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.466468 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.466841 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.466496 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.466841 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.466523 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c4b49723-ad26-4643-8531-0612a454b10c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.466841 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.466548 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.466841 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.466580 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.466841 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.466611 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.466841 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.466642 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.466841 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.466667 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn92b\" (UniqueName: \"kubernetes.io/projected/c4b49723-ad26-4643-8531-0612a454b10c-kube-api-access-gn92b\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.466841 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.466691 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.466841 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.466716 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.466841 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.466754 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.466841 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.466781 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.466841 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.466806 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.466841 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.466835 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c4b49723-ad26-4643-8531-0612a454b10c-config-out\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.467583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.466871 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-web-config\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.467583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.466900 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c4b49723-ad26-4643-8531-0612a454b10c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.467583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.466916 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.467583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.466942 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-config\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.467583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.466961 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.467583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.467293 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c4b49723-ad26-4643-8531-0612a454b10c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.467583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.467392 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.467905 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.467708 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.467905 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.467841 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.469310 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.468941 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.470223 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.470203 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.470387 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.470365 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.470547 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.470520 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.470911 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.470885 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c4b49723-ad26-4643-8531-0612a454b10c-config-out\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.471073 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.471053 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.473839 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.473331 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-config\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.473839 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.473799 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.473839 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.473804 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.474066 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.473996 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.474313 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.474292 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.476907 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.476603 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.479160 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.478179 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c4b49723-ad26-4643-8531-0612a454b10c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.479160 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.478993 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-web-config\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.480435 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.480183 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.483776 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.483747 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn92b\" (UniqueName: \"kubernetes.io/projected/c4b49723-ad26-4643-8531-0612a454b10c-kube-api-access-gn92b\") pod \"prometheus-k8s-0\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:32.630806 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:32.630722 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:34.012554 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:32:34.012522 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc11e10d3_bb73_455b_b57b_3e88b4cc3855.slice/crio-00590f03db1cfb636da0ac6cdf24677c9b7d15e548517a7fb90c111dc75e4155 WatchSource:0}: Error finding container 00590f03db1cfb636da0ac6cdf24677c9b7d15e548517a7fb90c111dc75e4155: Status 404 returned error can't find the container with id 00590f03db1cfb636da0ac6cdf24677c9b7d15e548517a7fb90c111dc75e4155 Jul 10 14:32:34.910904 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:34.910876 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jhqqr" event={"ID":"c11e10d3-bb73-455b-b57b-3e88b4cc3855","Type":"ContainerStarted","Data":"00590f03db1cfb636da0ac6cdf24677c9b7d15e548517a7fb90c111dc75e4155"} Jul 10 14:32:35.073570 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:35.073033 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 14:32:35.080665 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:32:35.079244 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4b49723_ad26_4643_8531_0612a454b10c.slice/crio-fb4a50fa15e0b0512f28af7a534be1eae64bc455fceccffc0e73436bde4a96f3 WatchSource:0}: Error finding container fb4a50fa15e0b0512f28af7a534be1eae64bc455fceccffc0e73436bde4a96f3: Status 404 returned error can't find the container with id fb4a50fa15e0b0512f28af7a534be1eae64bc455fceccffc0e73436bde4a96f3 Jul 10 14:32:35.918603 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:35.918567 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vs75x" event={"ID":"81b8479f-42ac-4f15-8e01-1dd667debc38","Type":"ContainerStarted","Data":"a630ae8b4df464a97f869eec17467bd4d24cc0fe6253d996e6b18ab3a4dad03b"} Jul 10 14:32:35.918811 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:35.918681 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:32:35.922570 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:35.922537 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e0d7efcd-121d-48e7-82f6-cc405e907258","Type":"ContainerStarted","Data":"bf7e5ea9898fbffbe0f981c8407a2134304bc6382ff73a7a2fd288f730be0d30"} Jul 10 14:32:35.922735 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:35.922611 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e0d7efcd-121d-48e7-82f6-cc405e907258","Type":"ContainerStarted","Data":"5de74b24e7c971283ae12fae0046d55fcb000753d2f7bd8101eaab18f02b60b6"} Jul 10 14:32:35.922735 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:35.922657 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e0d7efcd-121d-48e7-82f6-cc405e907258","Type":"ContainerStarted","Data":"67f946ceba74f7a2d9966f33e1566e511f00c2716e255ef0b20649517d38d365"} Jul 10 14:32:35.922735 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:35.922700 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e0d7efcd-121d-48e7-82f6-cc405e907258","Type":"ContainerStarted","Data":"b1965fbee40c51cf105c3df32d184cb15c22e1d34f22e121410ba0501855593f"} Jul 10 14:32:35.922880 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:35.922741 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e0d7efcd-121d-48e7-82f6-cc405e907258","Type":"ContainerStarted","Data":"62750998c30cdaed20d79ae3393e41ad7b39937cc78794053051e41ce32a219d"} Jul 10 14:32:35.924618 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:35.924321 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tc6vj" event={"ID":"031289f7-f9ec-407f-8fa5-98afbc1755a3","Type":"ContainerStarted","Data":"b3d3e2e8741bce396baf0a289b46c6dbe2b6eeacf9b95ac4d22e9d02de374a3f"} Jul 10 14:32:35.926817 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:35.926791 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" event={"ID":"b83f2b41-b0c7-4516-a51d-e28730a1de64","Type":"ContainerStarted","Data":"51a361a4056466f6fb3c78cf89feff9fae2a12e32bef921c6d3c5e7b9752a676"} Jul 10 14:32:35.926928 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:35.926858 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" event={"ID":"b83f2b41-b0c7-4516-a51d-e28730a1de64","Type":"ContainerStarted","Data":"5834411ba6e3ac4651cdbf5a677d30749d2a0a53eb29f787814da938b383a4dd"} Jul 10 14:32:35.926928 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:35.926900 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" event={"ID":"b83f2b41-b0c7-4516-a51d-e28730a1de64","Type":"ContainerStarted","Data":"4d7ca084306b1a4697b9ac3877891e220ae63de45585a8115482c4a05901bb0d"} Jul 10 14:32:35.928579 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:35.928540 2571 generic.go:356] "Generic (PLEG): container finished" podID="c4b49723-ad26-4643-8531-0612a454b10c" containerID="d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83" exitCode=0 Jul 10 14:32:35.928579 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:35.928571 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4b49723-ad26-4643-8531-0612a454b10c","Type":"ContainerDied","Data":"d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83"} Jul 10 14:32:35.928747 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:35.928640 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4b49723-ad26-4643-8531-0612a454b10c","Type":"ContainerStarted","Data":"fb4a50fa15e0b0512f28af7a534be1eae64bc455fceccffc0e73436bde4a96f3"} Jul 10 14:32:35.935059 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:35.935003 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vs75x" podStartSLOduration=67.673095445 podStartE2EDuration="1m13.934961778s" totalImagesPullingTime="6.261866333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:31:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:32:35.9333543 +0000 UTC m=+74.011015848" watchObservedRunningTime="2026-07-10 14:32:35.934961778 +0000 UTC m=+74.012623302" Jul 10 14:32:35.948029 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:35.947578 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tc6vj" podStartSLOduration=67.368512872 podStartE2EDuration="1m13.94756409s" totalImagesPullingTime="6.579051218s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 14:31:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:32:35.946935374 +0000 UTC m=+74.024596928" watchObservedRunningTime="2026-07-10 14:32:35.94756409 +0000 UTC m=+74.025225635" Jul 10 14:32:36.936339 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:36.936207 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e0d7efcd-121d-48e7-82f6-cc405e907258","Type":"ContainerStarted","Data":"4bc8e2d65d5b407b4804297c6d484057dfd50128baddb1607ed2a49903ddc137"} Jul 10 14:32:36.937871 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:36.937841 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jhqqr" event={"ID":"c11e10d3-bb73-455b-b57b-3e88b4cc3855","Type":"ContainerStarted","Data":"d76eba2639908250e0f1ef78a340eafc4910541e7ff2b7fea1b0d15384e612ff"} Jul 10 14:32:36.938017 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:36.938003 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jhqqr" Jul 10 14:32:36.941632 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:36.941607 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" event={"ID":"b83f2b41-b0c7-4516-a51d-e28730a1de64","Type":"ContainerStarted","Data":"1de6dc8b9db8dbf8c642227b2a1ca8d95d69f55d2917a03d6e4ecefaccd59a2b"} Jul 10 14:32:36.941796 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:36.941673 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" event={"ID":"b83f2b41-b0c7-4516-a51d-e28730a1de64","Type":"ContainerStarted","Data":"9fe79958fd1f770bfaad61c1e43ec6fafd80423f469f025a68391d9fc94f07ae"} Jul 10 14:32:36.941796 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:36.941715 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" event={"ID":"b83f2b41-b0c7-4516-a51d-e28730a1de64","Type":"ContainerStarted","Data":"b0288fe90574eeb5ff529716efea15d5e27904703c504e0bb930177dff24e9ce"} Jul 10 14:32:36.943618 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:36.943593 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jhqqr" Jul 10 14:32:36.977303 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:36.977262 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.863466663 podStartE2EDuration="9.97724829s" totalImagesPullingTime="7.090475464s" totalInitContainerRuntime="23.306163ms" isStatefulPod=false podCreationTimestamp="2026-07-10 14:32:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:32:36.976614149 +0000 UTC m=+75.054275721" watchObservedRunningTime="2026-07-10 14:32:36.97724829 +0000 UTC m=+75.054909834" Jul 10 14:32:37.015472 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:37.015404 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" podStartSLOduration=2.7174015540000003 podStartE2EDuration="8.01538753s" totalImagesPullingTime="5.297985976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:32:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:32:37.014665342 +0000 UTC m=+75.092326887" watchObservedRunningTime="2026-07-10 14:32:37.01538753 +0000 UTC m=+75.093049094" Jul 10 14:32:37.044447 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:37.044385 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-jhqqr" podStartSLOduration=4.851666339 podStartE2EDuration="7.044362948s" totalImagesPullingTime="2.192696609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:32:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:32:37.042818369 +0000 UTC m=+75.120479917" watchObservedRunningTime="2026-07-10 14:32:37.044362948 +0000 UTC m=+75.122024502" Jul 10 14:32:37.947019 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:37.946987 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" Jul 10 14:32:39.958365 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:39.958334 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4b49723-ad26-4643-8531-0612a454b10c","Type":"ContainerStarted","Data":"eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43"} Jul 10 14:32:40.964845 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:40.964812 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4b49723-ad26-4643-8531-0612a454b10c","Type":"ContainerStarted","Data":"0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848"} Jul 10 14:32:40.965232 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:40.964874 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4b49723-ad26-4643-8531-0612a454b10c","Type":"ContainerStarted","Data":"204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337"} Jul 10 14:32:40.965232 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:40.964900 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4b49723-ad26-4643-8531-0612a454b10c","Type":"ContainerStarted","Data":"50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9"} Jul 10 14:32:40.965232 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:40.964925 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4b49723-ad26-4643-8531-0612a454b10c","Type":"ContainerStarted","Data":"09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca"} Jul 10 14:32:40.965232 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:40.964950 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4b49723-ad26-4643-8531-0612a454b10c","Type":"ContainerStarted","Data":"a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6"} Jul 10 14:32:40.995282 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:40.995232 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=5.02376533 podStartE2EDuration="8.995217473s" totalImagesPullingTime="3.941120471s" totalInitContainerRuntime="30.331672ms" isStatefulPod=false podCreationTimestamp="2026-07-10 14:32:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:32:40.993742076 +0000 UTC m=+79.071403636" watchObservedRunningTime="2026-07-10 14:32:40.995217473 +0000 UTC m=+79.072879019" Jul 10 14:32:42.631830 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:42.631783 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:32:43.960160 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:43.960057 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6c6d66b8b7-t7dsd" Jul 10 14:32:55.934818 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:55.934775 2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5dbd779cbf-gmzpn" podUID="8564e38c-6574-457e-88d5-f07579c4ce3a" containerName="console" containerID="cri-o://f523e81ec193f640171a2bd2ed88cbd976341a354e892bf95bd5b4146b4e6a20" gracePeriod=15 Jul 10 14:32:56.750405 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:56.750381 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dbd779cbf-gmzpn" Jul 10 14:32:56.874549 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:56.874452 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8564e38c-6574-457e-88d5-f07579c4ce3a-oauth-serving-cert\") pod \"8564e38c-6574-457e-88d5-f07579c4ce3a\" (UID: \"8564e38c-6574-457e-88d5-f07579c4ce3a\") " Jul 10 14:32:56.874703 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:56.874553 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8564e38c-6574-457e-88d5-f07579c4ce3a-console-config\") pod \"8564e38c-6574-457e-88d5-f07579c4ce3a\" (UID: \"8564e38c-6574-457e-88d5-f07579c4ce3a\") " Jul 10 14:32:56.874703 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:56.874596 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8564e38c-6574-457e-88d5-f07579c4ce3a-console-oauth-config\") pod \"8564e38c-6574-457e-88d5-f07579c4ce3a\" (UID: \"8564e38c-6574-457e-88d5-f07579c4ce3a\") " Jul 10 14:32:56.874703 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:56.874652 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84xhr\" (UniqueName: \"kubernetes.io/projected/8564e38c-6574-457e-88d5-f07579c4ce3a-kube-api-access-84xhr\") pod \"8564e38c-6574-457e-88d5-f07579c4ce3a\" (UID: \"8564e38c-6574-457e-88d5-f07579c4ce3a\") " Jul 10 14:32:56.874861 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:56.874706 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8564e38c-6574-457e-88d5-f07579c4ce3a-console-serving-cert\") pod \"8564e38c-6574-457e-88d5-f07579c4ce3a\" (UID: \"8564e38c-6574-457e-88d5-f07579c4ce3a\") " Jul 10 14:32:56.874861 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:56.874768 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8564e38c-6574-457e-88d5-f07579c4ce3a-service-ca\") pod \"8564e38c-6574-457e-88d5-f07579c4ce3a\" (UID: \"8564e38c-6574-457e-88d5-f07579c4ce3a\") " Jul 10 14:32:56.875066 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:56.875027 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8564e38c-6574-457e-88d5-f07579c4ce3a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8564e38c-6574-457e-88d5-f07579c4ce3a" (UID: "8564e38c-6574-457e-88d5-f07579c4ce3a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:32:56.875196 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:56.875061 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8564e38c-6574-457e-88d5-f07579c4ce3a-console-config" (OuterVolumeSpecName: "console-config") pod "8564e38c-6574-457e-88d5-f07579c4ce3a" (UID: "8564e38c-6574-457e-88d5-f07579c4ce3a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:32:56.875268 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:56.875253 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8564e38c-6574-457e-88d5-f07579c4ce3a-service-ca" (OuterVolumeSpecName: "service-ca") pod "8564e38c-6574-457e-88d5-f07579c4ce3a" (UID: "8564e38c-6574-457e-88d5-f07579c4ce3a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:32:56.877012 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:56.876984 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8564e38c-6574-457e-88d5-f07579c4ce3a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8564e38c-6574-457e-88d5-f07579c4ce3a" (UID: "8564e38c-6574-457e-88d5-f07579c4ce3a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:32:56.877115 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:56.877041 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8564e38c-6574-457e-88d5-f07579c4ce3a-kube-api-access-84xhr" (OuterVolumeSpecName: "kube-api-access-84xhr") pod "8564e38c-6574-457e-88d5-f07579c4ce3a" (UID: "8564e38c-6574-457e-88d5-f07579c4ce3a"). InnerVolumeSpecName "kube-api-access-84xhr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:32:56.877115 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:56.877052 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8564e38c-6574-457e-88d5-f07579c4ce3a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8564e38c-6574-457e-88d5-f07579c4ce3a" (UID: "8564e38c-6574-457e-88d5-f07579c4ce3a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:32:56.976288 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:56.976260 2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8564e38c-6574-457e-88d5-f07579c4ce3a-console-oauth-config\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:32:56.976288 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:56.976283 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84xhr\" (UniqueName: \"kubernetes.io/projected/8564e38c-6574-457e-88d5-f07579c4ce3a-kube-api-access-84xhr\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:32:56.976288 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:56.976293 2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8564e38c-6574-457e-88d5-f07579c4ce3a-console-serving-cert\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:32:56.976652 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:56.976302 2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8564e38c-6574-457e-88d5-f07579c4ce3a-service-ca\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:32:56.976652 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:56.976311 2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8564e38c-6574-457e-88d5-f07579c4ce3a-oauth-serving-cert\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:32:56.976652 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:56.976319 2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8564e38c-6574-457e-88d5-f07579c4ce3a-console-config\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:32:57.026284 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:57.026251 2571 generic.go:356] "Generic (PLEG): container finished" podID="8564e38c-6574-457e-88d5-f07579c4ce3a" containerID="f523e81ec193f640171a2bd2ed88cbd976341a354e892bf95bd5b4146b4e6a20" exitCode=0 Jul 10 14:32:57.026400 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:57.026298 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dbd779cbf-gmzpn" event={"ID":"8564e38c-6574-457e-88d5-f07579c4ce3a","Type":"ContainerDied","Data":"f523e81ec193f640171a2bd2ed88cbd976341a354e892bf95bd5b4146b4e6a20"} Jul 10 14:32:57.026400 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:57.026307 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dbd779cbf-gmzpn" Jul 10 14:32:57.026400 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:57.026367 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dbd779cbf-gmzpn" event={"ID":"8564e38c-6574-457e-88d5-f07579c4ce3a","Type":"ContainerDied","Data":"bedf7602f7c46e4bc04ef45b7708ce3e7a6a882b32247aa96534c2a3b80e2dd8"} Jul 10 14:32:57.026400 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:57.026387 2571 scope.go:117] "RemoveContainer" containerID="f523e81ec193f640171a2bd2ed88cbd976341a354e892bf95bd5b4146b4e6a20" Jul 10 14:32:57.043086 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:57.043067 2571 scope.go:117] "RemoveContainer" containerID="f523e81ec193f640171a2bd2ed88cbd976341a354e892bf95bd5b4146b4e6a20" Jul 10 14:32:57.043342 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:32:57.043325 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f523e81ec193f640171a2bd2ed88cbd976341a354e892bf95bd5b4146b4e6a20\": container with ID starting with f523e81ec193f640171a2bd2ed88cbd976341a354e892bf95bd5b4146b4e6a20 not found: ID does not exist" containerID="f523e81ec193f640171a2bd2ed88cbd976341a354e892bf95bd5b4146b4e6a20" Jul 10 14:32:57.043387 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:57.043350 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f523e81ec193f640171a2bd2ed88cbd976341a354e892bf95bd5b4146b4e6a20"} err="failed to get container status \"f523e81ec193f640171a2bd2ed88cbd976341a354e892bf95bd5b4146b4e6a20\": rpc error: code = NotFound desc = could not find container \"f523e81ec193f640171a2bd2ed88cbd976341a354e892bf95bd5b4146b4e6a20\": container with ID starting with f523e81ec193f640171a2bd2ed88cbd976341a354e892bf95bd5b4146b4e6a20 not found: ID does not exist" Jul 10 14:32:57.049542 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:57.049521 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dbd779cbf-gmzpn"] Jul 10 14:32:57.053761 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:57.053741 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5dbd779cbf-gmzpn"] Jul 10 14:32:58.461364 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:32:58.461332 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8564e38c-6574-457e-88d5-f07579c4ce3a" path="/var/lib/kubelet/pods/8564e38c-6574-457e-88d5-f07579c4ce3a/volumes" Jul 10 14:33:06.944120 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:06.944091 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vs75x" Jul 10 14:33:32.630882 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:32.630840 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:32.650274 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:32.650251 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:33.180209 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:33.180184 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:46.328430 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:46.328395 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 14:33:46.328860 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:46.328792 2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e0d7efcd-121d-48e7-82f6-cc405e907258" containerName="alertmanager" containerID="cri-o://62750998c30cdaed20d79ae3393e41ad7b39937cc78794053051e41ce32a219d" gracePeriod=120 Jul 10 14:33:46.328999 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:46.328851 2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e0d7efcd-121d-48e7-82f6-cc405e907258" containerName="kube-rbac-proxy-metric" containerID="cri-o://bf7e5ea9898fbffbe0f981c8407a2134304bc6382ff73a7a2fd288f730be0d30" gracePeriod=120 Jul 10 14:33:46.328999 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:46.328880 2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e0d7efcd-121d-48e7-82f6-cc405e907258" containerName="kube-rbac-proxy-web" containerID="cri-o://67f946ceba74f7a2d9966f33e1566e511f00c2716e255ef0b20649517d38d365" gracePeriod=120 Jul 10 14:33:46.328999 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:46.328902 2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e0d7efcd-121d-48e7-82f6-cc405e907258" containerName="prom-label-proxy" containerID="cri-o://4bc8e2d65d5b407b4804297c6d484057dfd50128baddb1607ed2a49903ddc137" gracePeriod=120 Jul 10 14:33:46.328999 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:46.328914 2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e0d7efcd-121d-48e7-82f6-cc405e907258" containerName="kube-rbac-proxy" containerID="cri-o://5de74b24e7c971283ae12fae0046d55fcb000753d2f7bd8101eaab18f02b60b6" gracePeriod=120 Jul 10 14:33:46.329190 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:46.329034 2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e0d7efcd-121d-48e7-82f6-cc405e907258" containerName="config-reloader" containerID="cri-o://b1965fbee40c51cf105c3df32d184cb15c22e1d34f22e121410ba0501855593f" gracePeriod=120 Jul 10 14:33:47.223153 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.223122 2571 generic.go:356] "Generic (PLEG): container finished" podID="e0d7efcd-121d-48e7-82f6-cc405e907258" containerID="4bc8e2d65d5b407b4804297c6d484057dfd50128baddb1607ed2a49903ddc137" exitCode=0 Jul 10 14:33:47.223153 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.223145 2571 generic.go:356] "Generic (PLEG): container finished" podID="e0d7efcd-121d-48e7-82f6-cc405e907258" containerID="bf7e5ea9898fbffbe0f981c8407a2134304bc6382ff73a7a2fd288f730be0d30" exitCode=0 Jul 10 14:33:47.223153 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.223153 2571 generic.go:356] "Generic (PLEG): container finished" podID="e0d7efcd-121d-48e7-82f6-cc405e907258" containerID="5de74b24e7c971283ae12fae0046d55fcb000753d2f7bd8101eaab18f02b60b6" exitCode=0 Jul 10 14:33:47.223384 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.223163 2571 generic.go:356] "Generic (PLEG): container finished" podID="e0d7efcd-121d-48e7-82f6-cc405e907258" containerID="b1965fbee40c51cf105c3df32d184cb15c22e1d34f22e121410ba0501855593f" exitCode=0 Jul 10 14:33:47.223384 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.223170 2571 generic.go:356] "Generic (PLEG): container finished" podID="e0d7efcd-121d-48e7-82f6-cc405e907258" containerID="62750998c30cdaed20d79ae3393e41ad7b39937cc78794053051e41ce32a219d" exitCode=0 Jul 10 14:33:47.223384 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.223206 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e0d7efcd-121d-48e7-82f6-cc405e907258","Type":"ContainerDied","Data":"4bc8e2d65d5b407b4804297c6d484057dfd50128baddb1607ed2a49903ddc137"} Jul 10 14:33:47.223384 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.223270 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e0d7efcd-121d-48e7-82f6-cc405e907258","Type":"ContainerDied","Data":"bf7e5ea9898fbffbe0f981c8407a2134304bc6382ff73a7a2fd288f730be0d30"} Jul 10 14:33:47.223384 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.223296 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e0d7efcd-121d-48e7-82f6-cc405e907258","Type":"ContainerDied","Data":"5de74b24e7c971283ae12fae0046d55fcb000753d2f7bd8101eaab18f02b60b6"} Jul 10 14:33:47.223384 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.223321 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e0d7efcd-121d-48e7-82f6-cc405e907258","Type":"ContainerDied","Data":"b1965fbee40c51cf105c3df32d184cb15c22e1d34f22e121410ba0501855593f"} Jul 10 14:33:47.223384 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.223346 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e0d7efcd-121d-48e7-82f6-cc405e907258","Type":"ContainerDied","Data":"62750998c30cdaed20d79ae3393e41ad7b39937cc78794053051e41ce32a219d"} Jul 10 14:33:47.576880 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.576860 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:47.643407 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.643380 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0d7efcd-121d-48e7-82f6-cc405e907258-alertmanager-trusted-ca-bundle\") pod \"e0d7efcd-121d-48e7-82f6-cc405e907258\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " Jul 10 14:33:47.643577 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.643414 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-cluster-tls-config\") pod \"e0d7efcd-121d-48e7-82f6-cc405e907258\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " Jul 10 14:33:47.643577 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.643455 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-web-config\") pod \"e0d7efcd-121d-48e7-82f6-cc405e907258\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " Jul 10 14:33:47.643577 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.643488 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0d7efcd-121d-48e7-82f6-cc405e907258-metrics-client-ca\") pod \"e0d7efcd-121d-48e7-82f6-cc405e907258\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " Jul 10 14:33:47.643577 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.643521 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e0d7efcd-121d-48e7-82f6-cc405e907258-alertmanager-main-db\") pod \"e0d7efcd-121d-48e7-82f6-cc405e907258\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " Jul 10 14:33:47.643577 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.643545 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-config-volume\") pod \"e0d7efcd-121d-48e7-82f6-cc405e907258\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " Jul 10 14:33:47.643840 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.643582 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-secret-alertmanager-kube-rbac-proxy\") pod \"e0d7efcd-121d-48e7-82f6-cc405e907258\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " Jul 10 14:33:47.643840 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.643623 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-secret-alertmanager-kube-rbac-proxy-metric\") pod \"e0d7efcd-121d-48e7-82f6-cc405e907258\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " Jul 10 14:33:47.643840 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.643677 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kk52c\" (UniqueName: \"kubernetes.io/projected/e0d7efcd-121d-48e7-82f6-cc405e907258-kube-api-access-kk52c\") pod \"e0d7efcd-121d-48e7-82f6-cc405e907258\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " Jul 10 14:33:47.643840 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.643711 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-secret-alertmanager-kube-rbac-proxy-web\") pod \"e0d7efcd-121d-48e7-82f6-cc405e907258\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " Jul 10 14:33:47.643840 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.643749 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e0d7efcd-121d-48e7-82f6-cc405e907258-tls-assets\") pod \"e0d7efcd-121d-48e7-82f6-cc405e907258\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " Jul 10 14:33:47.643840 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.643785 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e0d7efcd-121d-48e7-82f6-cc405e907258-config-out\") pod \"e0d7efcd-121d-48e7-82f6-cc405e907258\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " Jul 10 14:33:47.643840 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.643800 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0d7efcd-121d-48e7-82f6-cc405e907258-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "e0d7efcd-121d-48e7-82f6-cc405e907258" (UID: "e0d7efcd-121d-48e7-82f6-cc405e907258"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:33:47.643840 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.643810 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-secret-alertmanager-main-tls\") pod \"e0d7efcd-121d-48e7-82f6-cc405e907258\" (UID: \"e0d7efcd-121d-48e7-82f6-cc405e907258\") " Jul 10 14:33:47.644275 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.644058 2571 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0d7efcd-121d-48e7-82f6-cc405e907258-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:33:47.644384 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.644356 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0d7efcd-121d-48e7-82f6-cc405e907258-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "e0d7efcd-121d-48e7-82f6-cc405e907258" (UID: "e0d7efcd-121d-48e7-82f6-cc405e907258"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:33:47.644800 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.644769 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0d7efcd-121d-48e7-82f6-cc405e907258-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "e0d7efcd-121d-48e7-82f6-cc405e907258" (UID: "e0d7efcd-121d-48e7-82f6-cc405e907258"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:33:47.648581 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.648547 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "e0d7efcd-121d-48e7-82f6-cc405e907258" (UID: "e0d7efcd-121d-48e7-82f6-cc405e907258"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:33:47.648692 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.648577 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "e0d7efcd-121d-48e7-82f6-cc405e907258" (UID: "e0d7efcd-121d-48e7-82f6-cc405e907258"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:33:47.649335 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.649298 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "e0d7efcd-121d-48e7-82f6-cc405e907258" (UID: "e0d7efcd-121d-48e7-82f6-cc405e907258"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:33:47.649440 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.649340 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0d7efcd-121d-48e7-82f6-cc405e907258-config-out" (OuterVolumeSpecName: "config-out") pod "e0d7efcd-121d-48e7-82f6-cc405e907258" (UID: "e0d7efcd-121d-48e7-82f6-cc405e907258"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:33:47.649440 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.649421 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-config-volume" (OuterVolumeSpecName: "config-volume") pod "e0d7efcd-121d-48e7-82f6-cc405e907258" (UID: "e0d7efcd-121d-48e7-82f6-cc405e907258"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:33:47.649733 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.649708 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "e0d7efcd-121d-48e7-82f6-cc405e907258" (UID: "e0d7efcd-121d-48e7-82f6-cc405e907258"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:33:47.649878 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.649842 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0d7efcd-121d-48e7-82f6-cc405e907258-kube-api-access-kk52c" (OuterVolumeSpecName: "kube-api-access-kk52c") pod "e0d7efcd-121d-48e7-82f6-cc405e907258" (UID: "e0d7efcd-121d-48e7-82f6-cc405e907258"). InnerVolumeSpecName "kube-api-access-kk52c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:33:47.650431 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.650406 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0d7efcd-121d-48e7-82f6-cc405e907258-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e0d7efcd-121d-48e7-82f6-cc405e907258" (UID: "e0d7efcd-121d-48e7-82f6-cc405e907258"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:33:47.651830 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.651812 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "e0d7efcd-121d-48e7-82f6-cc405e907258" (UID: "e0d7efcd-121d-48e7-82f6-cc405e907258"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:33:47.658099 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.658078 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-web-config" (OuterVolumeSpecName: "web-config") pod "e0d7efcd-121d-48e7-82f6-cc405e907258" (UID: "e0d7efcd-121d-48e7-82f6-cc405e907258"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:33:47.744678 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.744618 2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:33:47.744678 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.744642 2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:33:47.744678 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.744651 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kk52c\" (UniqueName: \"kubernetes.io/projected/e0d7efcd-121d-48e7-82f6-cc405e907258-kube-api-access-kk52c\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:33:47.744678 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.744660 2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:33:47.744678 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.744670 2571 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e0d7efcd-121d-48e7-82f6-cc405e907258-tls-assets\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:33:47.744678 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.744678 2571 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e0d7efcd-121d-48e7-82f6-cc405e907258-config-out\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:33:47.744915 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.744685 2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-secret-alertmanager-main-tls\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:33:47.744915 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.744693 2571 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-cluster-tls-config\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:33:47.744915 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.744702 2571 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-web-config\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:33:47.744915 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.744712 2571 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e0d7efcd-121d-48e7-82f6-cc405e907258-metrics-client-ca\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:33:47.744915 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.744720 2571 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e0d7efcd-121d-48e7-82f6-cc405e907258-alertmanager-main-db\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:33:47.744915 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:47.744728 2571 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e0d7efcd-121d-48e7-82f6-cc405e907258-config-volume\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:33:48.231628 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.231595 2571 generic.go:356] "Generic (PLEG): container finished" podID="e0d7efcd-121d-48e7-82f6-cc405e907258" containerID="67f946ceba74f7a2d9966f33e1566e511f00c2716e255ef0b20649517d38d365" exitCode=0 Jul 10 14:33:48.231786 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.231640 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e0d7efcd-121d-48e7-82f6-cc405e907258","Type":"ContainerDied","Data":"67f946ceba74f7a2d9966f33e1566e511f00c2716e255ef0b20649517d38d365"} Jul 10 14:33:48.231786 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.231687 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.231786 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.231729 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e0d7efcd-121d-48e7-82f6-cc405e907258","Type":"ContainerDied","Data":"cd504ac81b15c3580c51acaab91ffc1ff3ca01c08c1d80dbd10a0159e268be19"} Jul 10 14:33:48.231786 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.231764 2571 scope.go:117] "RemoveContainer" containerID="4bc8e2d65d5b407b4804297c6d484057dfd50128baddb1607ed2a49903ddc137" Jul 10 14:33:48.238924 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.238908 2571 scope.go:117] "RemoveContainer" containerID="bf7e5ea9898fbffbe0f981c8407a2134304bc6382ff73a7a2fd288f730be0d30" Jul 10 14:33:48.245705 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.245688 2571 scope.go:117] "RemoveContainer" containerID="5de74b24e7c971283ae12fae0046d55fcb000753d2f7bd8101eaab18f02b60b6" Jul 10 14:33:48.251908 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.251890 2571 scope.go:117] "RemoveContainer" containerID="67f946ceba74f7a2d9966f33e1566e511f00c2716e255ef0b20649517d38d365" Jul 10 14:33:48.255418 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.255399 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 14:33:48.259208 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.259170 2571 scope.go:117] "RemoveContainer" containerID="b1965fbee40c51cf105c3df32d184cb15c22e1d34f22e121410ba0501855593f" Jul 10 14:33:48.261874 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.261855 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 14:33:48.266232 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.266218 2571 scope.go:117] "RemoveContainer" containerID="62750998c30cdaed20d79ae3393e41ad7b39937cc78794053051e41ce32a219d" Jul 10 14:33:48.272482 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.272466 2571 scope.go:117] "RemoveContainer" containerID="c2d8117957d5cc6148025df46617d39187ef062d2549d2773682c5ac60182e81" Jul 10 14:33:48.279443 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.279427 2571 scope.go:117] "RemoveContainer" containerID="4bc8e2d65d5b407b4804297c6d484057dfd50128baddb1607ed2a49903ddc137" Jul 10 14:33:48.279689 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:33:48.279673 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bc8e2d65d5b407b4804297c6d484057dfd50128baddb1607ed2a49903ddc137\": container with ID starting with 4bc8e2d65d5b407b4804297c6d484057dfd50128baddb1607ed2a49903ddc137 not found: ID does not exist" containerID="4bc8e2d65d5b407b4804297c6d484057dfd50128baddb1607ed2a49903ddc137" Jul 10 14:33:48.279731 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.279696 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bc8e2d65d5b407b4804297c6d484057dfd50128baddb1607ed2a49903ddc137"} err="failed to get container status \"4bc8e2d65d5b407b4804297c6d484057dfd50128baddb1607ed2a49903ddc137\": rpc error: code = NotFound desc = could not find container \"4bc8e2d65d5b407b4804297c6d484057dfd50128baddb1607ed2a49903ddc137\": container with ID starting with 4bc8e2d65d5b407b4804297c6d484057dfd50128baddb1607ed2a49903ddc137 not found: ID does not exist" Jul 10 14:33:48.279731 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.279712 2571 scope.go:117] "RemoveContainer" containerID="bf7e5ea9898fbffbe0f981c8407a2134304bc6382ff73a7a2fd288f730be0d30" Jul 10 14:33:48.279931 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:33:48.279912 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf7e5ea9898fbffbe0f981c8407a2134304bc6382ff73a7a2fd288f730be0d30\": container with ID starting with bf7e5ea9898fbffbe0f981c8407a2134304bc6382ff73a7a2fd288f730be0d30 not found: ID does not exist" containerID="bf7e5ea9898fbffbe0f981c8407a2134304bc6382ff73a7a2fd288f730be0d30" Jul 10 14:33:48.280023 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.279940 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf7e5ea9898fbffbe0f981c8407a2134304bc6382ff73a7a2fd288f730be0d30"} err="failed to get container status \"bf7e5ea9898fbffbe0f981c8407a2134304bc6382ff73a7a2fd288f730be0d30\": rpc error: code = NotFound desc = could not find container \"bf7e5ea9898fbffbe0f981c8407a2134304bc6382ff73a7a2fd288f730be0d30\": container with ID starting with bf7e5ea9898fbffbe0f981c8407a2134304bc6382ff73a7a2fd288f730be0d30 not found: ID does not exist" Jul 10 14:33:48.280023 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.279983 2571 scope.go:117] "RemoveContainer" containerID="5de74b24e7c971283ae12fae0046d55fcb000753d2f7bd8101eaab18f02b60b6" Jul 10 14:33:48.280229 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:33:48.280208 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5de74b24e7c971283ae12fae0046d55fcb000753d2f7bd8101eaab18f02b60b6\": container with ID starting with 5de74b24e7c971283ae12fae0046d55fcb000753d2f7bd8101eaab18f02b60b6 not found: ID does not exist" containerID="5de74b24e7c971283ae12fae0046d55fcb000753d2f7bd8101eaab18f02b60b6" Jul 10 14:33:48.280329 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.280230 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5de74b24e7c971283ae12fae0046d55fcb000753d2f7bd8101eaab18f02b60b6"} err="failed to get container status \"5de74b24e7c971283ae12fae0046d55fcb000753d2f7bd8101eaab18f02b60b6\": rpc error: code = NotFound desc = could not find container \"5de74b24e7c971283ae12fae0046d55fcb000753d2f7bd8101eaab18f02b60b6\": container with ID starting with 5de74b24e7c971283ae12fae0046d55fcb000753d2f7bd8101eaab18f02b60b6 not found: ID does not exist" Jul 10 14:33:48.280329 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.280243 2571 scope.go:117] "RemoveContainer" containerID="67f946ceba74f7a2d9966f33e1566e511f00c2716e255ef0b20649517d38d365" Jul 10 14:33:48.280491 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:33:48.280475 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67f946ceba74f7a2d9966f33e1566e511f00c2716e255ef0b20649517d38d365\": container with ID starting with 67f946ceba74f7a2d9966f33e1566e511f00c2716e255ef0b20649517d38d365 not found: ID does not exist" containerID="67f946ceba74f7a2d9966f33e1566e511f00c2716e255ef0b20649517d38d365" Jul 10 14:33:48.280532 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.280495 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67f946ceba74f7a2d9966f33e1566e511f00c2716e255ef0b20649517d38d365"} err="failed to get container status \"67f946ceba74f7a2d9966f33e1566e511f00c2716e255ef0b20649517d38d365\": rpc error: code = NotFound desc = could not find container \"67f946ceba74f7a2d9966f33e1566e511f00c2716e255ef0b20649517d38d365\": container with ID starting with 67f946ceba74f7a2d9966f33e1566e511f00c2716e255ef0b20649517d38d365 not found: ID does not exist" Jul 10 14:33:48.280532 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.280509 2571 scope.go:117] "RemoveContainer" containerID="b1965fbee40c51cf105c3df32d184cb15c22e1d34f22e121410ba0501855593f" Jul 10 14:33:48.280714 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:33:48.280701 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1965fbee40c51cf105c3df32d184cb15c22e1d34f22e121410ba0501855593f\": container with ID starting with b1965fbee40c51cf105c3df32d184cb15c22e1d34f22e121410ba0501855593f not found: ID does not exist" containerID="b1965fbee40c51cf105c3df32d184cb15c22e1d34f22e121410ba0501855593f" Jul 10 14:33:48.280760 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.280718 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1965fbee40c51cf105c3df32d184cb15c22e1d34f22e121410ba0501855593f"} err="failed to get container status \"b1965fbee40c51cf105c3df32d184cb15c22e1d34f22e121410ba0501855593f\": rpc error: code = NotFound desc = could not find container \"b1965fbee40c51cf105c3df32d184cb15c22e1d34f22e121410ba0501855593f\": container with ID starting with b1965fbee40c51cf105c3df32d184cb15c22e1d34f22e121410ba0501855593f not found: ID does not exist" Jul 10 14:33:48.280760 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.280732 2571 scope.go:117] "RemoveContainer" containerID="62750998c30cdaed20d79ae3393e41ad7b39937cc78794053051e41ce32a219d" Jul 10 14:33:48.280957 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:33:48.280940 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62750998c30cdaed20d79ae3393e41ad7b39937cc78794053051e41ce32a219d\": container with ID starting with 62750998c30cdaed20d79ae3393e41ad7b39937cc78794053051e41ce32a219d not found: ID does not exist" containerID="62750998c30cdaed20d79ae3393e41ad7b39937cc78794053051e41ce32a219d" Jul 10 14:33:48.281023 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.280962 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62750998c30cdaed20d79ae3393e41ad7b39937cc78794053051e41ce32a219d"} err="failed to get container status \"62750998c30cdaed20d79ae3393e41ad7b39937cc78794053051e41ce32a219d\": rpc error: code = NotFound desc = could not find container \"62750998c30cdaed20d79ae3393e41ad7b39937cc78794053051e41ce32a219d\": container with ID starting with 62750998c30cdaed20d79ae3393e41ad7b39937cc78794053051e41ce32a219d not found: ID does not exist" Jul 10 14:33:48.281023 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.280992 2571 scope.go:117] "RemoveContainer" containerID="c2d8117957d5cc6148025df46617d39187ef062d2549d2773682c5ac60182e81" Jul 10 14:33:48.281218 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:33:48.281203 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2d8117957d5cc6148025df46617d39187ef062d2549d2773682c5ac60182e81\": container with ID starting with c2d8117957d5cc6148025df46617d39187ef062d2549d2773682c5ac60182e81 not found: ID does not exist" containerID="c2d8117957d5cc6148025df46617d39187ef062d2549d2773682c5ac60182e81" Jul 10 14:33:48.281256 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.281221 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2d8117957d5cc6148025df46617d39187ef062d2549d2773682c5ac60182e81"} err="failed to get container status \"c2d8117957d5cc6148025df46617d39187ef062d2549d2773682c5ac60182e81\": rpc error: code = NotFound desc = could not find container \"c2d8117957d5cc6148025df46617d39187ef062d2549d2773682c5ac60182e81\": container with ID starting with c2d8117957d5cc6148025df46617d39187ef062d2549d2773682c5ac60182e81 not found: ID does not exist" Jul 10 14:33:48.290077 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.290054 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 14:33:48.290348 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.290335 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0d7efcd-121d-48e7-82f6-cc405e907258" containerName="alertmanager" Jul 10 14:33:48.290400 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.290350 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0d7efcd-121d-48e7-82f6-cc405e907258" containerName="alertmanager" Jul 10 14:33:48.290400 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.290362 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0d7efcd-121d-48e7-82f6-cc405e907258" containerName="config-reloader" Jul 10 14:33:48.290400 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.290371 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0d7efcd-121d-48e7-82f6-cc405e907258" containerName="config-reloader" Jul 10 14:33:48.290400 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.290381 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0d7efcd-121d-48e7-82f6-cc405e907258" containerName="init-config-reloader" Jul 10 14:33:48.290400 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.290388 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0d7efcd-121d-48e7-82f6-cc405e907258" containerName="init-config-reloader" Jul 10 14:33:48.290400 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.290395 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0d7efcd-121d-48e7-82f6-cc405e907258" containerName="prom-label-proxy" Jul 10 14:33:48.290400 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.290401 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0d7efcd-121d-48e7-82f6-cc405e907258" containerName="prom-label-proxy" Jul 10 14:33:48.290620 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.290408 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0d7efcd-121d-48e7-82f6-cc405e907258" containerName="kube-rbac-proxy" Jul 10 14:33:48.290620 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.290413 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0d7efcd-121d-48e7-82f6-cc405e907258" containerName="kube-rbac-proxy" Jul 10 14:33:48.290620 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.290421 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8564e38c-6574-457e-88d5-f07579c4ce3a" containerName="console" Jul 10 14:33:48.290620 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.290426 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="8564e38c-6574-457e-88d5-f07579c4ce3a" containerName="console" Jul 10 14:33:48.290620 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.290432 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0d7efcd-121d-48e7-82f6-cc405e907258" containerName="kube-rbac-proxy-metric" Jul 10 14:33:48.290620 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.290438 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0d7efcd-121d-48e7-82f6-cc405e907258" containerName="kube-rbac-proxy-metric" Jul 10 14:33:48.290620 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.290451 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0d7efcd-121d-48e7-82f6-cc405e907258" containerName="kube-rbac-proxy-web" Jul 10 14:33:48.290620 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.290457 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0d7efcd-121d-48e7-82f6-cc405e907258" containerName="kube-rbac-proxy-web" Jul 10 14:33:48.290620 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.290499 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0d7efcd-121d-48e7-82f6-cc405e907258" containerName="alertmanager" Jul 10 14:33:48.290620 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.290507 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0d7efcd-121d-48e7-82f6-cc405e907258" containerName="kube-rbac-proxy-metric" Jul 10 14:33:48.290620 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.290514 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0d7efcd-121d-48e7-82f6-cc405e907258" containerName="kube-rbac-proxy" Jul 10 14:33:48.290620 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.290520 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="8564e38c-6574-457e-88d5-f07579c4ce3a" containerName="console" Jul 10 14:33:48.290620 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.290526 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0d7efcd-121d-48e7-82f6-cc405e907258" containerName="kube-rbac-proxy-web" Jul 10 14:33:48.290620 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.290531 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0d7efcd-121d-48e7-82f6-cc405e907258" containerName="prom-label-proxy" Jul 10 14:33:48.290620 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.290539 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0d7efcd-121d-48e7-82f6-cc405e907258" containerName="config-reloader" Jul 10 14:33:48.295886 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.294866 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.297465 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.297434 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 10 14:33:48.297770 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.297709 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 10 14:33:48.297871 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.297779 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 10 14:33:48.297871 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.297806 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 10 14:33:48.297871 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.297832 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-sml8n\"" Jul 10 14:33:48.298099 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.298011 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 10 14:33:48.298310 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.298296 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 10 14:33:48.298454 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.298435 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 10 14:33:48.298525 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.298483 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 10 14:33:48.303767 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.303750 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 10 14:33:48.308629 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.308609 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 14:33:48.348441 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.348412 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98683e94-703e-455c-a069-def463432e0f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.348441 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.348442 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98683e94-703e-455c-a069-def463432e0f-web-config\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.348600 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.348461 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/98683e94-703e-455c-a069-def463432e0f-config-volume\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.348600 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.348477 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df6tn\" (UniqueName: \"kubernetes.io/projected/98683e94-703e-455c-a069-def463432e0f-kube-api-access-df6tn\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.348600 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.348502 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98683e94-703e-455c-a069-def463432e0f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.348600 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.348541 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/98683e94-703e-455c-a069-def463432e0f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.348600 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.348576 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98683e94-703e-455c-a069-def463432e0f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.348762 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.348600 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98683e94-703e-455c-a069-def463432e0f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.348762 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.348630 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/98683e94-703e-455c-a069-def463432e0f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.348762 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.348650 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98683e94-703e-455c-a069-def463432e0f-config-out\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.348762 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.348664 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/98683e94-703e-455c-a069-def463432e0f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.348762 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.348683 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/98683e94-703e-455c-a069-def463432e0f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.348762 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.348710 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98683e94-703e-455c-a069-def463432e0f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.449363 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.449333 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/98683e94-703e-455c-a069-def463432e0f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.449475 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.449372 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98683e94-703e-455c-a069-def463432e0f-config-out\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.449539 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.449469 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/98683e94-703e-455c-a069-def463432e0f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.449539 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.449507 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/98683e94-703e-455c-a069-def463432e0f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.449635 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.449532 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98683e94-703e-455c-a069-def463432e0f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.449635 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.449578 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98683e94-703e-455c-a069-def463432e0f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.449635 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.449611 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98683e94-703e-455c-a069-def463432e0f-web-config\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.449783 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.449645 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/98683e94-703e-455c-a069-def463432e0f-config-volume\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.449783 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.449666 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df6tn\" (UniqueName: \"kubernetes.io/projected/98683e94-703e-455c-a069-def463432e0f-kube-api-access-df6tn\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.449783 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.449702 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98683e94-703e-455c-a069-def463432e0f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.449783 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.449731 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/98683e94-703e-455c-a069-def463432e0f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.449963 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.449795 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98683e94-703e-455c-a069-def463432e0f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.449963 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.449833 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98683e94-703e-455c-a069-def463432e0f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.450448 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.450420 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/98683e94-703e-455c-a069-def463432e0f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.451147 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.451122 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/98683e94-703e-455c-a069-def463432e0f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.451808 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.451784 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98683e94-703e-455c-a069-def463432e0f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.452459 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.452408 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/98683e94-703e-455c-a069-def463432e0f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.452459 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.452449 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/98683e94-703e-455c-a069-def463432e0f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.452854 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.452830 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/98683e94-703e-455c-a069-def463432e0f-config-out\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.453000 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.452962 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/98683e94-703e-455c-a069-def463432e0f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.453087 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.453027 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/98683e94-703e-455c-a069-def463432e0f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.453242 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.453223 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/98683e94-703e-455c-a069-def463432e0f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.453505 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.453485 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/98683e94-703e-455c-a069-def463432e0f-config-volume\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.453628 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.453609 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/98683e94-703e-455c-a069-def463432e0f-web-config\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.454259 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.454238 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/98683e94-703e-455c-a069-def463432e0f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.458487 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.458460 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-df6tn\" (UniqueName: \"kubernetes.io/projected/98683e94-703e-455c-a069-def463432e0f-kube-api-access-df6tn\") pod \"alertmanager-main-0\" (UID: \"98683e94-703e-455c-a069-def463432e0f\") " pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.462445 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.462413 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0d7efcd-121d-48e7-82f6-cc405e907258" path="/var/lib/kubelet/pods/e0d7efcd-121d-48e7-82f6-cc405e907258/volumes" Jul 10 14:33:48.605915 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.605856 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 10 14:33:48.735874 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:48.735849 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 10 14:33:48.737408 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:33:48.737382 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98683e94_703e_455c_a069_def463432e0f.slice/crio-5d149a724460efd588e8e8ee495d1984778a528f9ccdd80f22025f435c86c0e7 WatchSource:0}: Error finding container 5d149a724460efd588e8e8ee495d1984778a528f9ccdd80f22025f435c86c0e7: Status 404 returned error can't find the container with id 5d149a724460efd588e8e8ee495d1984778a528f9ccdd80f22025f435c86c0e7 Jul 10 14:33:49.236597 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:49.236567 2571 generic.go:356] "Generic (PLEG): container finished" podID="98683e94-703e-455c-a069-def463432e0f" containerID="baf84dd1ddfd47c84677a72c8bd55fba50dfaac8062a01570c84cec5fbddf586" exitCode=0 Jul 10 14:33:49.236793 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:49.236661 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98683e94-703e-455c-a069-def463432e0f","Type":"ContainerDied","Data":"baf84dd1ddfd47c84677a72c8bd55fba50dfaac8062a01570c84cec5fbddf586"} Jul 10 14:33:49.236793 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:49.236737 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98683e94-703e-455c-a069-def463432e0f","Type":"ContainerStarted","Data":"5d149a724460efd588e8e8ee495d1984778a528f9ccdd80f22025f435c86c0e7"} Jul 10 14:33:50.244804 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.244771 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98683e94-703e-455c-a069-def463432e0f","Type":"ContainerStarted","Data":"a1b3c48e2297efc94850b85a60e1a2fd85fa893d95726e454208dd8b18d06d4e"} Jul 10 14:33:50.245188 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.244852 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98683e94-703e-455c-a069-def463432e0f","Type":"ContainerStarted","Data":"e0faa8a92f05b101b6b96599d8ef466228a092a3ad64a91063c5e3956e530b88"} Jul 10 14:33:50.245188 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.244890 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98683e94-703e-455c-a069-def463432e0f","Type":"ContainerStarted","Data":"51de67ad8a276c98145753d274fa511b8ad7087d38d275bca2c08780a263ba53"} Jul 10 14:33:50.245188 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.244935 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98683e94-703e-455c-a069-def463432e0f","Type":"ContainerStarted","Data":"fe97fd2d47ad2aaa3e60761e4b8b170d6369cbe13886deb3adc61c937992621f"} Jul 10 14:33:50.245188 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.244988 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98683e94-703e-455c-a069-def463432e0f","Type":"ContainerStarted","Data":"ea0164b851603ed92e106071df315d15fff93e50b175cc970368d61cc637b682"} Jul 10 14:33:50.245188 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.245025 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"98683e94-703e-455c-a069-def463432e0f","Type":"ContainerStarted","Data":"b944d44b2aa4308f5f045557f5e881713a8ebd0d3509ae00a5e5850b8d0a6764"} Jul 10 14:33:50.273656 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.273608 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.2577479719999998 podStartE2EDuration="2.273592908s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.844936ms" isStatefulPod=false podCreationTimestamp="2026-07-10 14:33:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:33:50.272957037 +0000 UTC m=+148.350618593" watchObservedRunningTime="2026-07-10 14:33:50.273592908 +0000 UTC m=+148.351254464" Jul 10 14:33:50.374437 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.374407 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-84599b86b6-5vt2d"] Jul 10 14:33:50.377149 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.377126 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-84599b86b6-5vt2d" Jul 10 14:33:50.379701 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.379679 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 10 14:33:50.379799 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.379679 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 10 14:33:50.379799 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.379769 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 10 14:33:50.379922 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.379888 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 10 14:33:50.380134 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.380104 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-gv4xz\"" Jul 10 14:33:50.380248 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.380158 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 10 14:33:50.386451 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.386430 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 10 14:33:50.394552 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.394527 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-84599b86b6-5vt2d"] Jul 10 14:33:50.468870 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.467907 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a598e8d8-ceee-4f31-9597-e6a2f6d39685-telemeter-trusted-ca-bundle\") pod \"telemeter-client-84599b86b6-5vt2d\" (UID: \"a598e8d8-ceee-4f31-9597-e6a2f6d39685\") " pod="openshift-monitoring/telemeter-client-84599b86b6-5vt2d" Jul 10 14:33:50.468870 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.468079 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a598e8d8-ceee-4f31-9597-e6a2f6d39685-federate-client-tls\") pod \"telemeter-client-84599b86b6-5vt2d\" (UID: \"a598e8d8-ceee-4f31-9597-e6a2f6d39685\") " pod="openshift-monitoring/telemeter-client-84599b86b6-5vt2d" Jul 10 14:33:50.468870 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.468115 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2vnt\" (UniqueName: \"kubernetes.io/projected/a598e8d8-ceee-4f31-9597-e6a2f6d39685-kube-api-access-z2vnt\") pod \"telemeter-client-84599b86b6-5vt2d\" (UID: \"a598e8d8-ceee-4f31-9597-e6a2f6d39685\") " pod="openshift-monitoring/telemeter-client-84599b86b6-5vt2d" Jul 10 14:33:50.468870 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.468172 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a598e8d8-ceee-4f31-9597-e6a2f6d39685-telemeter-client-tls\") pod \"telemeter-client-84599b86b6-5vt2d\" (UID: \"a598e8d8-ceee-4f31-9597-e6a2f6d39685\") " pod="openshift-monitoring/telemeter-client-84599b86b6-5vt2d" Jul 10 14:33:50.468870 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.468224 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a598e8d8-ceee-4f31-9597-e6a2f6d39685-secret-telemeter-client\") pod \"telemeter-client-84599b86b6-5vt2d\" (UID: \"a598e8d8-ceee-4f31-9597-e6a2f6d39685\") " pod="openshift-monitoring/telemeter-client-84599b86b6-5vt2d" Jul 10 14:33:50.468870 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.468283 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a598e8d8-ceee-4f31-9597-e6a2f6d39685-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-84599b86b6-5vt2d\" (UID: \"a598e8d8-ceee-4f31-9597-e6a2f6d39685\") " pod="openshift-monitoring/telemeter-client-84599b86b6-5vt2d" Jul 10 14:33:50.468870 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.468310 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a598e8d8-ceee-4f31-9597-e6a2f6d39685-metrics-client-ca\") pod \"telemeter-client-84599b86b6-5vt2d\" (UID: \"a598e8d8-ceee-4f31-9597-e6a2f6d39685\") " pod="openshift-monitoring/telemeter-client-84599b86b6-5vt2d" Jul 10 14:33:50.468870 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.468373 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a598e8d8-ceee-4f31-9597-e6a2f6d39685-serving-certs-ca-bundle\") pod \"telemeter-client-84599b86b6-5vt2d\" (UID: \"a598e8d8-ceee-4f31-9597-e6a2f6d39685\") " pod="openshift-monitoring/telemeter-client-84599b86b6-5vt2d" Jul 10 14:33:50.568776 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.568698 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a598e8d8-ceee-4f31-9597-e6a2f6d39685-telemeter-client-tls\") pod \"telemeter-client-84599b86b6-5vt2d\" (UID: \"a598e8d8-ceee-4f31-9597-e6a2f6d39685\") " pod="openshift-monitoring/telemeter-client-84599b86b6-5vt2d" Jul 10 14:33:50.568776 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.568734 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a598e8d8-ceee-4f31-9597-e6a2f6d39685-secret-telemeter-client\") pod \"telemeter-client-84599b86b6-5vt2d\" (UID: \"a598e8d8-ceee-4f31-9597-e6a2f6d39685\") " pod="openshift-monitoring/telemeter-client-84599b86b6-5vt2d" Jul 10 14:33:50.568776 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.568756 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a598e8d8-ceee-4f31-9597-e6a2f6d39685-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-84599b86b6-5vt2d\" (UID: \"a598e8d8-ceee-4f31-9597-e6a2f6d39685\") " pod="openshift-monitoring/telemeter-client-84599b86b6-5vt2d" Jul 10 14:33:50.568776 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.568773 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a598e8d8-ceee-4f31-9597-e6a2f6d39685-metrics-client-ca\") pod \"telemeter-client-84599b86b6-5vt2d\" (UID: \"a598e8d8-ceee-4f31-9597-e6a2f6d39685\") " pod="openshift-monitoring/telemeter-client-84599b86b6-5vt2d" Jul 10 14:33:50.569081 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.568794 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a598e8d8-ceee-4f31-9597-e6a2f6d39685-serving-certs-ca-bundle\") pod \"telemeter-client-84599b86b6-5vt2d\" (UID: \"a598e8d8-ceee-4f31-9597-e6a2f6d39685\") " pod="openshift-monitoring/telemeter-client-84599b86b6-5vt2d" Jul 10 14:33:50.569081 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.568818 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a598e8d8-ceee-4f31-9597-e6a2f6d39685-telemeter-trusted-ca-bundle\") pod \"telemeter-client-84599b86b6-5vt2d\" (UID: \"a598e8d8-ceee-4f31-9597-e6a2f6d39685\") " pod="openshift-monitoring/telemeter-client-84599b86b6-5vt2d" Jul 10 14:33:50.569081 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.568846 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a598e8d8-ceee-4f31-9597-e6a2f6d39685-federate-client-tls\") pod \"telemeter-client-84599b86b6-5vt2d\" (UID: \"a598e8d8-ceee-4f31-9597-e6a2f6d39685\") " pod="openshift-monitoring/telemeter-client-84599b86b6-5vt2d" Jul 10 14:33:50.569081 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.568869 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2vnt\" (UniqueName: \"kubernetes.io/projected/a598e8d8-ceee-4f31-9597-e6a2f6d39685-kube-api-access-z2vnt\") pod \"telemeter-client-84599b86b6-5vt2d\" (UID: \"a598e8d8-ceee-4f31-9597-e6a2f6d39685\") " pod="openshift-monitoring/telemeter-client-84599b86b6-5vt2d" Jul 10 14:33:50.569611 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.569584 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a598e8d8-ceee-4f31-9597-e6a2f6d39685-metrics-client-ca\") pod \"telemeter-client-84599b86b6-5vt2d\" (UID: \"a598e8d8-ceee-4f31-9597-e6a2f6d39685\") " pod="openshift-monitoring/telemeter-client-84599b86b6-5vt2d" Jul 10 14:33:50.569795 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.569594 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a598e8d8-ceee-4f31-9597-e6a2f6d39685-serving-certs-ca-bundle\") pod \"telemeter-client-84599b86b6-5vt2d\" (UID: \"a598e8d8-ceee-4f31-9597-e6a2f6d39685\") " pod="openshift-monitoring/telemeter-client-84599b86b6-5vt2d" Jul 10 14:33:50.570042 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.570023 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a598e8d8-ceee-4f31-9597-e6a2f6d39685-telemeter-trusted-ca-bundle\") pod \"telemeter-client-84599b86b6-5vt2d\" (UID: \"a598e8d8-ceee-4f31-9597-e6a2f6d39685\") " pod="openshift-monitoring/telemeter-client-84599b86b6-5vt2d" Jul 10 14:33:50.571530 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.571504 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a598e8d8-ceee-4f31-9597-e6a2f6d39685-telemeter-client-tls\") pod \"telemeter-client-84599b86b6-5vt2d\" (UID: \"a598e8d8-ceee-4f31-9597-e6a2f6d39685\") " pod="openshift-monitoring/telemeter-client-84599b86b6-5vt2d" Jul 10 14:33:50.571719 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.571699 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a598e8d8-ceee-4f31-9597-e6a2f6d39685-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-84599b86b6-5vt2d\" (UID: \"a598e8d8-ceee-4f31-9597-e6a2f6d39685\") " pod="openshift-monitoring/telemeter-client-84599b86b6-5vt2d" Jul 10 14:33:50.571782 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.571733 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a598e8d8-ceee-4f31-9597-e6a2f6d39685-secret-telemeter-client\") pod \"telemeter-client-84599b86b6-5vt2d\" (UID: \"a598e8d8-ceee-4f31-9597-e6a2f6d39685\") " pod="openshift-monitoring/telemeter-client-84599b86b6-5vt2d" Jul 10 14:33:50.571926 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.571903 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a598e8d8-ceee-4f31-9597-e6a2f6d39685-federate-client-tls\") pod \"telemeter-client-84599b86b6-5vt2d\" (UID: \"a598e8d8-ceee-4f31-9597-e6a2f6d39685\") " pod="openshift-monitoring/telemeter-client-84599b86b6-5vt2d" Jul 10 14:33:50.577227 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.577207 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2vnt\" (UniqueName: \"kubernetes.io/projected/a598e8d8-ceee-4f31-9597-e6a2f6d39685-kube-api-access-z2vnt\") pod \"telemeter-client-84599b86b6-5vt2d\" (UID: \"a598e8d8-ceee-4f31-9597-e6a2f6d39685\") " pod="openshift-monitoring/telemeter-client-84599b86b6-5vt2d" Jul 10 14:33:50.688275 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.688243 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-84599b86b6-5vt2d" Jul 10 14:33:50.702026 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.702001 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 14:33:50.702404 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.702342 2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c4b49723-ad26-4643-8531-0612a454b10c" containerName="prometheus" containerID="cri-o://eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43" gracePeriod=600 Jul 10 14:33:50.702733 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.702665 2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c4b49723-ad26-4643-8531-0612a454b10c" containerName="kube-rbac-proxy" containerID="cri-o://204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337" gracePeriod=600 Jul 10 14:33:50.702814 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.702729 2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c4b49723-ad26-4643-8531-0612a454b10c" containerName="kube-rbac-proxy-web" containerID="cri-o://50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9" gracePeriod=600 Jul 10 14:33:50.702879 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.702837 2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c4b49723-ad26-4643-8531-0612a454b10c" containerName="thanos-sidecar" containerID="cri-o://09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca" gracePeriod=600 Jul 10 14:33:50.702879 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.702848 2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c4b49723-ad26-4643-8531-0612a454b10c" containerName="kube-rbac-proxy-thanos" containerID="cri-o://0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848" gracePeriod=600 Jul 10 14:33:50.703012 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.702918 2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c4b49723-ad26-4643-8531-0612a454b10c" containerName="config-reloader" containerID="cri-o://a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6" gracePeriod=600 Jul 10 14:33:50.850816 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.850269 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-84599b86b6-5vt2d"] Jul 10 14:33:50.851727 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:33:50.851703 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda598e8d8_ceee_4f31_9597_e6a2f6d39685.slice/crio-07d76fa532403abe92eadfb4b559ce4476a6b2952c65f3c2c79c41bd80417dba WatchSource:0}: Error finding container 07d76fa532403abe92eadfb4b559ce4476a6b2952c65f3c2c79c41bd80417dba: Status 404 returned error can't find the container with id 07d76fa532403abe92eadfb4b559ce4476a6b2952c65f3c2c79c41bd80417dba Jul 10 14:33:50.971288 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:50.971265 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.072590 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.072518 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"c4b49723-ad26-4643-8531-0612a454b10c\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " Jul 10 14:33:51.072590 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.072550 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-thanos-prometheus-http-client-file\") pod \"c4b49723-ad26-4643-8531-0612a454b10c\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " Jul 10 14:33:51.072590 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.072577 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c4b49723-ad26-4643-8531-0612a454b10c-prometheus-k8s-db\") pod \"c4b49723-ad26-4643-8531-0612a454b10c\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " Jul 10 14:33:51.072839 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.072596 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-web-config\") pod \"c4b49723-ad26-4643-8531-0612a454b10c\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " Jul 10 14:33:51.072839 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.072670 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"c4b49723-ad26-4643-8531-0612a454b10c\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " Jul 10 14:33:51.072839 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.072725 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-kube-rbac-proxy\") pod \"c4b49723-ad26-4643-8531-0612a454b10c\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " Jul 10 14:33:51.072839 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.072762 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-prometheus-k8s-rulefiles-2\") pod \"c4b49723-ad26-4643-8531-0612a454b10c\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " Jul 10 14:33:51.072839 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.072798 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-prometheus-k8s-rulefiles-0\") pod \"c4b49723-ad26-4643-8531-0612a454b10c\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " Jul 10 14:33:51.072839 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.072827 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-prometheus-k8s-tls\") pod \"c4b49723-ad26-4643-8531-0612a454b10c\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " Jul 10 14:33:51.073166 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.072856 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-configmap-metrics-client-ca\") pod \"c4b49723-ad26-4643-8531-0612a454b10c\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " Jul 10 14:33:51.073166 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.072886 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-configmap-kubelet-serving-ca-bundle\") pod \"c4b49723-ad26-4643-8531-0612a454b10c\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " Jul 10 14:33:51.073166 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.072911 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-prometheus-k8s-rulefiles-1\") pod \"c4b49723-ad26-4643-8531-0612a454b10c\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " Jul 10 14:33:51.073166 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.072949 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c4b49723-ad26-4643-8531-0612a454b10c-tls-assets\") pod \"c4b49723-ad26-4643-8531-0612a454b10c\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " Jul 10 14:33:51.073166 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.073000 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-configmap-serving-certs-ca-bundle\") pod \"c4b49723-ad26-4643-8531-0612a454b10c\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " Jul 10 14:33:51.073166 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.073030 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-config\") pod \"c4b49723-ad26-4643-8531-0612a454b10c\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " Jul 10 14:33:51.073166 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.073060 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gn92b\" (UniqueName: \"kubernetes.io/projected/c4b49723-ad26-4643-8531-0612a454b10c-kube-api-access-gn92b\") pod \"c4b49723-ad26-4643-8531-0612a454b10c\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " Jul 10 14:33:51.073166 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.073093 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-prometheus-trusted-ca-bundle\") pod \"c4b49723-ad26-4643-8531-0612a454b10c\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " Jul 10 14:33:51.073166 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.073139 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c4b49723-ad26-4643-8531-0612a454b10c-config-out\") pod \"c4b49723-ad26-4643-8531-0612a454b10c\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " Jul 10 14:33:51.073575 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.073192 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-grpc-tls\") pod \"c4b49723-ad26-4643-8531-0612a454b10c\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " Jul 10 14:33:51.073575 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.073223 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-metrics-client-certs\") pod \"c4b49723-ad26-4643-8531-0612a454b10c\" (UID: \"c4b49723-ad26-4643-8531-0612a454b10c\") " Jul 10 14:33:51.073575 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.073351 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "c4b49723-ad26-4643-8531-0612a454b10c" (UID: "c4b49723-ad26-4643-8531-0612a454b10c"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:33:51.073575 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.073509 2571 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:33:51.073790 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.073765 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "c4b49723-ad26-4643-8531-0612a454b10c" (UID: "c4b49723-ad26-4643-8531-0612a454b10c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:33:51.073857 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.073832 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4b49723-ad26-4643-8531-0612a454b10c-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "c4b49723-ad26-4643-8531-0612a454b10c" (UID: "c4b49723-ad26-4643-8531-0612a454b10c"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:33:51.074862 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.074832 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "c4b49723-ad26-4643-8531-0612a454b10c" (UID: "c4b49723-ad26-4643-8531-0612a454b10c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:33:51.075341 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.075314 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "c4b49723-ad26-4643-8531-0612a454b10c" (UID: "c4b49723-ad26-4643-8531-0612a454b10c"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:33:51.075604 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.075578 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "c4b49723-ad26-4643-8531-0612a454b10c" (UID: "c4b49723-ad26-4643-8531-0612a454b10c"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:33:51.075839 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.075810 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "c4b49723-ad26-4643-8531-0612a454b10c" (UID: "c4b49723-ad26-4643-8531-0612a454b10c"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:33:51.075922 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.075906 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "c4b49723-ad26-4643-8531-0612a454b10c" (UID: "c4b49723-ad26-4643-8531-0612a454b10c"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:33:51.076044 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.076019 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "c4b49723-ad26-4643-8531-0612a454b10c" (UID: "c4b49723-ad26-4643-8531-0612a454b10c"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:33:51.076160 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.076131 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "c4b49723-ad26-4643-8531-0612a454b10c" (UID: "c4b49723-ad26-4643-8531-0612a454b10c"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 10 14:33:51.076221 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.076184 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "c4b49723-ad26-4643-8531-0612a454b10c" (UID: "c4b49723-ad26-4643-8531-0612a454b10c"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:33:51.076806 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.076767 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "c4b49723-ad26-4643-8531-0612a454b10c" (UID: "c4b49723-ad26-4643-8531-0612a454b10c"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:33:51.076942 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.076922 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "c4b49723-ad26-4643-8531-0612a454b10c" (UID: "c4b49723-ad26-4643-8531-0612a454b10c"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:33:51.077393 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.077355 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "c4b49723-ad26-4643-8531-0612a454b10c" (UID: "c4b49723-ad26-4643-8531-0612a454b10c"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:33:51.077661 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.077636 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4b49723-ad26-4643-8531-0612a454b10c-kube-api-access-gn92b" (OuterVolumeSpecName: "kube-api-access-gn92b") pod "c4b49723-ad26-4643-8531-0612a454b10c" (UID: "c4b49723-ad26-4643-8531-0612a454b10c"). InnerVolumeSpecName "kube-api-access-gn92b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:33:51.077772 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.077725 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4b49723-ad26-4643-8531-0612a454b10c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c4b49723-ad26-4643-8531-0612a454b10c" (UID: "c4b49723-ad26-4643-8531-0612a454b10c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 14:33:51.077911 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.077892 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-config" (OuterVolumeSpecName: "config") pod "c4b49723-ad26-4643-8531-0612a454b10c" (UID: "c4b49723-ad26-4643-8531-0612a454b10c"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:33:51.078100 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.078085 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4b49723-ad26-4643-8531-0612a454b10c-config-out" (OuterVolumeSpecName: "config-out") pod "c4b49723-ad26-4643-8531-0612a454b10c" (UID: "c4b49723-ad26-4643-8531-0612a454b10c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 14:33:51.078261 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.078245 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "c4b49723-ad26-4643-8531-0612a454b10c" (UID: "c4b49723-ad26-4643-8531-0612a454b10c"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:33:51.085853 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.085834 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-web-config" (OuterVolumeSpecName: "web-config") pod "c4b49723-ad26-4643-8531-0612a454b10c" (UID: "c4b49723-ad26-4643-8531-0612a454b10c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 14:33:51.173833 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.173807 2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:33:51.173833 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.173829 2571 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c4b49723-ad26-4643-8531-0612a454b10c-config-out\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:33:51.173833 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.173838 2571 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-grpc-tls\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:33:51.174029 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.173848 2571 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-metrics-client-certs\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:33:51.174029 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.173857 2571 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:33:51.174029 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.173866 2571 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:33:51.174029 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.173874 2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c4b49723-ad26-4643-8531-0612a454b10c-prometheus-k8s-db\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:33:51.174029 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.173882 2571 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-web-config\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:33:51.174029 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.173890 2571 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:33:51.174029 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.173898 2571 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-kube-rbac-proxy\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:33:51.174029 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.173907 2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:33:51.174029 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.173918 2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:33:51.174029 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.173926 2571 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:33:51.174029 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.173934 2571 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-configmap-metrics-client-ca\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:33:51.174029 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.173941 2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:33:51.174029 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.173949 2571 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c4b49723-ad26-4643-8531-0612a454b10c-tls-assets\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:33:51.174029 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.173956 2571 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4b49723-ad26-4643-8531-0612a454b10c-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:33:51.174029 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.173984 2571 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/c4b49723-ad26-4643-8531-0612a454b10c-config\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:33:51.174029 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.173997 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gn92b\" (UniqueName: \"kubernetes.io/projected/c4b49723-ad26-4643-8531-0612a454b10c-kube-api-access-gn92b\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 14:33:51.254197 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.254169 2571 generic.go:356] "Generic (PLEG): container finished" podID="c4b49723-ad26-4643-8531-0612a454b10c" containerID="0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848" exitCode=0 Jul 10 14:33:51.254197 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.254191 2571 generic.go:356] "Generic (PLEG): container finished" podID="c4b49723-ad26-4643-8531-0612a454b10c" containerID="204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337" exitCode=0 Jul 10 14:33:51.254197 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.254197 2571 generic.go:356] "Generic (PLEG): container finished" podID="c4b49723-ad26-4643-8531-0612a454b10c" containerID="50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9" exitCode=0 Jul 10 14:33:51.254197 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.254203 2571 generic.go:356] "Generic (PLEG): container finished" podID="c4b49723-ad26-4643-8531-0612a454b10c" containerID="09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca" exitCode=0 Jul 10 14:33:51.254684 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.254211 2571 generic.go:356] "Generic (PLEG): container finished" podID="c4b49723-ad26-4643-8531-0612a454b10c" containerID="a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6" exitCode=0 Jul 10 14:33:51.254684 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.254219 2571 generic.go:356] "Generic (PLEG): container finished" podID="c4b49723-ad26-4643-8531-0612a454b10c" containerID="eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43" exitCode=0 Jul 10 14:33:51.254684 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.254217 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4b49723-ad26-4643-8531-0612a454b10c","Type":"ContainerDied","Data":"0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848"} Jul 10 14:33:51.254684 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.254242 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.254684 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.254285 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4b49723-ad26-4643-8531-0612a454b10c","Type":"ContainerDied","Data":"204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337"} Jul 10 14:33:51.254684 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.254314 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4b49723-ad26-4643-8531-0612a454b10c","Type":"ContainerDied","Data":"50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9"} Jul 10 14:33:51.254684 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.254348 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4b49723-ad26-4643-8531-0612a454b10c","Type":"ContainerDied","Data":"09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca"} Jul 10 14:33:51.254684 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.254356 2571 scope.go:117] "RemoveContainer" containerID="0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848" Jul 10 14:33:51.254684 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.254392 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4b49723-ad26-4643-8531-0612a454b10c","Type":"ContainerDied","Data":"a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6"} Jul 10 14:33:51.254684 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.254432 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4b49723-ad26-4643-8531-0612a454b10c","Type":"ContainerDied","Data":"eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43"} Jul 10 14:33:51.254684 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.254474 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c4b49723-ad26-4643-8531-0612a454b10c","Type":"ContainerDied","Data":"fb4a50fa15e0b0512f28af7a534be1eae64bc455fceccffc0e73436bde4a96f3"} Jul 10 14:33:51.255614 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.255590 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84599b86b6-5vt2d" event={"ID":"a598e8d8-ceee-4f31-9597-e6a2f6d39685","Type":"ContainerStarted","Data":"07d76fa532403abe92eadfb4b559ce4476a6b2952c65f3c2c79c41bd80417dba"} Jul 10 14:33:51.262726 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.262687 2571 scope.go:117] "RemoveContainer" containerID="204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337" Jul 10 14:33:51.269457 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.269441 2571 scope.go:117] "RemoveContainer" containerID="50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9" Jul 10 14:33:51.275774 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.275760 2571 scope.go:117] "RemoveContainer" containerID="09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca" Jul 10 14:33:51.281723 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.281701 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 14:33:51.282617 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.282605 2571 scope.go:117] "RemoveContainer" containerID="a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6" Jul 10 14:33:51.286414 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.286397 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 14:33:51.289426 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.289412 2571 scope.go:117] "RemoveContainer" containerID="eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43" Jul 10 14:33:51.296398 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.296374 2571 scope.go:117] "RemoveContainer" containerID="d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83" Jul 10 14:33:51.302730 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.302700 2571 scope.go:117] "RemoveContainer" containerID="0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848" Jul 10 14:33:51.302977 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:33:51.302945 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848\": container with ID starting with 0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848 not found: ID does not exist" containerID="0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848" Jul 10 14:33:51.303040 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.302990 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848"} err="failed to get container status \"0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848\": rpc error: code = NotFound desc = could not find container \"0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848\": container with ID starting with 0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848 not found: ID does not exist" Jul 10 14:33:51.303040 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.303006 2571 scope.go:117] "RemoveContainer" containerID="204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337" Jul 10 14:33:51.303246 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:33:51.303229 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337\": container with ID starting with 204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337 not found: ID does not exist" containerID="204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337" Jul 10 14:33:51.303294 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.303252 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337"} err="failed to get container status \"204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337\": rpc error: code = NotFound desc = could not find container \"204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337\": container with ID starting with 204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337 not found: ID does not exist" Jul 10 14:33:51.303294 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.303267 2571 scope.go:117] "RemoveContainer" containerID="50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9" Jul 10 14:33:51.303492 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:33:51.303469 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9\": container with ID starting with 50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9 not found: ID does not exist" containerID="50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9" Jul 10 14:33:51.303545 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.303495 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9"} err="failed to get container status \"50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9\": rpc error: code = NotFound desc = could not find container \"50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9\": container with ID starting with 50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9 not found: ID does not exist" Jul 10 14:33:51.303545 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.303508 2571 scope.go:117] "RemoveContainer" containerID="09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca" Jul 10 14:33:51.303726 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:33:51.303713 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca\": container with ID starting with 09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca not found: ID does not exist" containerID="09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca" Jul 10 14:33:51.303761 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.303730 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca"} err="failed to get container status \"09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca\": rpc error: code = NotFound desc = could not find container \"09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca\": container with ID starting with 09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca not found: ID does not exist" Jul 10 14:33:51.303761 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.303743 2571 scope.go:117] "RemoveContainer" containerID="a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6" Jul 10 14:33:51.303946 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:33:51.303933 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6\": container with ID starting with a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6 not found: ID does not exist" containerID="a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6" Jul 10 14:33:51.304022 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.303949 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6"} err="failed to get container status \"a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6\": rpc error: code = NotFound desc = could not find container \"a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6\": container with ID starting with a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6 not found: ID does not exist" Jul 10 14:33:51.304022 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.303960 2571 scope.go:117] "RemoveContainer" containerID="eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43" Jul 10 14:33:51.304190 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:33:51.304176 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43\": container with ID starting with eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43 not found: ID does not exist" containerID="eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43" Jul 10 14:33:51.304235 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.304194 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43"} err="failed to get container status \"eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43\": rpc error: code = NotFound desc = could not find container \"eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43\": container with ID starting with eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43 not found: ID does not exist" Jul 10 14:33:51.304235 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.304207 2571 scope.go:117] "RemoveContainer" containerID="d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83" Jul 10 14:33:51.304423 ip-10-0-137-101 kubenswrapper[2571]: E0710 14:33:51.304407 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83\": container with ID starting with d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83 not found: ID does not exist" containerID="d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83" Jul 10 14:33:51.304464 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.304425 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83"} err="failed to get container status \"d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83\": rpc error: code = NotFound desc = could not find container \"d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83\": container with ID starting with d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83 not found: ID does not exist" Jul 10 14:33:51.304464 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.304437 2571 scope.go:117] "RemoveContainer" containerID="0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848" Jul 10 14:33:51.304647 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.304631 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848"} err="failed to get container status \"0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848\": rpc error: code = NotFound desc = could not find container \"0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848\": container with ID starting with 0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848 not found: ID does not exist" Jul 10 14:33:51.304691 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.304647 2571 scope.go:117] "RemoveContainer" containerID="204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337" Jul 10 14:33:51.304856 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.304838 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337"} err="failed to get container status \"204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337\": rpc error: code = NotFound desc = could not find container \"204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337\": container with ID starting with 204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337 not found: ID does not exist" Jul 10 14:33:51.304891 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.304856 2571 scope.go:117] "RemoveContainer" containerID="50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9" Jul 10 14:33:51.305068 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.305051 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9"} err="failed to get container status \"50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9\": rpc error: code = NotFound desc = could not find container \"50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9\": container with ID starting with 50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9 not found: ID does not exist" Jul 10 14:33:51.305125 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.305069 2571 scope.go:117] "RemoveContainer" containerID="09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca" Jul 10 14:33:51.305243 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.305228 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca"} err="failed to get container status \"09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca\": rpc error: code = NotFound desc = could not find container \"09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca\": container with ID starting with 09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca not found: ID does not exist" Jul 10 14:33:51.305285 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.305243 2571 scope.go:117] "RemoveContainer" containerID="a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6" Jul 10 14:33:51.305411 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.305396 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6"} err="failed to get container status \"a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6\": rpc error: code = NotFound desc = could not find container \"a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6\": container with ID starting with a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6 not found: ID does not exist" Jul 10 14:33:51.305446 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.305411 2571 scope.go:117] "RemoveContainer" containerID="eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43" Jul 10 14:33:51.305584 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.305564 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43"} err="failed to get container status \"eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43\": rpc error: code = NotFound desc = could not find container \"eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43\": container with ID starting with eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43 not found: ID does not exist" Jul 10 14:33:51.305619 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.305585 2571 scope.go:117] "RemoveContainer" containerID="d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83" Jul 10 14:33:51.305779 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.305761 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83"} err="failed to get container status \"d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83\": rpc error: code = NotFound desc = could not find container \"d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83\": container with ID starting with d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83 not found: ID does not exist" Jul 10 14:33:51.305814 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.305780 2571 scope.go:117] "RemoveContainer" containerID="0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848" Jul 10 14:33:51.305992 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.305957 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848"} err="failed to get container status \"0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848\": rpc error: code = NotFound desc = could not find container \"0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848\": container with ID starting with 0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848 not found: ID does not exist" Jul 10 14:33:51.305992 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.305990 2571 scope.go:117] "RemoveContainer" containerID="204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337" Jul 10 14:33:51.306191 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.306174 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337"} err="failed to get container status \"204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337\": rpc error: code = NotFound desc = could not find container \"204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337\": container with ID starting with 204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337 not found: ID does not exist" Jul 10 14:33:51.306239 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.306193 2571 scope.go:117] "RemoveContainer" containerID="50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9" Jul 10 14:33:51.306401 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.306380 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9"} err="failed to get container status \"50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9\": rpc error: code = NotFound desc = could not find container \"50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9\": container with ID starting with 50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9 not found: ID does not exist" Jul 10 14:33:51.306440 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.306403 2571 scope.go:117] "RemoveContainer" containerID="09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca" Jul 10 14:33:51.306595 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.306576 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca"} err="failed to get container status \"09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca\": rpc error: code = NotFound desc = could not find container \"09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca\": container with ID starting with 09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca not found: ID does not exist" Jul 10 14:33:51.306638 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.306595 2571 scope.go:117] "RemoveContainer" containerID="a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6" Jul 10 14:33:51.306801 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.306786 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6"} err="failed to get container status \"a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6\": rpc error: code = NotFound desc = could not find container \"a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6\": container with ID starting with a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6 not found: ID does not exist" Jul 10 14:33:51.306880 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.306801 2571 scope.go:117] "RemoveContainer" containerID="eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43" Jul 10 14:33:51.307017 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.307002 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43"} err="failed to get container status \"eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43\": rpc error: code = NotFound desc = could not find container \"eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43\": container with ID starting with eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43 not found: ID does not exist" Jul 10 14:33:51.307017 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.307016 2571 scope.go:117] "RemoveContainer" containerID="d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83" Jul 10 14:33:51.307236 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.307221 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83"} err="failed to get container status \"d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83\": rpc error: code = NotFound desc = could not find container \"d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83\": container with ID starting with d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83 not found: ID does not exist" Jul 10 14:33:51.307236 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.307235 2571 scope.go:117] "RemoveContainer" containerID="0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848" Jul 10 14:33:51.307433 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.307414 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848"} err="failed to get container status \"0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848\": rpc error: code = NotFound desc = could not find container \"0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848\": container with ID starting with 0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848 not found: ID does not exist" Jul 10 14:33:51.307486 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.307436 2571 scope.go:117] "RemoveContainer" containerID="204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337" Jul 10 14:33:51.307687 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.307644 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337"} err="failed to get container status \"204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337\": rpc error: code = NotFound desc = could not find container \"204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337\": container with ID starting with 204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337 not found: ID does not exist" Jul 10 14:33:51.307687 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.307664 2571 scope.go:117] "RemoveContainer" containerID="50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9" Jul 10 14:33:51.307922 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.307902 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9"} err="failed to get container status \"50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9\": rpc error: code = NotFound desc = could not find container \"50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9\": container with ID starting with 50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9 not found: ID does not exist" Jul 10 14:33:51.307922 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.307923 2571 scope.go:117] "RemoveContainer" containerID="09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca" Jul 10 14:33:51.308142 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.308127 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca"} err="failed to get container status \"09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca\": rpc error: code = NotFound desc = could not find container \"09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca\": container with ID starting with 09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca not found: ID does not exist" Jul 10 14:33:51.308185 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.308143 2571 scope.go:117] "RemoveContainer" containerID="a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6" Jul 10 14:33:51.308331 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.308316 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6"} err="failed to get container status \"a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6\": rpc error: code = NotFound desc = could not find container \"a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6\": container with ID starting with a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6 not found: ID does not exist" Jul 10 14:33:51.308371 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.308333 2571 scope.go:117] "RemoveContainer" containerID="eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43" Jul 10 14:33:51.308504 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.308490 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43"} err="failed to get container status \"eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43\": rpc error: code = NotFound desc = could not find container \"eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43\": container with ID starting with eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43 not found: ID does not exist" Jul 10 14:33:51.308551 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.308504 2571 scope.go:117] "RemoveContainer" containerID="d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83" Jul 10 14:33:51.308711 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.308695 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83"} err="failed to get container status \"d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83\": rpc error: code = NotFound desc = could not find container \"d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83\": container with ID starting with d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83 not found: ID does not exist" Jul 10 14:33:51.308758 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.308713 2571 scope.go:117] "RemoveContainer" containerID="0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848" Jul 10 14:33:51.308886 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.308869 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848"} err="failed to get container status \"0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848\": rpc error: code = NotFound desc = could not find container \"0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848\": container with ID starting with 0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848 not found: ID does not exist" Jul 10 14:33:51.308929 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.308887 2571 scope.go:117] "RemoveContainer" containerID="204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337" Jul 10 14:33:51.309079 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.309065 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337"} err="failed to get container status \"204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337\": rpc error: code = NotFound desc = could not find container \"204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337\": container with ID starting with 204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337 not found: ID does not exist" Jul 10 14:33:51.309128 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.309079 2571 scope.go:117] "RemoveContainer" containerID="50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9" Jul 10 14:33:51.309236 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.309221 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9"} err="failed to get container status \"50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9\": rpc error: code = NotFound desc = could not find container \"50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9\": container with ID starting with 50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9 not found: ID does not exist" Jul 10 14:33:51.309274 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.309237 2571 scope.go:117] "RemoveContainer" containerID="09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca" Jul 10 14:33:51.309429 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.309412 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca"} err="failed to get container status \"09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca\": rpc error: code = NotFound desc = could not find container \"09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca\": container with ID starting with 09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca not found: ID does not exist" Jul 10 14:33:51.309468 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.309429 2571 scope.go:117] "RemoveContainer" containerID="a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6" Jul 10 14:33:51.309603 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.309588 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6"} err="failed to get container status \"a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6\": rpc error: code = NotFound desc = could not find container \"a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6\": container with ID starting with a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6 not found: ID does not exist" Jul 10 14:33:51.309643 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.309603 2571 scope.go:117] "RemoveContainer" containerID="eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43" Jul 10 14:33:51.309779 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.309761 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43"} err="failed to get container status \"eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43\": rpc error: code = NotFound desc = could not find container \"eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43\": container with ID starting with eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43 not found: ID does not exist" Jul 10 14:33:51.309823 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.309779 2571 scope.go:117] "RemoveContainer" containerID="d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83" Jul 10 14:33:51.310007 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.309991 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83"} err="failed to get container status \"d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83\": rpc error: code = NotFound desc = could not find container \"d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83\": container with ID starting with d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83 not found: ID does not exist" Jul 10 14:33:51.310007 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.310007 2571 scope.go:117] "RemoveContainer" containerID="0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848" Jul 10 14:33:51.310210 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.310194 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848"} err="failed to get container status \"0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848\": rpc error: code = NotFound desc = could not find container \"0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848\": container with ID starting with 0925659d90624ebdb69f98d5f81ba948ee7e5fb65ba1ffaf101b05a88909b848 not found: ID does not exist" Jul 10 14:33:51.310264 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.310211 2571 scope.go:117] "RemoveContainer" containerID="204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337" Jul 10 14:33:51.310428 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.310409 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337"} err="failed to get container status \"204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337\": rpc error: code = NotFound desc = could not find container \"204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337\": container with ID starting with 204aa6b8f6cb0a4f82dc4d4e01934e2b03e9873eeb774e0715dc89bd09df4337 not found: ID does not exist" Jul 10 14:33:51.310471 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.310430 2571 scope.go:117] "RemoveContainer" containerID="50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9" Jul 10 14:33:51.310610 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.310596 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9"} err="failed to get container status \"50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9\": rpc error: code = NotFound desc = could not find container \"50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9\": container with ID starting with 50ca9e62cacf860e5a0a9415c8bdf3d239e8980fd85c58266166a034c87ea6c9 not found: ID does not exist" Jul 10 14:33:51.310647 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.310611 2571 scope.go:117] "RemoveContainer" containerID="09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca" Jul 10 14:33:51.310797 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.310783 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca"} err="failed to get container status \"09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca\": rpc error: code = NotFound desc = could not find container \"09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca\": container with ID starting with 09d7b579eb46baabc6352d49303a3eff8d40d9a462839abf09c59d83946525ca not found: ID does not exist" Jul 10 14:33:51.310852 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.310797 2571 scope.go:117] "RemoveContainer" containerID="a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6" Jul 10 14:33:51.311026 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.311002 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6"} err="failed to get container status \"a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6\": rpc error: code = NotFound desc = could not find container \"a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6\": container with ID starting with a3dc7c9ab56ce40eff1e5d55f41b8d77d0df01a47ef518d025e0c9ff0321d2b6 not found: ID does not exist" Jul 10 14:33:51.311026 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.311025 2571 scope.go:117] "RemoveContainer" containerID="eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43" Jul 10 14:33:51.311212 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.311198 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43"} err="failed to get container status \"eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43\": rpc error: code = NotFound desc = could not find container \"eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43\": container with ID starting with eff6fb1c4e52cf62107d8d63d598b7445bb041e114e12ab936a5431edbc45a43 not found: ID does not exist" Jul 10 14:33:51.311250 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.311213 2571 scope.go:117] "RemoveContainer" containerID="d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83" Jul 10 14:33:51.311396 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.311381 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83"} err="failed to get container status \"d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83\": rpc error: code = NotFound desc = could not find container \"d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83\": container with ID starting with d87ef20f296b8c6cb34b161a35eda2a2d536bdeb81203726dc4e1b0038184b83 not found: ID does not exist" Jul 10 14:33:51.318676 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.318655 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 14:33:51.318917 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.318907 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4b49723-ad26-4643-8531-0612a454b10c" containerName="config-reloader" Jul 10 14:33:51.318952 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.318919 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4b49723-ad26-4643-8531-0612a454b10c" containerName="config-reloader" Jul 10 14:33:51.318952 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.318929 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4b49723-ad26-4643-8531-0612a454b10c" containerName="thanos-sidecar" Jul 10 14:33:51.318952 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.318935 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4b49723-ad26-4643-8531-0612a454b10c" containerName="thanos-sidecar" Jul 10 14:33:51.318952 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.318943 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4b49723-ad26-4643-8531-0612a454b10c" containerName="kube-rbac-proxy-web" Jul 10 14:33:51.318952 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.318949 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4b49723-ad26-4643-8531-0612a454b10c" containerName="kube-rbac-proxy-web" Jul 10 14:33:51.319112 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.318955 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4b49723-ad26-4643-8531-0612a454b10c" containerName="prometheus" Jul 10 14:33:51.319112 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.318961 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4b49723-ad26-4643-8531-0612a454b10c" containerName="prometheus" Jul 10 14:33:51.319112 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.318986 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4b49723-ad26-4643-8531-0612a454b10c" containerName="kube-rbac-proxy" Jul 10 14:33:51.319112 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.318992 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4b49723-ad26-4643-8531-0612a454b10c" containerName="kube-rbac-proxy" Jul 10 14:33:51.319112 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.318997 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4b49723-ad26-4643-8531-0612a454b10c" containerName="kube-rbac-proxy-thanos" Jul 10 14:33:51.319112 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.319002 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4b49723-ad26-4643-8531-0612a454b10c" containerName="kube-rbac-proxy-thanos" Jul 10 14:33:51.319112 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.319013 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4b49723-ad26-4643-8531-0612a454b10c" containerName="init-config-reloader" Jul 10 14:33:51.319112 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.319018 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4b49723-ad26-4643-8531-0612a454b10c" containerName="init-config-reloader" Jul 10 14:33:51.319112 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.319056 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4b49723-ad26-4643-8531-0612a454b10c" containerName="kube-rbac-proxy-thanos" Jul 10 14:33:51.319112 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.319065 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4b49723-ad26-4643-8531-0612a454b10c" containerName="kube-rbac-proxy" Jul 10 14:33:51.319112 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.319071 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4b49723-ad26-4643-8531-0612a454b10c" containerName="kube-rbac-proxy-web" Jul 10 14:33:51.319112 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.319077 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4b49723-ad26-4643-8531-0612a454b10c" containerName="thanos-sidecar" Jul 10 14:33:51.319112 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.319083 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4b49723-ad26-4643-8531-0612a454b10c" containerName="config-reloader" Jul 10 14:33:51.319112 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.319088 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4b49723-ad26-4643-8531-0612a454b10c" containerName="prometheus" Jul 10 14:33:51.323390 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.323346 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.328206 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.328133 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 10 14:33:51.328206 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.328183 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 10 14:33:51.328446 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.328184 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 10 14:33:51.328446 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.328186 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 10 14:33:51.328446 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.328350 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 10 14:33:51.328638 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.328520 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 10 14:33:51.328690 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.328646 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bbp1treer3j08\"" Jul 10 14:33:51.328789 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.328752 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 10 14:33:51.328898 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.328814 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 10 14:33:51.328962 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.328899 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 10 14:33:51.329041 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.328963 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-tw7v5\"" Jul 10 14:33:51.329041 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.328986 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 10 14:33:51.329041 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.328996 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 10 14:33:51.329307 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.329292 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 10 14:33:51.329371 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.329317 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 10 14:33:51.332200 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.332170 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 10 14:33:51.334526 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.334510 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 10 14:33:51.348796 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.348777 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 14:33:51.375646 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.375627 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/127cdd83-4138-4109-a8ba-fcb01b8a7eed-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.375749 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.375666 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/127cdd83-4138-4109-a8ba-fcb01b8a7eed-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.375749 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.375686 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/127cdd83-4138-4109-a8ba-fcb01b8a7eed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.375835 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.375757 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/127cdd83-4138-4109-a8ba-fcb01b8a7eed-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.375835 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.375786 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/127cdd83-4138-4109-a8ba-fcb01b8a7eed-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.375903 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.375829 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/127cdd83-4138-4109-a8ba-fcb01b8a7eed-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.375938 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.375907 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/127cdd83-4138-4109-a8ba-fcb01b8a7eed-config-out\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.376004 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.375936 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/127cdd83-4138-4109-a8ba-fcb01b8a7eed-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.376057 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.376027 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/127cdd83-4138-4109-a8ba-fcb01b8a7eed-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.376057 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.376044 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/127cdd83-4138-4109-a8ba-fcb01b8a7eed-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.376131 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.376082 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/127cdd83-4138-4109-a8ba-fcb01b8a7eed-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.376131 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.376100 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/127cdd83-4138-4109-a8ba-fcb01b8a7eed-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.376131 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.376118 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crzsb\" (UniqueName: \"kubernetes.io/projected/127cdd83-4138-4109-a8ba-fcb01b8a7eed-kube-api-access-crzsb\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.376247 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.376232 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/127cdd83-4138-4109-a8ba-fcb01b8a7eed-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.376294 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.376260 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/127cdd83-4138-4109-a8ba-fcb01b8a7eed-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.376342 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.376329 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/127cdd83-4138-4109-a8ba-fcb01b8a7eed-web-config\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.376521 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.376502 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/127cdd83-4138-4109-a8ba-fcb01b8a7eed-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.376554 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.376540 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/127cdd83-4138-4109-a8ba-fcb01b8a7eed-config\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.376586 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.376564 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/127cdd83-4138-4109-a8ba-fcb01b8a7eed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.376665 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.376644 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/127cdd83-4138-4109-a8ba-fcb01b8a7eed-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.477643 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.477617 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/127cdd83-4138-4109-a8ba-fcb01b8a7eed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.477760 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.477648 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/127cdd83-4138-4109-a8ba-fcb01b8a7eed-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.477760 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.477665 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/127cdd83-4138-4109-a8ba-fcb01b8a7eed-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.477760 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.477681 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/127cdd83-4138-4109-a8ba-fcb01b8a7eed-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.477760 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.477709 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/127cdd83-4138-4109-a8ba-fcb01b8a7eed-config-out\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.477760 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.477732 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/127cdd83-4138-4109-a8ba-fcb01b8a7eed-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.477760 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.477758 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/127cdd83-4138-4109-a8ba-fcb01b8a7eed-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.478041 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.477782 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/127cdd83-4138-4109-a8ba-fcb01b8a7eed-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.478041 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.477806 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/127cdd83-4138-4109-a8ba-fcb01b8a7eed-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.478321 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.478299 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/127cdd83-4138-4109-a8ba-fcb01b8a7eed-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.478441 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.478366 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/127cdd83-4138-4109-a8ba-fcb01b8a7eed-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.478441 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.478411 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/127cdd83-4138-4109-a8ba-fcb01b8a7eed-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.478441 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.478437 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crzsb\" (UniqueName: \"kubernetes.io/projected/127cdd83-4138-4109-a8ba-fcb01b8a7eed-kube-api-access-crzsb\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.478601 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.478465 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/127cdd83-4138-4109-a8ba-fcb01b8a7eed-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.478601 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.478469 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/127cdd83-4138-4109-a8ba-fcb01b8a7eed-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.478601 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.478530 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/127cdd83-4138-4109-a8ba-fcb01b8a7eed-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.478601 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.478588 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/127cdd83-4138-4109-a8ba-fcb01b8a7eed-web-config\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.478798 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.478620 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/127cdd83-4138-4109-a8ba-fcb01b8a7eed-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.478798 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.478652 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/127cdd83-4138-4109-a8ba-fcb01b8a7eed-config\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.478798 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.478675 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/127cdd83-4138-4109-a8ba-fcb01b8a7eed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.478798 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.478707 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/127cdd83-4138-4109-a8ba-fcb01b8a7eed-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.478798 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.478742 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/127cdd83-4138-4109-a8ba-fcb01b8a7eed-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.478798 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.478769 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/127cdd83-4138-4109-a8ba-fcb01b8a7eed-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.479104 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.478996 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/127cdd83-4138-4109-a8ba-fcb01b8a7eed-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.479798 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.479773 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/127cdd83-4138-4109-a8ba-fcb01b8a7eed-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.480612 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.480583 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/127cdd83-4138-4109-a8ba-fcb01b8a7eed-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.480814 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.480791 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/127cdd83-4138-4109-a8ba-fcb01b8a7eed-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.480871 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.480815 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/127cdd83-4138-4109-a8ba-fcb01b8a7eed-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.480871 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.480824 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/127cdd83-4138-4109-a8ba-fcb01b8a7eed-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.481606 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.481262 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/127cdd83-4138-4109-a8ba-fcb01b8a7eed-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.481606 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.481295 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/127cdd83-4138-4109-a8ba-fcb01b8a7eed-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.482021 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.481932 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/127cdd83-4138-4109-a8ba-fcb01b8a7eed-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.482021 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.481940 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/127cdd83-4138-4109-a8ba-fcb01b8a7eed-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.482669 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.482638 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/127cdd83-4138-4109-a8ba-fcb01b8a7eed-config\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.483012 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.482984 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/127cdd83-4138-4109-a8ba-fcb01b8a7eed-config-out\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.483103 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.483030 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/127cdd83-4138-4109-a8ba-fcb01b8a7eed-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.483302 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.483282 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/127cdd83-4138-4109-a8ba-fcb01b8a7eed-web-config\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.483302 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.483292 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/127cdd83-4138-4109-a8ba-fcb01b8a7eed-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.483572 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.483553 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/127cdd83-4138-4109-a8ba-fcb01b8a7eed-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.494442 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.494426 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crzsb\" (UniqueName: \"kubernetes.io/projected/127cdd83-4138-4109-a8ba-fcb01b8a7eed-kube-api-access-crzsb\") pod \"prometheus-k8s-0\" (UID: \"127cdd83-4138-4109-a8ba-fcb01b8a7eed\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.635738 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.635710 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:33:51.775452 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:51.775423 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 10 14:33:51.777130 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:33:51.777099 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod127cdd83_4138_4109_a8ba_fcb01b8a7eed.slice/crio-68f74f6bfd2ec25375cbdbf73fe433bd9edef80527828249659cc13e5ae227f9 WatchSource:0}: Error finding container 68f74f6bfd2ec25375cbdbf73fe433bd9edef80527828249659cc13e5ae227f9: Status 404 returned error can't find the container with id 68f74f6bfd2ec25375cbdbf73fe433bd9edef80527828249659cc13e5ae227f9 Jul 10 14:33:52.262389 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:52.262358 2571 generic.go:356] "Generic (PLEG): container finished" podID="127cdd83-4138-4109-a8ba-fcb01b8a7eed" containerID="cd97f6babbe8fed0912f3c42b4ac1d7e86bd84ac521b0e4008426416df0b7e07" exitCode=0 Jul 10 14:33:52.262778 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:52.262446 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"127cdd83-4138-4109-a8ba-fcb01b8a7eed","Type":"ContainerDied","Data":"cd97f6babbe8fed0912f3c42b4ac1d7e86bd84ac521b0e4008426416df0b7e07"} Jul 10 14:33:52.262778 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:52.262529 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"127cdd83-4138-4109-a8ba-fcb01b8a7eed","Type":"ContainerStarted","Data":"68f74f6bfd2ec25375cbdbf73fe433bd9edef80527828249659cc13e5ae227f9"} Jul 10 14:33:52.464569 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:52.464472 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4b49723-ad26-4643-8531-0612a454b10c" path="/var/lib/kubelet/pods/c4b49723-ad26-4643-8531-0612a454b10c/volumes" Jul 10 14:33:53.275979 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:53.275932 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"127cdd83-4138-4109-a8ba-fcb01b8a7eed","Type":"ContainerStarted","Data":"e75eaecdd34507d8f63c87d85a3eb1966acacca93918dc9b9440455898e2eb04"} Jul 10 14:33:53.276392 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:53.276059 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"127cdd83-4138-4109-a8ba-fcb01b8a7eed","Type":"ContainerStarted","Data":"8336d0cb17da83d0e80195242c6ebf3b2ec55971fd717419e3263e264a4005e5"} Jul 10 14:33:53.276392 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:53.276104 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"127cdd83-4138-4109-a8ba-fcb01b8a7eed","Type":"ContainerStarted","Data":"11c5ea88c04caa7bcd31ee332a8fd508773cfed64ebc61501a73bdf2a9ecf3c9"} Jul 10 14:33:53.276392 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:53.276147 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"127cdd83-4138-4109-a8ba-fcb01b8a7eed","Type":"ContainerStarted","Data":"9ddb6a247cf1cff41f5dee76453a6371e56597cad993f4001e24976becb372aa"} Jul 10 14:33:53.276392 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:53.276182 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"127cdd83-4138-4109-a8ba-fcb01b8a7eed","Type":"ContainerStarted","Data":"56da9df26ab3a2e07ffa7b258b6653e1a2e0f816fbb1424d835ff054e02ad969"} Jul 10 14:33:53.276392 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:53.276222 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"127cdd83-4138-4109-a8ba-fcb01b8a7eed","Type":"ContainerStarted","Data":"ef9b3ba4ce25fa3c17bdf10083344b33cb7c928acf4fd58da76fb4e2ec034438"} Jul 10 14:33:53.307743 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:53.307693 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.288559249 podStartE2EDuration="2.307679647s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.120398ms" isStatefulPod=false podCreationTimestamp="2026-07-10 14:33:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:33:53.306898163 +0000 UTC m=+151.384559721" watchObservedRunningTime="2026-07-10 14:33:53.307679647 +0000 UTC m=+151.385341230" Jul 10 14:33:54.281307 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:54.281270 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84599b86b6-5vt2d" event={"ID":"a598e8d8-ceee-4f31-9597-e6a2f6d39685","Type":"ContainerStarted","Data":"ce7ed39b06c33634fce38dafc9f9ce07a7febf12d5c74dfb4ab623fb8ae31ead"} Jul 10 14:33:54.281703 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:54.281339 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84599b86b6-5vt2d" event={"ID":"a598e8d8-ceee-4f31-9597-e6a2f6d39685","Type":"ContainerStarted","Data":"1354857c48660ab0e6b8973a645dbd63125c85ed0ec5eebdbb215c8875eb25b6"} Jul 10 14:33:54.281703 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:54.281360 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-84599b86b6-5vt2d" event={"ID":"a598e8d8-ceee-4f31-9597-e6a2f6d39685","Type":"ContainerStarted","Data":"6945a9b96a23aac804b0bbf03b688649f2f71056fd2f76ef81060dcd555472ab"} Jul 10 14:33:54.305741 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:54.305693 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-84599b86b6-5vt2d" podStartSLOduration=1.879068308 podStartE2EDuration="4.305678787s" totalImagesPullingTime="2.426610479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:33:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:33:54.304677529 +0000 UTC m=+152.382339072" watchObservedRunningTime="2026-07-10 14:33:54.305678787 +0000 UTC m=+152.383340332" Jul 10 14:33:56.636184 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:33:56.636151 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:34:51.636297 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:34:51.636265 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:34:51.651364 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:34:51.651339 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:34:52.522754 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:34:52.522727 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 10 14:36:22.314616 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:36:22.314583 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7clbv_b7c12f35-7b1f-4341-9302-0dfe837776f8/ovn-acl-logging/0.log" Jul 10 14:36:22.319525 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:36:22.319503 2571 kubelet.go:1648] "Image garbage collection succeeded" Jul 10 14:36:22.321227 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:36:22.321207 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7clbv_b7c12f35-7b1f-4341-9302-0dfe837776f8/ovn-acl-logging/0.log" Jul 10 14:36:50.784236 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:36:50.784202 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dbsdx"] Jul 10 14:36:50.787436 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:36:50.787421 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dbsdx" Jul 10 14:36:50.789708 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:36:50.789690 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 10 14:36:50.790869 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:36:50.790853 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 10 14:36:50.790961 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:36:50.790886 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-zck9r\"" Jul 10 14:36:50.795636 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:36:50.795613 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dbsdx"] Jul 10 14:36:50.878876 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:36:50.878845 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73ac9da1-f6bd-48d9-a615-de88d2614e77-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dbsdx\" (UID: \"73ac9da1-f6bd-48d9-a615-de88d2614e77\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dbsdx" Jul 10 14:36:50.879034 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:36:50.878889 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5pxr\" (UniqueName: \"kubernetes.io/projected/73ac9da1-f6bd-48d9-a615-de88d2614e77-kube-api-access-m5pxr\") pod \"openshift-lws-operator-fd8ccff4c-dbsdx\" (UID: \"73ac9da1-f6bd-48d9-a615-de88d2614e77\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dbsdx" Jul 10 14:36:50.979385 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:36:50.979356 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73ac9da1-f6bd-48d9-a615-de88d2614e77-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dbsdx\" (UID: \"73ac9da1-f6bd-48d9-a615-de88d2614e77\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dbsdx" Jul 10 14:36:50.979508 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:36:50.979414 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5pxr\" (UniqueName: \"kubernetes.io/projected/73ac9da1-f6bd-48d9-a615-de88d2614e77-kube-api-access-m5pxr\") pod \"openshift-lws-operator-fd8ccff4c-dbsdx\" (UID: \"73ac9da1-f6bd-48d9-a615-de88d2614e77\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dbsdx" Jul 10 14:36:50.979666 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:36:50.979647 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73ac9da1-f6bd-48d9-a615-de88d2614e77-tmp\") pod \"openshift-lws-operator-fd8ccff4c-dbsdx\" (UID: \"73ac9da1-f6bd-48d9-a615-de88d2614e77\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dbsdx" Jul 10 14:36:50.987231 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:36:50.987201 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5pxr\" (UniqueName: \"kubernetes.io/projected/73ac9da1-f6bd-48d9-a615-de88d2614e77-kube-api-access-m5pxr\") pod \"openshift-lws-operator-fd8ccff4c-dbsdx\" (UID: \"73ac9da1-f6bd-48d9-a615-de88d2614e77\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dbsdx" Jul 10 14:36:51.107183 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:36:51.107118 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dbsdx" Jul 10 14:36:51.228222 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:36:51.228155 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dbsdx"] Jul 10 14:36:51.231022 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:36:51.230997 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73ac9da1_f6bd_48d9_a615_de88d2614e77.slice/crio-c65a08be573e4862b24d78366ae7d167838ec00dccb9071a0be27eac08bf5081 WatchSource:0}: Error finding container c65a08be573e4862b24d78366ae7d167838ec00dccb9071a0be27eac08bf5081: Status 404 returned error can't find the container with id c65a08be573e4862b24d78366ae7d167838ec00dccb9071a0be27eac08bf5081 Jul 10 14:36:51.233020 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:36:51.233002 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 14:36:51.948940 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:36:51.948897 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dbsdx" event={"ID":"73ac9da1-f6bd-48d9-a615-de88d2614e77","Type":"ContainerStarted","Data":"c65a08be573e4862b24d78366ae7d167838ec00dccb9071a0be27eac08bf5081"} Jul 10 14:36:53.959311 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:36:53.959277 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dbsdx" event={"ID":"73ac9da1-f6bd-48d9-a615-de88d2614e77","Type":"ContainerStarted","Data":"079ece05452d51f7a83f9e6cfb36513c72f5f68e83e8757fd63c551d7010e6a1"} Jul 10 14:36:53.984136 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:36:53.984087 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-dbsdx" podStartSLOduration=1.449767269 podStartE2EDuration="3.984072632s" totalImagesPullingTime="2.534305363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:36:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:36:53.982336165 +0000 UTC m=+332.059997710" watchObservedRunningTime="2026-07-10 14:36:53.984072632 +0000 UTC m=+332.061734177" Jul 10 14:37:12.432110 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:12.432080 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-547957cd78-zsm5q"] Jul 10 14:37:12.435612 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:12.435593 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-zsm5q" Jul 10 14:37:12.437906 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:12.437888 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 10 14:37:12.438407 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:12.438385 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 10 14:37:12.438497 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:12.438414 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 10 14:37:12.438497 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:12.438472 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6fv7g\"" Jul 10 14:37:12.438772 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:12.438754 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 10 14:37:12.456647 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:12.456613 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-547957cd78-zsm5q"] Jul 10 14:37:12.558582 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:12.558550 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287-manifests\") pod \"opendatahub-operator-controller-manager-547957cd78-zsm5q\" (UID: \"7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287\") " pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-zsm5q" Jul 10 14:37:12.558735 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:12.558619 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287-webhook-cert\") pod \"opendatahub-operator-controller-manager-547957cd78-zsm5q\" (UID: \"7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287\") " pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-zsm5q" Jul 10 14:37:12.558735 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:12.558642 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287-tmp\") pod \"opendatahub-operator-controller-manager-547957cd78-zsm5q\" (UID: \"7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287\") " pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-zsm5q" Jul 10 14:37:12.558735 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:12.558657 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8x5zx\" (UniqueName: \"kubernetes.io/projected/7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287-kube-api-access-8x5zx\") pod \"opendatahub-operator-controller-manager-547957cd78-zsm5q\" (UID: \"7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287\") " pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-zsm5q" Jul 10 14:37:12.558735 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:12.558688 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287-apiservice-cert\") pod \"opendatahub-operator-controller-manager-547957cd78-zsm5q\" (UID: \"7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287\") " pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-zsm5q" Jul 10 14:37:12.660113 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:12.660070 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287-webhook-cert\") pod \"opendatahub-operator-controller-manager-547957cd78-zsm5q\" (UID: \"7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287\") " pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-zsm5q" Jul 10 14:37:12.660113 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:12.660118 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287-tmp\") pod \"opendatahub-operator-controller-manager-547957cd78-zsm5q\" (UID: \"7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287\") " pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-zsm5q" Jul 10 14:37:12.660320 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:12.660233 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8x5zx\" (UniqueName: \"kubernetes.io/projected/7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287-kube-api-access-8x5zx\") pod \"opendatahub-operator-controller-manager-547957cd78-zsm5q\" (UID: \"7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287\") " pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-zsm5q" Jul 10 14:37:12.660320 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:12.660285 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287-apiservice-cert\") pod \"opendatahub-operator-controller-manager-547957cd78-zsm5q\" (UID: \"7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287\") " pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-zsm5q" Jul 10 14:37:12.660383 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:12.660331 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287-manifests\") pod \"opendatahub-operator-controller-manager-547957cd78-zsm5q\" (UID: \"7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287\") " pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-zsm5q" Jul 10 14:37:12.660676 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:12.660652 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287-manifests\") pod \"opendatahub-operator-controller-manager-547957cd78-zsm5q\" (UID: \"7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287\") " pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-zsm5q" Jul 10 14:37:12.662498 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:12.662475 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287-tmp\") pod \"opendatahub-operator-controller-manager-547957cd78-zsm5q\" (UID: \"7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287\") " pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-zsm5q" Jul 10 14:37:12.662714 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:12.662695 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287-webhook-cert\") pod \"opendatahub-operator-controller-manager-547957cd78-zsm5q\" (UID: \"7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287\") " pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-zsm5q" Jul 10 14:37:12.662758 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:12.662695 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287-apiservice-cert\") pod \"opendatahub-operator-controller-manager-547957cd78-zsm5q\" (UID: \"7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287\") " pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-zsm5q" Jul 10 14:37:12.668196 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:12.668176 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8x5zx\" (UniqueName: \"kubernetes.io/projected/7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287-kube-api-access-8x5zx\") pod \"opendatahub-operator-controller-manager-547957cd78-zsm5q\" (UID: \"7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287\") " pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-zsm5q" Jul 10 14:37:12.745262 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:12.745226 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-zsm5q" Jul 10 14:37:12.880799 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:12.880756 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-547957cd78-zsm5q"] Jul 10 14:37:12.885339 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:37:12.885312 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a1e9cf9_a480_4bb5_a6fe_b5d6161e0287.slice/crio-016a0343a86c3c2b8e4d50800ba364b26b49396afcf82ce23c096a31e9a5548f WatchSource:0}: Error finding container 016a0343a86c3c2b8e4d50800ba364b26b49396afcf82ce23c096a31e9a5548f: Status 404 returned error can't find the container with id 016a0343a86c3c2b8e4d50800ba364b26b49396afcf82ce23c096a31e9a5548f Jul 10 14:37:13.034617 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:13.034532 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-zsm5q" event={"ID":"7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287","Type":"ContainerStarted","Data":"016a0343a86c3c2b8e4d50800ba364b26b49396afcf82ce23c096a31e9a5548f"} Jul 10 14:37:17.053047 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:17.053010 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-zsm5q" event={"ID":"7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287","Type":"ContainerStarted","Data":"2053a9664ee76a5b7266315e7122f8e68743485ab5f46750a5ddf4cb58f7c5f5"} Jul 10 14:37:18.058137 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:18.058101 2571 generic.go:356] "Generic (PLEG): container finished" podID="7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287" containerID="2053a9664ee76a5b7266315e7122f8e68743485ab5f46750a5ddf4cb58f7c5f5" exitCode=0 Jul 10 14:37:18.058507 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:18.058188 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-zsm5q" event={"ID":"7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287","Type":"ContainerDied","Data":"2053a9664ee76a5b7266315e7122f8e68743485ab5f46750a5ddf4cb58f7c5f5"} Jul 10 14:37:19.063919 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:19.063882 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-zsm5q" event={"ID":"7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287","Type":"ContainerStarted","Data":"cb843c61f51a90075607ef61dbfdff4cf26ceb53d63fd806ca2ccfd7031da792"} Jul 10 14:37:19.064335 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:19.064022 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-zsm5q" Jul 10 14:37:19.087335 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:19.087283 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-zsm5q" podStartSLOduration=2.491495733 podStartE2EDuration="7.087265521s" totalImagesPullingTime="3.444495642s" totalInitContainerRuntime="1.151274146s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:37:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:37:19.085534703 +0000 UTC m=+357.163196249" watchObservedRunningTime="2026-07-10 14:37:19.087265521 +0000 UTC m=+357.164927136" Jul 10 14:37:30.070416 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:30.070388 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-547957cd78-zsm5q" Jul 10 14:37:37.912452 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:37.912417 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-65d766598b-q9plf"] Jul 10 14:37:37.924623 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:37.924602 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65d766598b-q9plf" Jul 10 14:37:37.927385 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:37.927365 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-dgddf\"" Jul 10 14:37:37.927509 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:37.927466 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 10 14:37:37.927509 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:37.927466 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 10 14:37:37.928386 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:37.928365 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 10 14:37:37.928482 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:37.928404 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 10 14:37:37.933074 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:37.933053 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65d766598b-q9plf"] Jul 10 14:37:37.962902 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:37.962883 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adb3da3b-85b5-4dd4-a21f-af7d50e5e1ae-tls-certs\") pod \"kube-auth-proxy-65d766598b-q9plf\" (UID: \"adb3da3b-85b5-4dd4-a21f-af7d50e5e1ae\") " pod="openshift-ingress/kube-auth-proxy-65d766598b-q9plf" Jul 10 14:37:37.963021 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:37.962919 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adb3da3b-85b5-4dd4-a21f-af7d50e5e1ae-tmp\") pod \"kube-auth-proxy-65d766598b-q9plf\" (UID: \"adb3da3b-85b5-4dd4-a21f-af7d50e5e1ae\") " pod="openshift-ingress/kube-auth-proxy-65d766598b-q9plf" Jul 10 14:37:37.963021 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:37.962964 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5cj4\" (UniqueName: \"kubernetes.io/projected/adb3da3b-85b5-4dd4-a21f-af7d50e5e1ae-kube-api-access-k5cj4\") pod \"kube-auth-proxy-65d766598b-q9plf\" (UID: \"adb3da3b-85b5-4dd4-a21f-af7d50e5e1ae\") " pod="openshift-ingress/kube-auth-proxy-65d766598b-q9plf" Jul 10 14:37:38.063592 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:38.063568 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5cj4\" (UniqueName: \"kubernetes.io/projected/adb3da3b-85b5-4dd4-a21f-af7d50e5e1ae-kube-api-access-k5cj4\") pod \"kube-auth-proxy-65d766598b-q9plf\" (UID: \"adb3da3b-85b5-4dd4-a21f-af7d50e5e1ae\") " pod="openshift-ingress/kube-auth-proxy-65d766598b-q9plf" Jul 10 14:37:38.063729 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:38.063615 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adb3da3b-85b5-4dd4-a21f-af7d50e5e1ae-tls-certs\") pod \"kube-auth-proxy-65d766598b-q9plf\" (UID: \"adb3da3b-85b5-4dd4-a21f-af7d50e5e1ae\") " pod="openshift-ingress/kube-auth-proxy-65d766598b-q9plf" Jul 10 14:37:38.063770 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:38.063733 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adb3da3b-85b5-4dd4-a21f-af7d50e5e1ae-tmp\") pod \"kube-auth-proxy-65d766598b-q9plf\" (UID: \"adb3da3b-85b5-4dd4-a21f-af7d50e5e1ae\") " pod="openshift-ingress/kube-auth-proxy-65d766598b-q9plf" Jul 10 14:37:38.065845 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:38.065826 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/adb3da3b-85b5-4dd4-a21f-af7d50e5e1ae-tmp\") pod \"kube-auth-proxy-65d766598b-q9plf\" (UID: \"adb3da3b-85b5-4dd4-a21f-af7d50e5e1ae\") " pod="openshift-ingress/kube-auth-proxy-65d766598b-q9plf" Jul 10 14:37:38.066003 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:38.065984 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/adb3da3b-85b5-4dd4-a21f-af7d50e5e1ae-tls-certs\") pod \"kube-auth-proxy-65d766598b-q9plf\" (UID: \"adb3da3b-85b5-4dd4-a21f-af7d50e5e1ae\") " pod="openshift-ingress/kube-auth-proxy-65d766598b-q9plf" Jul 10 14:37:38.076775 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:38.076753 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5cj4\" (UniqueName: \"kubernetes.io/projected/adb3da3b-85b5-4dd4-a21f-af7d50e5e1ae-kube-api-access-k5cj4\") pod \"kube-auth-proxy-65d766598b-q9plf\" (UID: \"adb3da3b-85b5-4dd4-a21f-af7d50e5e1ae\") " pod="openshift-ingress/kube-auth-proxy-65d766598b-q9plf" Jul 10 14:37:38.235079 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:38.235045 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-65d766598b-q9plf" Jul 10 14:37:38.362115 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:38.362091 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-65d766598b-q9plf"] Jul 10 14:37:38.364316 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:37:38.364291 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadb3da3b_85b5_4dd4_a21f_af7d50e5e1ae.slice/crio-1ced996607275a6a0998e24ed3e1ee12c6a73c95aeffa49b777e15a113dff858 WatchSource:0}: Error finding container 1ced996607275a6a0998e24ed3e1ee12c6a73c95aeffa49b777e15a113dff858: Status 404 returned error can't find the container with id 1ced996607275a6a0998e24ed3e1ee12c6a73c95aeffa49b777e15a113dff858 Jul 10 14:37:39.143103 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:39.143070 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65d766598b-q9plf" event={"ID":"adb3da3b-85b5-4dd4-a21f-af7d50e5e1ae","Type":"ContainerStarted","Data":"1ced996607275a6a0998e24ed3e1ee12c6a73c95aeffa49b777e15a113dff858"} Jul 10 14:37:42.158322 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:42.158288 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-65d766598b-q9plf" event={"ID":"adb3da3b-85b5-4dd4-a21f-af7d50e5e1ae","Type":"ContainerStarted","Data":"461203b59e5507e69cfe1143159d58411b26c18a730e97651e56bcabfaaf8a88"} Jul 10 14:37:42.173772 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:42.173715 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-65d766598b-q9plf" podStartSLOduration=1.953220553 podStartE2EDuration="5.173700838s" totalImagesPullingTime="3.220480285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:37:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:37:42.173211028 +0000 UTC m=+380.250872573" watchObservedRunningTime="2026-07-10 14:37:42.173700838 +0000 UTC m=+380.251362417" Jul 10 14:37:45.074615 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:45.074580 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgg58"] Jul 10 14:37:45.076657 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:45.076642 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgg58" Jul 10 14:37:45.080564 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:45.080545 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 10 14:37:45.080667 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:45.080547 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 10 14:37:45.080667 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:45.080545 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 10 14:37:45.080667 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:45.080658 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-vktqs\"" Jul 10 14:37:45.081084 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:45.081068 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 10 14:37:45.093698 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:45.093677 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgg58"] Jul 10 14:37:45.129475 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:45.129450 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/393ed4f2-6eb7-4710-8319-cb8ccf5a2b56-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-xgg58\" (UID: \"393ed4f2-6eb7-4710-8319-cb8ccf5a2b56\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgg58" Jul 10 14:37:45.129593 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:45.129482 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/393ed4f2-6eb7-4710-8319-cb8ccf5a2b56-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-xgg58\" (UID: \"393ed4f2-6eb7-4710-8319-cb8ccf5a2b56\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgg58" Jul 10 14:37:45.129593 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:45.129505 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/393ed4f2-6eb7-4710-8319-cb8ccf5a2b56-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-xgg58\" (UID: \"393ed4f2-6eb7-4710-8319-cb8ccf5a2b56\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgg58" Jul 10 14:37:45.129593 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:45.129541 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/393ed4f2-6eb7-4710-8319-cb8ccf5a2b56-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-xgg58\" (UID: \"393ed4f2-6eb7-4710-8319-cb8ccf5a2b56\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgg58" Jul 10 14:37:45.129593 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:45.129566 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/393ed4f2-6eb7-4710-8319-cb8ccf5a2b56-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-xgg58\" (UID: \"393ed4f2-6eb7-4710-8319-cb8ccf5a2b56\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgg58" Jul 10 14:37:45.129593 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:45.129585 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt6pg\" (UniqueName: \"kubernetes.io/projected/393ed4f2-6eb7-4710-8319-cb8ccf5a2b56-kube-api-access-jt6pg\") pod \"istiod-openshift-gateway-94bb8fbfd-xgg58\" (UID: \"393ed4f2-6eb7-4710-8319-cb8ccf5a2b56\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgg58" Jul 10 14:37:45.129778 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:45.129604 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/393ed4f2-6eb7-4710-8319-cb8ccf5a2b56-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-xgg58\" (UID: \"393ed4f2-6eb7-4710-8319-cb8ccf5a2b56\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgg58" Jul 10 14:37:45.230893 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:45.230870 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/393ed4f2-6eb7-4710-8319-cb8ccf5a2b56-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-xgg58\" (UID: \"393ed4f2-6eb7-4710-8319-cb8ccf5a2b56\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgg58" Jul 10 14:37:45.231049 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:45.230907 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/393ed4f2-6eb7-4710-8319-cb8ccf5a2b56-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-xgg58\" (UID: \"393ed4f2-6eb7-4710-8319-cb8ccf5a2b56\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgg58" Jul 10 14:37:45.231049 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:45.230925 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/393ed4f2-6eb7-4710-8319-cb8ccf5a2b56-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-xgg58\" (UID: \"393ed4f2-6eb7-4710-8319-cb8ccf5a2b56\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgg58" Jul 10 14:37:45.231049 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:45.230944 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt6pg\" (UniqueName: \"kubernetes.io/projected/393ed4f2-6eb7-4710-8319-cb8ccf5a2b56-kube-api-access-jt6pg\") pod \"istiod-openshift-gateway-94bb8fbfd-xgg58\" (UID: \"393ed4f2-6eb7-4710-8319-cb8ccf5a2b56\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgg58" Jul 10 14:37:45.231049 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:45.231010 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/393ed4f2-6eb7-4710-8319-cb8ccf5a2b56-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-xgg58\" (UID: \"393ed4f2-6eb7-4710-8319-cb8ccf5a2b56\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgg58" Jul 10 14:37:45.231260 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:45.231088 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/393ed4f2-6eb7-4710-8319-cb8ccf5a2b56-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-xgg58\" (UID: \"393ed4f2-6eb7-4710-8319-cb8ccf5a2b56\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgg58" Jul 10 14:37:45.231260 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:45.231115 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/393ed4f2-6eb7-4710-8319-cb8ccf5a2b56-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-xgg58\" (UID: \"393ed4f2-6eb7-4710-8319-cb8ccf5a2b56\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgg58" Jul 10 14:37:45.232220 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:45.232190 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/393ed4f2-6eb7-4710-8319-cb8ccf5a2b56-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-xgg58\" (UID: \"393ed4f2-6eb7-4710-8319-cb8ccf5a2b56\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgg58" Jul 10 14:37:45.238066 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:45.238035 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/393ed4f2-6eb7-4710-8319-cb8ccf5a2b56-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-xgg58\" (UID: \"393ed4f2-6eb7-4710-8319-cb8ccf5a2b56\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgg58" Jul 10 14:37:45.238176 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:45.238107 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/393ed4f2-6eb7-4710-8319-cb8ccf5a2b56-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-xgg58\" (UID: \"393ed4f2-6eb7-4710-8319-cb8ccf5a2b56\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgg58" Jul 10 14:37:45.238239 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:45.238183 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/393ed4f2-6eb7-4710-8319-cb8ccf5a2b56-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-xgg58\" (UID: \"393ed4f2-6eb7-4710-8319-cb8ccf5a2b56\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgg58" Jul 10 14:37:45.238383 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:45.238362 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/393ed4f2-6eb7-4710-8319-cb8ccf5a2b56-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-xgg58\" (UID: \"393ed4f2-6eb7-4710-8319-cb8ccf5a2b56\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgg58" Jul 10 14:37:45.245017 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:45.244994 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/393ed4f2-6eb7-4710-8319-cb8ccf5a2b56-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-xgg58\" (UID: \"393ed4f2-6eb7-4710-8319-cb8ccf5a2b56\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgg58" Jul 10 14:37:45.248294 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:45.248274 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt6pg\" (UniqueName: \"kubernetes.io/projected/393ed4f2-6eb7-4710-8319-cb8ccf5a2b56-kube-api-access-jt6pg\") pod \"istiod-openshift-gateway-94bb8fbfd-xgg58\" (UID: \"393ed4f2-6eb7-4710-8319-cb8ccf5a2b56\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgg58" Jul 10 14:37:45.385939 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:45.385883 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgg58" Jul 10 14:37:45.517050 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:45.517022 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgg58"] Jul 10 14:37:45.518662 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:37:45.518638 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod393ed4f2_6eb7_4710_8319_cb8ccf5a2b56.slice/crio-313d1f5c81e0a744b0108e0e7e35f49c3dfadf310439e16b3d7a11f89d388d8e WatchSource:0}: Error finding container 313d1f5c81e0a744b0108e0e7e35f49c3dfadf310439e16b3d7a11f89d388d8e: Status 404 returned error can't find the container with id 313d1f5c81e0a744b0108e0e7e35f49c3dfadf310439e16b3d7a11f89d388d8e Jul 10 14:37:46.177226 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:46.177182 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgg58" event={"ID":"393ed4f2-6eb7-4710-8319-cb8ccf5a2b56","Type":"ContainerStarted","Data":"313d1f5c81e0a744b0108e0e7e35f49c3dfadf310439e16b3d7a11f89d388d8e"} Jul 10 14:37:47.584182 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:47.583523 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 14:37:47.584182 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:47.583612 2571 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 10 14:37:48.188814 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:48.188776 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgg58" event={"ID":"393ed4f2-6eb7-4710-8319-cb8ccf5a2b56","Type":"ContainerStarted","Data":"a134311e7deb5654163349ad2971f40fe89e2b5624672ecac49ec70fde8249c9"} Jul 10 14:37:48.188992 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:48.188956 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgg58" Jul 10 14:37:48.190568 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:48.190542 2571 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-xgg58 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 10 14:37:48.190696 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:48.190588 2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgg58" podUID="393ed4f2-6eb7-4710-8319-cb8ccf5a2b56" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 10 14:37:48.252732 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:48.252689 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-d76757ddd-4qlp6"] Jul 10 14:37:48.252897 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:48.252771 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgg58" podStartSLOduration=1.190152482 podStartE2EDuration="3.252754532s" totalImagesPullingTime="2.06260205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:37:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:37:48.24909174 +0000 UTC m=+386.326753287" watchObservedRunningTime="2026-07-10 14:37:48.252754532 +0000 UTC m=+386.330416076" Jul 10 14:37:48.255761 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:48.255722 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d76757ddd-4qlp6" Jul 10 14:37:48.266392 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:48.266368 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 10 14:37:48.266504 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:48.266401 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 10 14:37:48.266570 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:48.266533 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-4sp6c\"" Jul 10 14:37:48.266732 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:48.266720 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 10 14:37:48.295897 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:48.295875 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d76757ddd-4qlp6"] Jul 10 14:37:48.358963 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:48.358927 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0f99d889-8c56-487e-93eb-7b2f45714ae7-manager-config\") pod \"lws-controller-manager-d76757ddd-4qlp6\" (UID: \"0f99d889-8c56-487e-93eb-7b2f45714ae7\") " pod="openshift-lws-operator/lws-controller-manager-d76757ddd-4qlp6" Jul 10 14:37:48.359113 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:48.359021 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f99d889-8c56-487e-93eb-7b2f45714ae7-cert\") pod \"lws-controller-manager-d76757ddd-4qlp6\" (UID: \"0f99d889-8c56-487e-93eb-7b2f45714ae7\") " pod="openshift-lws-operator/lws-controller-manager-d76757ddd-4qlp6" Jul 10 14:37:48.359113 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:48.359088 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f99d889-8c56-487e-93eb-7b2f45714ae7-metrics-cert\") pod \"lws-controller-manager-d76757ddd-4qlp6\" (UID: \"0f99d889-8c56-487e-93eb-7b2f45714ae7\") " pod="openshift-lws-operator/lws-controller-manager-d76757ddd-4qlp6" Jul 10 14:37:48.359113 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:48.359109 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jwvc\" (UniqueName: \"kubernetes.io/projected/0f99d889-8c56-487e-93eb-7b2f45714ae7-kube-api-access-2jwvc\") pod \"lws-controller-manager-d76757ddd-4qlp6\" (UID: \"0f99d889-8c56-487e-93eb-7b2f45714ae7\") " pod="openshift-lws-operator/lws-controller-manager-d76757ddd-4qlp6" Jul 10 14:37:48.460004 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:48.459891 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f99d889-8c56-487e-93eb-7b2f45714ae7-cert\") pod \"lws-controller-manager-d76757ddd-4qlp6\" (UID: \"0f99d889-8c56-487e-93eb-7b2f45714ae7\") " pod="openshift-lws-operator/lws-controller-manager-d76757ddd-4qlp6" Jul 10 14:37:48.460293 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:48.460274 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f99d889-8c56-487e-93eb-7b2f45714ae7-metrics-cert\") pod \"lws-controller-manager-d76757ddd-4qlp6\" (UID: \"0f99d889-8c56-487e-93eb-7b2f45714ae7\") " pod="openshift-lws-operator/lws-controller-manager-d76757ddd-4qlp6" Jul 10 14:37:48.460417 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:48.460402 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jwvc\" (UniqueName: \"kubernetes.io/projected/0f99d889-8c56-487e-93eb-7b2f45714ae7-kube-api-access-2jwvc\") pod \"lws-controller-manager-d76757ddd-4qlp6\" (UID: \"0f99d889-8c56-487e-93eb-7b2f45714ae7\") " pod="openshift-lws-operator/lws-controller-manager-d76757ddd-4qlp6" Jul 10 14:37:48.460565 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:48.460552 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0f99d889-8c56-487e-93eb-7b2f45714ae7-manager-config\") pod \"lws-controller-manager-d76757ddd-4qlp6\" (UID: \"0f99d889-8c56-487e-93eb-7b2f45714ae7\") " pod="openshift-lws-operator/lws-controller-manager-d76757ddd-4qlp6" Jul 10 14:37:48.461793 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:48.461766 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0f99d889-8c56-487e-93eb-7b2f45714ae7-manager-config\") pod \"lws-controller-manager-d76757ddd-4qlp6\" (UID: \"0f99d889-8c56-487e-93eb-7b2f45714ae7\") " pod="openshift-lws-operator/lws-controller-manager-d76757ddd-4qlp6" Jul 10 14:37:48.464309 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:48.464283 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0f99d889-8c56-487e-93eb-7b2f45714ae7-metrics-cert\") pod \"lws-controller-manager-d76757ddd-4qlp6\" (UID: \"0f99d889-8c56-487e-93eb-7b2f45714ae7\") " pod="openshift-lws-operator/lws-controller-manager-d76757ddd-4qlp6" Jul 10 14:37:48.464458 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:48.464437 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0f99d889-8c56-487e-93eb-7b2f45714ae7-cert\") pod \"lws-controller-manager-d76757ddd-4qlp6\" (UID: \"0f99d889-8c56-487e-93eb-7b2f45714ae7\") " pod="openshift-lws-operator/lws-controller-manager-d76757ddd-4qlp6" Jul 10 14:37:48.481201 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:48.481174 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jwvc\" (UniqueName: \"kubernetes.io/projected/0f99d889-8c56-487e-93eb-7b2f45714ae7-kube-api-access-2jwvc\") pod \"lws-controller-manager-d76757ddd-4qlp6\" (UID: \"0f99d889-8c56-487e-93eb-7b2f45714ae7\") " pod="openshift-lws-operator/lws-controller-manager-d76757ddd-4qlp6" Jul 10 14:37:48.567232 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:48.567209 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d76757ddd-4qlp6" Jul 10 14:37:48.715855 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:48.715832 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d76757ddd-4qlp6"] Jul 10 14:37:48.718192 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:37:48.718148 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f99d889_8c56_487e_93eb_7b2f45714ae7.slice/crio-47e577e7e7603950d5a8df4a7fd68b8d422f731279eb39d868243c4e668001c9 WatchSource:0}: Error finding container 47e577e7e7603950d5a8df4a7fd68b8d422f731279eb39d868243c4e668001c9: Status 404 returned error can't find the container with id 47e577e7e7603950d5a8df4a7fd68b8d422f731279eb39d868243c4e668001c9 Jul 10 14:37:49.194716 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:49.194685 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d76757ddd-4qlp6" event={"ID":"0f99d889-8c56-487e-93eb-7b2f45714ae7","Type":"ContainerStarted","Data":"47e577e7e7603950d5a8df4a7fd68b8d422f731279eb39d868243c4e668001c9"} Jul 10 14:37:49.195535 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:49.195516 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xgg58" Jul 10 14:37:51.205935 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:51.205898 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d76757ddd-4qlp6" event={"ID":"0f99d889-8c56-487e-93eb-7b2f45714ae7","Type":"ContainerStarted","Data":"6cfc628c86d14891f05812c8c17c3ca8d358209c118fc7c33d11d7f6a4863707"} Jul 10 14:37:51.206416 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:51.206029 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-d76757ddd-4qlp6" Jul 10 14:37:51.224628 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:37:51.224583 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-d76757ddd-4qlp6" podStartSLOduration=1.746818432 podStartE2EDuration="3.224569355s" totalImagesPullingTime="1.477750923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:37:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:37:51.22276007 +0000 UTC m=+389.300421615" watchObservedRunningTime="2026-07-10 14:37:51.224569355 +0000 UTC m=+389.302230972" Jul 10 14:38:02.211769 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:38:02.211742 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-d76757ddd-4qlp6" Jul 10 14:41:22.341868 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:41:22.341838 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7clbv_b7c12f35-7b1f-4341-9302-0dfe837776f8/ovn-acl-logging/0.log" Jul 10 14:41:22.346582 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:41:22.346563 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7clbv_b7c12f35-7b1f-4341-9302-0dfe837776f8/ovn-acl-logging/0.log" Jul 10 14:42:35.821346 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:35.821314 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5ghsv"] Jul 10 14:42:35.824635 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:35.824615 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5ghsv" Jul 10 14:42:35.828596 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:35.828576 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2dj76\"" Jul 10 14:42:35.828701 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:35.828616 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 10 14:42:35.828839 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:35.828827 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 10 14:42:35.828945 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:35.828927 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 10 14:42:35.840843 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:35.840824 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5ghsv"] Jul 10 14:42:35.927777 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:35.927751 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llv7w\" (UniqueName: \"kubernetes.io/projected/86f22a40-9f52-45c7-91bf-f77ff4ab4c99-kube-api-access-llv7w\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5ghsv\" (UID: \"86f22a40-9f52-45c7-91bf-f77ff4ab4c99\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5ghsv" Jul 10 14:42:35.927903 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:35.927783 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86f22a40-9f52-45c7-91bf-f77ff4ab4c99-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5ghsv\" (UID: \"86f22a40-9f52-45c7-91bf-f77ff4ab4c99\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5ghsv" Jul 10 14:42:35.927903 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:35.927811 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86f22a40-9f52-45c7-91bf-f77ff4ab4c99-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5ghsv\" (UID: \"86f22a40-9f52-45c7-91bf-f77ff4ab4c99\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5ghsv" Jul 10 14:42:35.928054 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:35.927900 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86f22a40-9f52-45c7-91bf-f77ff4ab4c99-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5ghsv\" (UID: \"86f22a40-9f52-45c7-91bf-f77ff4ab4c99\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5ghsv" Jul 10 14:42:35.928054 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:35.927925 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86f22a40-9f52-45c7-91bf-f77ff4ab4c99-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5ghsv\" (UID: \"86f22a40-9f52-45c7-91bf-f77ff4ab4c99\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5ghsv" Jul 10 14:42:35.928054 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:35.927984 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86f22a40-9f52-45c7-91bf-f77ff4ab4c99-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5ghsv\" (UID: \"86f22a40-9f52-45c7-91bf-f77ff4ab4c99\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5ghsv" Jul 10 14:42:36.029054 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:36.029024 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86f22a40-9f52-45c7-91bf-f77ff4ab4c99-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5ghsv\" (UID: \"86f22a40-9f52-45c7-91bf-f77ff4ab4c99\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5ghsv" Jul 10 14:42:36.029167 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:36.029081 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86f22a40-9f52-45c7-91bf-f77ff4ab4c99-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5ghsv\" (UID: \"86f22a40-9f52-45c7-91bf-f77ff4ab4c99\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5ghsv" Jul 10 14:42:36.029167 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:36.029106 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86f22a40-9f52-45c7-91bf-f77ff4ab4c99-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5ghsv\" (UID: \"86f22a40-9f52-45c7-91bf-f77ff4ab4c99\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5ghsv" Jul 10 14:42:36.029167 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:36.029154 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86f22a40-9f52-45c7-91bf-f77ff4ab4c99-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5ghsv\" (UID: \"86f22a40-9f52-45c7-91bf-f77ff4ab4c99\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5ghsv" Jul 10 14:42:36.029314 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:36.029195 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llv7w\" (UniqueName: \"kubernetes.io/projected/86f22a40-9f52-45c7-91bf-f77ff4ab4c99-kube-api-access-llv7w\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5ghsv\" (UID: \"86f22a40-9f52-45c7-91bf-f77ff4ab4c99\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5ghsv" Jul 10 14:42:36.029314 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:36.029221 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86f22a40-9f52-45c7-91bf-f77ff4ab4c99-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5ghsv\" (UID: \"86f22a40-9f52-45c7-91bf-f77ff4ab4c99\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5ghsv" Jul 10 14:42:36.029470 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:36.029452 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86f22a40-9f52-45c7-91bf-f77ff4ab4c99-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5ghsv\" (UID: \"86f22a40-9f52-45c7-91bf-f77ff4ab4c99\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5ghsv" Jul 10 14:42:36.029576 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:36.029563 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86f22a40-9f52-45c7-91bf-f77ff4ab4c99-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5ghsv\" (UID: \"86f22a40-9f52-45c7-91bf-f77ff4ab4c99\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5ghsv" Jul 10 14:42:36.029615 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:36.029578 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86f22a40-9f52-45c7-91bf-f77ff4ab4c99-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5ghsv\" (UID: \"86f22a40-9f52-45c7-91bf-f77ff4ab4c99\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5ghsv" Jul 10 14:42:36.031317 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:36.031298 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86f22a40-9f52-45c7-91bf-f77ff4ab4c99-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5ghsv\" (UID: \"86f22a40-9f52-45c7-91bf-f77ff4ab4c99\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5ghsv" Jul 10 14:42:36.031508 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:36.031491 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86f22a40-9f52-45c7-91bf-f77ff4ab4c99-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5ghsv\" (UID: \"86f22a40-9f52-45c7-91bf-f77ff4ab4c99\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5ghsv" Jul 10 14:42:36.039514 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:36.039496 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llv7w\" (UniqueName: \"kubernetes.io/projected/86f22a40-9f52-45c7-91bf-f77ff4ab4c99-kube-api-access-llv7w\") pod \"e2e-trlp-test-simulated-kserve-598466548d-5ghsv\" (UID: \"86f22a40-9f52-45c7-91bf-f77ff4ab4c99\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5ghsv" Jul 10 14:42:36.134637 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:36.134579 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5ghsv" Jul 10 14:42:36.277053 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:36.277026 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-5ghsv"] Jul 10 14:42:36.279447 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:42:36.279416 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86f22a40_9f52_45c7_91bf_f77ff4ab4c99.slice/crio-e1eec81dfc9e1b052cc25e070da812dc2dec2cfe84128b9cd679ca9076dbb437 WatchSource:0}: Error finding container e1eec81dfc9e1b052cc25e070da812dc2dec2cfe84128b9cd679ca9076dbb437: Status 404 returned error can't find the container with id e1eec81dfc9e1b052cc25e070da812dc2dec2cfe84128b9cd679ca9076dbb437 Jul 10 14:42:36.280815 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:36.280800 2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 10 14:42:36.426863 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:36.426796 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5ghsv" event={"ID":"86f22a40-9f52-45c7-91bf-f77ff4ab4c99","Type":"ContainerStarted","Data":"e1eec81dfc9e1b052cc25e070da812dc2dec2cfe84128b9cd679ca9076dbb437"} Jul 10 14:42:37.432489 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:37.432461 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5ghsv" event={"ID":"86f22a40-9f52-45c7-91bf-f77ff4ab4c99","Type":"ContainerStarted","Data":"a71293ad48cee1fe01bfdfa3af28d7ce0a296a78051032a1aeff843e0dee3b71"} Jul 10 14:42:37.450804 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:37.450755 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5ghsv" podStartSLOduration=1.43111635 podStartE2EDuration="2.450737589s" totalImagesPullingTime="1.019621239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:42:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:42:37.450590936 +0000 UTC m=+675.528252473" watchObservedRunningTime="2026-07-10 14:42:37.450737589 +0000 UTC m=+675.528399112" Jul 10 14:42:46.135288 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:46.135251 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5ghsv" Jul 10 14:42:46.135763 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:46.135320 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5ghsv" Jul 10 14:42:46.148553 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:46.148529 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5ghsv" Jul 10 14:42:46.482963 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:42:46.482937 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-5ghsv" Jul 10 14:43:11.205583 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:43:11.205551 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297"] Jul 10 14:43:11.208843 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:43:11.208826 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297" Jul 10 14:43:11.211402 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:43:11.211381 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 10 14:43:11.219192 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:43:11.219170 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297"] Jul 10 14:43:11.334376 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:43:11.334342 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acf94efa-27b6-4c66-8b20-e7506913466b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297\" (UID: \"acf94efa-27b6-4c66-8b20-e7506913466b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297" Jul 10 14:43:11.334376 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:43:11.334379 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dw4k\" (UniqueName: \"kubernetes.io/projected/acf94efa-27b6-4c66-8b20-e7506913466b-kube-api-access-4dw4k\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297\" (UID: \"acf94efa-27b6-4c66-8b20-e7506913466b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297" Jul 10 14:43:11.334594 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:43:11.334406 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acf94efa-27b6-4c66-8b20-e7506913466b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297\" (UID: \"acf94efa-27b6-4c66-8b20-e7506913466b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297" Jul 10 14:43:11.334594 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:43:11.334493 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acf94efa-27b6-4c66-8b20-e7506913466b-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297\" (UID: \"acf94efa-27b6-4c66-8b20-e7506913466b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297" Jul 10 14:43:11.334594 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:43:11.334537 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acf94efa-27b6-4c66-8b20-e7506913466b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297\" (UID: \"acf94efa-27b6-4c66-8b20-e7506913466b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297" Jul 10 14:43:11.334594 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:43:11.334563 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acf94efa-27b6-4c66-8b20-e7506913466b-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297\" (UID: \"acf94efa-27b6-4c66-8b20-e7506913466b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297" Jul 10 14:43:11.435611 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:43:11.435577 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acf94efa-27b6-4c66-8b20-e7506913466b-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297\" (UID: \"acf94efa-27b6-4c66-8b20-e7506913466b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297" Jul 10 14:43:11.435784 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:43:11.435625 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acf94efa-27b6-4c66-8b20-e7506913466b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297\" (UID: \"acf94efa-27b6-4c66-8b20-e7506913466b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297" Jul 10 14:43:11.435784 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:43:11.435663 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acf94efa-27b6-4c66-8b20-e7506913466b-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297\" (UID: \"acf94efa-27b6-4c66-8b20-e7506913466b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297" Jul 10 14:43:11.435784 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:43:11.435726 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acf94efa-27b6-4c66-8b20-e7506913466b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297\" (UID: \"acf94efa-27b6-4c66-8b20-e7506913466b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297" Jul 10 14:43:11.435784 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:43:11.435756 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dw4k\" (UniqueName: \"kubernetes.io/projected/acf94efa-27b6-4c66-8b20-e7506913466b-kube-api-access-4dw4k\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297\" (UID: \"acf94efa-27b6-4c66-8b20-e7506913466b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297" Jul 10 14:43:11.436023 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:43:11.435858 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acf94efa-27b6-4c66-8b20-e7506913466b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297\" (UID: \"acf94efa-27b6-4c66-8b20-e7506913466b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297" Jul 10 14:43:11.436147 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:43:11.436125 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/acf94efa-27b6-4c66-8b20-e7506913466b-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297\" (UID: \"acf94efa-27b6-4c66-8b20-e7506913466b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297" Jul 10 14:43:11.436194 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:43:11.436134 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/acf94efa-27b6-4c66-8b20-e7506913466b-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297\" (UID: \"acf94efa-27b6-4c66-8b20-e7506913466b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297" Jul 10 14:43:11.436245 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:43:11.436225 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/acf94efa-27b6-4c66-8b20-e7506913466b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297\" (UID: \"acf94efa-27b6-4c66-8b20-e7506913466b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297" Jul 10 14:43:11.437739 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:43:11.437721 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/acf94efa-27b6-4c66-8b20-e7506913466b-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297\" (UID: \"acf94efa-27b6-4c66-8b20-e7506913466b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297" Jul 10 14:43:11.437999 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:43:11.437959 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/acf94efa-27b6-4c66-8b20-e7506913466b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297\" (UID: \"acf94efa-27b6-4c66-8b20-e7506913466b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297" Jul 10 14:43:11.443708 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:43:11.443679 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dw4k\" (UniqueName: \"kubernetes.io/projected/acf94efa-27b6-4c66-8b20-e7506913466b-kube-api-access-4dw4k\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297\" (UID: \"acf94efa-27b6-4c66-8b20-e7506913466b\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297" Jul 10 14:43:11.517749 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:43:11.517683 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297" Jul 10 14:43:11.649388 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:43:11.649365 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297"] Jul 10 14:43:11.651838 ip-10-0-137-101 kubenswrapper[2571]: W0710 14:43:11.651811 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podacf94efa_27b6_4c66_8b20_e7506913466b.slice/crio-844a4656974202b76015c64e5ace3aa7bb48f462d12cd9787db1ab2fa75cc358 WatchSource:0}: Error finding container 844a4656974202b76015c64e5ace3aa7bb48f462d12cd9787db1ab2fa75cc358: Status 404 returned error can't find the container with id 844a4656974202b76015c64e5ace3aa7bb48f462d12cd9787db1ab2fa75cc358 Jul 10 14:43:12.584943 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:43:12.584908 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297" event={"ID":"acf94efa-27b6-4c66-8b20-e7506913466b","Type":"ContainerStarted","Data":"76faec81c8363fdf9e5b29221fe6bc3fc02cc125af40ed97d0c394a1980d5350"} Jul 10 14:43:12.584943 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:43:12.584949 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297" event={"ID":"acf94efa-27b6-4c66-8b20-e7506913466b","Type":"ContainerStarted","Data":"844a4656974202b76015c64e5ace3aa7bb48f462d12cd9787db1ab2fa75cc358"} Jul 10 14:43:12.602930 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:43:12.602884 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297" podStartSLOduration=1.4315840899999999 podStartE2EDuration="1.60286845s" totalImagesPullingTime="171.28436ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 14:43:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 14:43:12.600807039 +0000 UTC m=+710.678468583" watchObservedRunningTime="2026-07-10 14:43:12.60286845 +0000 UTC m=+710.680529995" Jul 10 14:43:21.518522 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:43:21.518488 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297" Jul 10 14:43:21.518901 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:43:21.518557 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297" Jul 10 14:43:21.530915 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:43:21.530887 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297" Jul 10 14:43:21.634416 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:43:21.634394 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297" Jul 10 14:46:22.372936 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:46:22.372909 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7clbv_b7c12f35-7b1f-4341-9302-0dfe837776f8/ovn-acl-logging/0.log" Jul 10 14:46:22.374920 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:46:22.374896 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7clbv_b7c12f35-7b1f-4341-9302-0dfe837776f8/ovn-acl-logging/0.log" Jul 10 14:51:22.406174 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:51:22.406141 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7clbv_b7c12f35-7b1f-4341-9302-0dfe837776f8/ovn-acl-logging/0.log" Jul 10 14:51:22.406665 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:51:22.406246 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7clbv_b7c12f35-7b1f-4341-9302-0dfe837776f8/ovn-acl-logging/0.log" Jul 10 14:56:22.432267 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:56:22.432235 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7clbv_b7c12f35-7b1f-4341-9302-0dfe837776f8/ovn-acl-logging/0.log" Jul 10 14:56:22.433757 ip-10-0-137-101 kubenswrapper[2571]: I0710 14:56:22.433599 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7clbv_b7c12f35-7b1f-4341-9302-0dfe837776f8/ovn-acl-logging/0.log" Jul 10 15:01:22.458698 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:01:22.458660 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7clbv_b7c12f35-7b1f-4341-9302-0dfe837776f8/ovn-acl-logging/0.log" Jul 10 15:01:22.461820 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:01:22.461796 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7clbv_b7c12f35-7b1f-4341-9302-0dfe837776f8/ovn-acl-logging/0.log" Jul 10 15:03:56.385650 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:03:56.385613 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896"] Jul 10 15:03:56.388198 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:03:56.388174 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896" Jul 10 15:03:56.391897 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:03:56.391871 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-a68a9f\"/\"kube-root-ca.crt\"" Jul 10 15:03:56.392033 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:03:56.391897 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-a68a9f\"/\"default-dockercfg-772rq\"" Jul 10 15:03:56.392033 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:03:56.391947 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-a68a9f\"/\"openshift-service-ca.crt\"" Jul 10 15:03:56.392033 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:03:56.391963 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-a68a9f\"/\"test-model-a68a9f-kserve-self-signed-certs\"" Jul 10 15:03:56.396670 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:03:56.396651 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896"] Jul 10 15:03:56.510220 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:03:56.510188 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd2759fb-df3b-40f9-9055-cd587936d278-model-cache\") pod \"test-model-a68a9f-kserve-7ffc64dc75-nb896\" (UID: \"dd2759fb-df3b-40f9-9055-cd587936d278\") " pod="ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896" Jul 10 15:03:56.510385 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:03:56.510227 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd2759fb-df3b-40f9-9055-cd587936d278-tmp-dir\") pod \"test-model-a68a9f-kserve-7ffc64dc75-nb896\" (UID: \"dd2759fb-df3b-40f9-9055-cd587936d278\") " pod="ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896" Jul 10 15:03:56.510385 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:03:56.510300 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd2759fb-df3b-40f9-9055-cd587936d278-home\") pod \"test-model-a68a9f-kserve-7ffc64dc75-nb896\" (UID: \"dd2759fb-df3b-40f9-9055-cd587936d278\") " pod="ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896" Jul 10 15:03:56.510385 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:03:56.510326 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxp5b\" (UniqueName: \"kubernetes.io/projected/dd2759fb-df3b-40f9-9055-cd587936d278-kube-api-access-hxp5b\") pod \"test-model-a68a9f-kserve-7ffc64dc75-nb896\" (UID: \"dd2759fb-df3b-40f9-9055-cd587936d278\") " pod="ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896" Jul 10 15:03:56.510385 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:03:56.510351 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd2759fb-df3b-40f9-9055-cd587936d278-tls-certs\") pod \"test-model-a68a9f-kserve-7ffc64dc75-nb896\" (UID: \"dd2759fb-df3b-40f9-9055-cd587936d278\") " pod="ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896" Jul 10 15:03:56.510566 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:03:56.510421 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd2759fb-df3b-40f9-9055-cd587936d278-dshm\") pod \"test-model-a68a9f-kserve-7ffc64dc75-nb896\" (UID: \"dd2759fb-df3b-40f9-9055-cd587936d278\") " pod="ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896" Jul 10 15:03:56.610950 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:03:56.610916 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd2759fb-df3b-40f9-9055-cd587936d278-home\") pod \"test-model-a68a9f-kserve-7ffc64dc75-nb896\" (UID: \"dd2759fb-df3b-40f9-9055-cd587936d278\") " pod="ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896" Jul 10 15:03:56.611119 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:03:56.610954 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxp5b\" (UniqueName: \"kubernetes.io/projected/dd2759fb-df3b-40f9-9055-cd587936d278-kube-api-access-hxp5b\") pod \"test-model-a68a9f-kserve-7ffc64dc75-nb896\" (UID: \"dd2759fb-df3b-40f9-9055-cd587936d278\") " pod="ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896" Jul 10 15:03:56.611119 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:03:56.611017 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd2759fb-df3b-40f9-9055-cd587936d278-tls-certs\") pod \"test-model-a68a9f-kserve-7ffc64dc75-nb896\" (UID: \"dd2759fb-df3b-40f9-9055-cd587936d278\") " pod="ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896" Jul 10 15:03:56.611240 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:03:56.611118 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd2759fb-df3b-40f9-9055-cd587936d278-dshm\") pod \"test-model-a68a9f-kserve-7ffc64dc75-nb896\" (UID: \"dd2759fb-df3b-40f9-9055-cd587936d278\") " pod="ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896" Jul 10 15:03:56.611240 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:03:56.611173 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd2759fb-df3b-40f9-9055-cd587936d278-model-cache\") pod \"test-model-a68a9f-kserve-7ffc64dc75-nb896\" (UID: \"dd2759fb-df3b-40f9-9055-cd587936d278\") " pod="ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896" Jul 10 15:03:56.611240 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:03:56.611213 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd2759fb-df3b-40f9-9055-cd587936d278-tmp-dir\") pod \"test-model-a68a9f-kserve-7ffc64dc75-nb896\" (UID: \"dd2759fb-df3b-40f9-9055-cd587936d278\") " pod="ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896" Jul 10 15:03:56.611440 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:03:56.611389 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd2759fb-df3b-40f9-9055-cd587936d278-home\") pod \"test-model-a68a9f-kserve-7ffc64dc75-nb896\" (UID: \"dd2759fb-df3b-40f9-9055-cd587936d278\") " pod="ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896" Jul 10 15:03:56.611560 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:03:56.611524 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd2759fb-df3b-40f9-9055-cd587936d278-model-cache\") pod \"test-model-a68a9f-kserve-7ffc64dc75-nb896\" (UID: \"dd2759fb-df3b-40f9-9055-cd587936d278\") " pod="ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896" Jul 10 15:03:56.611680 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:03:56.611660 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd2759fb-df3b-40f9-9055-cd587936d278-tmp-dir\") pod \"test-model-a68a9f-kserve-7ffc64dc75-nb896\" (UID: \"dd2759fb-df3b-40f9-9055-cd587936d278\") " pod="ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896" Jul 10 15:03:56.613318 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:03:56.613297 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd2759fb-df3b-40f9-9055-cd587936d278-dshm\") pod \"test-model-a68a9f-kserve-7ffc64dc75-nb896\" (UID: \"dd2759fb-df3b-40f9-9055-cd587936d278\") " pod="ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896" Jul 10 15:03:56.613562 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:03:56.613546 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd2759fb-df3b-40f9-9055-cd587936d278-tls-certs\") pod \"test-model-a68a9f-kserve-7ffc64dc75-nb896\" (UID: \"dd2759fb-df3b-40f9-9055-cd587936d278\") " pod="ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896" Jul 10 15:03:56.618419 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:03:56.618401 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxp5b\" (UniqueName: \"kubernetes.io/projected/dd2759fb-df3b-40f9-9055-cd587936d278-kube-api-access-hxp5b\") pod \"test-model-a68a9f-kserve-7ffc64dc75-nb896\" (UID: \"dd2759fb-df3b-40f9-9055-cd587936d278\") " pod="ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896" Jul 10 15:03:56.699088 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:03:56.699059 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896" Jul 10 15:03:56.825559 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:03:56.825535 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896"] Jul 10 15:03:56.827610 ip-10-0-137-101 kubenswrapper[2571]: W0710 15:03:56.827574 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd2759fb_df3b_40f9_9055_cd587936d278.slice/crio-a89f2b53a95ca16c4b759bc3577210e91d6ee3b8067810ee085c0ac6ef5bef1a WatchSource:0}: Error finding container a89f2b53a95ca16c4b759bc3577210e91d6ee3b8067810ee085c0ac6ef5bef1a: Status 404 returned error can't find the container with id a89f2b53a95ca16c4b759bc3577210e91d6ee3b8067810ee085c0ac6ef5bef1a Jul 10 15:03:57.082073 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:03:57.081986 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896" event={"ID":"dd2759fb-df3b-40f9-9055-cd587936d278","Type":"ContainerStarted","Data":"507db0a2e5a538ef839e51aac8829977bdb4cc9aad207ac9f8e4122c9ff9b59f"} Jul 10 15:03:57.082073 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:03:57.082030 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896" event={"ID":"dd2759fb-df3b-40f9-9055-cd587936d278","Type":"ContainerStarted","Data":"a89f2b53a95ca16c4b759bc3577210e91d6ee3b8067810ee085c0ac6ef5bef1a"} Jul 10 15:03:57.099361 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:03:57.099316 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896" podStartSLOduration=1.099301239 podStartE2EDuration="1.099301239s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:03:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:03:57.097637892 +0000 UTC m=+1955.175299439" watchObservedRunningTime="2026-07-10 15:03:57.099301239 +0000 UTC m=+1955.176962783" Jul 10 15:04:06.700142 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:06.700104 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896" Jul 10 15:04:06.700540 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:06.700154 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896" Jul 10 15:04:06.712871 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:06.712841 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896" Jul 10 15:04:07.138114 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:07.138036 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896" Jul 10 15:04:18.481322 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:18.481241 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896"] Jul 10 15:04:33.502818 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:33.502757 2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896" podUID="dd2759fb-df3b-40f9-9055-cd587936d278" containerName="main" containerID="cri-o://507db0a2e5a538ef839e51aac8829977bdb4cc9aad207ac9f8e4122c9ff9b59f" gracePeriod=45 Jul 10 15:04:33.742843 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:33.742821 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896" Jul 10 15:04:33.817595 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:33.817537 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd2759fb-df3b-40f9-9055-cd587936d278-tmp-dir\") pod \"dd2759fb-df3b-40f9-9055-cd587936d278\" (UID: \"dd2759fb-df3b-40f9-9055-cd587936d278\") " Jul 10 15:04:33.817595 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:33.817578 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxp5b\" (UniqueName: \"kubernetes.io/projected/dd2759fb-df3b-40f9-9055-cd587936d278-kube-api-access-hxp5b\") pod \"dd2759fb-df3b-40f9-9055-cd587936d278\" (UID: \"dd2759fb-df3b-40f9-9055-cd587936d278\") " Jul 10 15:04:33.817819 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:33.817610 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd2759fb-df3b-40f9-9055-cd587936d278-model-cache\") pod \"dd2759fb-df3b-40f9-9055-cd587936d278\" (UID: \"dd2759fb-df3b-40f9-9055-cd587936d278\") " Jul 10 15:04:33.817819 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:33.817644 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd2759fb-df3b-40f9-9055-cd587936d278-dshm\") pod \"dd2759fb-df3b-40f9-9055-cd587936d278\" (UID: \"dd2759fb-df3b-40f9-9055-cd587936d278\") " Jul 10 15:04:33.817819 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:33.817668 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd2759fb-df3b-40f9-9055-cd587936d278-tls-certs\") pod \"dd2759fb-df3b-40f9-9055-cd587936d278\" (UID: \"dd2759fb-df3b-40f9-9055-cd587936d278\") " Jul 10 15:04:33.817819 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:33.817716 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd2759fb-df3b-40f9-9055-cd587936d278-home\") pod \"dd2759fb-df3b-40f9-9055-cd587936d278\" (UID: \"dd2759fb-df3b-40f9-9055-cd587936d278\") " Jul 10 15:04:33.817819 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:33.817788 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd2759fb-df3b-40f9-9055-cd587936d278-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dd2759fb-df3b-40f9-9055-cd587936d278" (UID: "dd2759fb-df3b-40f9-9055-cd587936d278"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:04:33.818100 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:33.817919 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd2759fb-df3b-40f9-9055-cd587936d278-model-cache" (OuterVolumeSpecName: "model-cache") pod "dd2759fb-df3b-40f9-9055-cd587936d278" (UID: "dd2759fb-df3b-40f9-9055-cd587936d278"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:04:33.818100 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:33.818040 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd2759fb-df3b-40f9-9055-cd587936d278-home" (OuterVolumeSpecName: "home") pod "dd2759fb-df3b-40f9-9055-cd587936d278" (UID: "dd2759fb-df3b-40f9-9055-cd587936d278"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:04:33.818100 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:33.818064 2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd2759fb-df3b-40f9-9055-cd587936d278-tmp-dir\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 15:04:33.818100 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:33.818085 2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd2759fb-df3b-40f9-9055-cd587936d278-model-cache\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 15:04:33.819722 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:33.819701 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd2759fb-df3b-40f9-9055-cd587936d278-kube-api-access-hxp5b" (OuterVolumeSpecName: "kube-api-access-hxp5b") pod "dd2759fb-df3b-40f9-9055-cd587936d278" (UID: "dd2759fb-df3b-40f9-9055-cd587936d278"). InnerVolumeSpecName "kube-api-access-hxp5b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 15:04:33.819817 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:33.819741 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd2759fb-df3b-40f9-9055-cd587936d278-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dd2759fb-df3b-40f9-9055-cd587936d278" (UID: "dd2759fb-df3b-40f9-9055-cd587936d278"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:04:33.819817 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:33.819744 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd2759fb-df3b-40f9-9055-cd587936d278-dshm" (OuterVolumeSpecName: "dshm") pod "dd2759fb-df3b-40f9-9055-cd587936d278" (UID: "dd2759fb-df3b-40f9-9055-cd587936d278"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:04:33.918994 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:33.918944 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxp5b\" (UniqueName: \"kubernetes.io/projected/dd2759fb-df3b-40f9-9055-cd587936d278-kube-api-access-hxp5b\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 15:04:33.918994 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:33.918994 2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd2759fb-df3b-40f9-9055-cd587936d278-dshm\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 15:04:33.919156 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:33.919010 2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd2759fb-df3b-40f9-9055-cd587936d278-tls-certs\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 15:04:33.919156 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:33.919022 2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd2759fb-df3b-40f9-9055-cd587936d278-home\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 15:04:34.243235 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:34.243200 2571 generic.go:356] "Generic (PLEG): container finished" podID="dd2759fb-df3b-40f9-9055-cd587936d278" containerID="507db0a2e5a538ef839e51aac8829977bdb4cc9aad207ac9f8e4122c9ff9b59f" exitCode=0 Jul 10 15:04:34.243415 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:34.243241 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896" Jul 10 15:04:34.243415 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:34.243291 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896" event={"ID":"dd2759fb-df3b-40f9-9055-cd587936d278","Type":"ContainerDied","Data":"507db0a2e5a538ef839e51aac8829977bdb4cc9aad207ac9f8e4122c9ff9b59f"} Jul 10 15:04:34.243415 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:34.243324 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896" event={"ID":"dd2759fb-df3b-40f9-9055-cd587936d278","Type":"ContainerDied","Data":"a89f2b53a95ca16c4b759bc3577210e91d6ee3b8067810ee085c0ac6ef5bef1a"} Jul 10 15:04:34.243415 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:34.243341 2571 scope.go:117] "RemoveContainer" containerID="507db0a2e5a538ef839e51aac8829977bdb4cc9aad207ac9f8e4122c9ff9b59f" Jul 10 15:04:34.252195 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:34.252179 2571 scope.go:117] "RemoveContainer" containerID="507db0a2e5a538ef839e51aac8829977bdb4cc9aad207ac9f8e4122c9ff9b59f" Jul 10 15:04:34.252461 ip-10-0-137-101 kubenswrapper[2571]: E0710 15:04:34.252443 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"507db0a2e5a538ef839e51aac8829977bdb4cc9aad207ac9f8e4122c9ff9b59f\": container with ID starting with 507db0a2e5a538ef839e51aac8829977bdb4cc9aad207ac9f8e4122c9ff9b59f not found: ID does not exist" containerID="507db0a2e5a538ef839e51aac8829977bdb4cc9aad207ac9f8e4122c9ff9b59f" Jul 10 15:04:34.252508 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:34.252469 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"507db0a2e5a538ef839e51aac8829977bdb4cc9aad207ac9f8e4122c9ff9b59f"} err="failed to get container status \"507db0a2e5a538ef839e51aac8829977bdb4cc9aad207ac9f8e4122c9ff9b59f\": rpc error: code = NotFound desc = could not find container \"507db0a2e5a538ef839e51aac8829977bdb4cc9aad207ac9f8e4122c9ff9b59f\": container with ID starting with 507db0a2e5a538ef839e51aac8829977bdb4cc9aad207ac9f8e4122c9ff9b59f not found: ID does not exist" Jul 10 15:04:34.263324 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:34.263300 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896"] Jul 10 15:04:34.268092 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:34.268073 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-a68a9f/test-model-a68a9f-kserve-7ffc64dc75-nb896"] Jul 10 15:04:34.463266 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:04:34.463238 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd2759fb-df3b-40f9-9055-cd587936d278" path="/var/lib/kubelet/pods/dd2759fb-df3b-40f9-9055-cd587936d278/volumes" Jul 10 15:06:22.484986 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:22.484878 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7clbv_b7c12f35-7b1f-4341-9302-0dfe837776f8/ovn-acl-logging/0.log" Jul 10 15:06:22.489231 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:22.488466 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7clbv_b7c12f35-7b1f-4341-9302-0dfe837776f8/ovn-acl-logging/0.log" Jul 10 15:06:46.992241 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:46.992210 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt"] Jul 10 15:06:46.992747 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:46.992725 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd2759fb-df3b-40f9-9055-cd587936d278" containerName="main" Jul 10 15:06:46.993082 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:46.992770 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd2759fb-df3b-40f9-9055-cd587936d278" containerName="main" Jul 10 15:06:46.993082 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:46.992871 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd2759fb-df3b-40f9-9055-cd587936d278" containerName="main" Jul 10 15:06:46.995680 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:46.995665 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt" Jul 10 15:06:46.998155 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:46.998131 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f923ab\"/\"kube-root-ca.crt\"" Jul 10 15:06:46.999231 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:46.999205 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f923ab\"/\"openshift-service-ca.crt\"" Jul 10 15:06:46.999231 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:46.999218 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f923ab\"/\"default-dockercfg-kdtmk\"" Jul 10 15:06:46.999418 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:46.999257 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f923ab\"/\"auth-test-model-f923ab-kserve-self-signed-certs\"" Jul 10 15:06:47.005701 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:47.005679 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt"] Jul 10 15:06:47.058357 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:47.058326 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ead6913a-cd05-4bde-89c1-40c749f02984-home\") pod \"auth-test-model-f923ab-kserve-74cdfb974c-9c8mt\" (UID: \"ead6913a-cd05-4bde-89c1-40c749f02984\") " pod="ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt" Jul 10 15:06:47.058505 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:47.058371 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ead6913a-cd05-4bde-89c1-40c749f02984-tls-certs\") pod \"auth-test-model-f923ab-kserve-74cdfb974c-9c8mt\" (UID: \"ead6913a-cd05-4bde-89c1-40c749f02984\") " pod="ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt" Jul 10 15:06:47.058505 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:47.058394 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ead6913a-cd05-4bde-89c1-40c749f02984-model-cache\") pod \"auth-test-model-f923ab-kserve-74cdfb974c-9c8mt\" (UID: \"ead6913a-cd05-4bde-89c1-40c749f02984\") " pod="ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt" Jul 10 15:06:47.058505 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:47.058448 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ead6913a-cd05-4bde-89c1-40c749f02984-tmp-dir\") pod \"auth-test-model-f923ab-kserve-74cdfb974c-9c8mt\" (UID: \"ead6913a-cd05-4bde-89c1-40c749f02984\") " pod="ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt" Jul 10 15:06:47.058505 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:47.058483 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ead6913a-cd05-4bde-89c1-40c749f02984-dshm\") pod \"auth-test-model-f923ab-kserve-74cdfb974c-9c8mt\" (UID: \"ead6913a-cd05-4bde-89c1-40c749f02984\") " pod="ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt" Jul 10 15:06:47.058677 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:47.058525 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br9vx\" (UniqueName: \"kubernetes.io/projected/ead6913a-cd05-4bde-89c1-40c749f02984-kube-api-access-br9vx\") pod \"auth-test-model-f923ab-kserve-74cdfb974c-9c8mt\" (UID: \"ead6913a-cd05-4bde-89c1-40c749f02984\") " pod="ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt" Jul 10 15:06:47.159569 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:47.159535 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br9vx\" (UniqueName: \"kubernetes.io/projected/ead6913a-cd05-4bde-89c1-40c749f02984-kube-api-access-br9vx\") pod \"auth-test-model-f923ab-kserve-74cdfb974c-9c8mt\" (UID: \"ead6913a-cd05-4bde-89c1-40c749f02984\") " pod="ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt" Jul 10 15:06:47.159781 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:47.159619 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ead6913a-cd05-4bde-89c1-40c749f02984-home\") pod \"auth-test-model-f923ab-kserve-74cdfb974c-9c8mt\" (UID: \"ead6913a-cd05-4bde-89c1-40c749f02984\") " pod="ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt" Jul 10 15:06:47.159781 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:47.159764 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ead6913a-cd05-4bde-89c1-40c749f02984-tls-certs\") pod \"auth-test-model-f923ab-kserve-74cdfb974c-9c8mt\" (UID: \"ead6913a-cd05-4bde-89c1-40c749f02984\") " pod="ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt" Jul 10 15:06:47.159909 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:47.159805 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ead6913a-cd05-4bde-89c1-40c749f02984-model-cache\") pod \"auth-test-model-f923ab-kserve-74cdfb974c-9c8mt\" (UID: \"ead6913a-cd05-4bde-89c1-40c749f02984\") " pod="ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt" Jul 10 15:06:47.159909 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:47.159851 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ead6913a-cd05-4bde-89c1-40c749f02984-tmp-dir\") pod \"auth-test-model-f923ab-kserve-74cdfb974c-9c8mt\" (UID: \"ead6913a-cd05-4bde-89c1-40c749f02984\") " pod="ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt" Jul 10 15:06:47.159909 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:47.159876 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ead6913a-cd05-4bde-89c1-40c749f02984-dshm\") pod \"auth-test-model-f923ab-kserve-74cdfb974c-9c8mt\" (UID: \"ead6913a-cd05-4bde-89c1-40c749f02984\") " pod="ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt" Jul 10 15:06:47.160112 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:47.160073 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ead6913a-cd05-4bde-89c1-40c749f02984-home\") pod \"auth-test-model-f923ab-kserve-74cdfb974c-9c8mt\" (UID: \"ead6913a-cd05-4bde-89c1-40c749f02984\") " pod="ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt" Jul 10 15:06:47.160162 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:47.160145 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ead6913a-cd05-4bde-89c1-40c749f02984-model-cache\") pod \"auth-test-model-f923ab-kserve-74cdfb974c-9c8mt\" (UID: \"ead6913a-cd05-4bde-89c1-40c749f02984\") " pod="ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt" Jul 10 15:06:47.160277 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:47.160262 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ead6913a-cd05-4bde-89c1-40c749f02984-tmp-dir\") pod \"auth-test-model-f923ab-kserve-74cdfb974c-9c8mt\" (UID: \"ead6913a-cd05-4bde-89c1-40c749f02984\") " pod="ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt" Jul 10 15:06:47.161924 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:47.161905 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ead6913a-cd05-4bde-89c1-40c749f02984-dshm\") pod \"auth-test-model-f923ab-kserve-74cdfb974c-9c8mt\" (UID: \"ead6913a-cd05-4bde-89c1-40c749f02984\") " pod="ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt" Jul 10 15:06:47.162289 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:47.162271 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ead6913a-cd05-4bde-89c1-40c749f02984-tls-certs\") pod \"auth-test-model-f923ab-kserve-74cdfb974c-9c8mt\" (UID: \"ead6913a-cd05-4bde-89c1-40c749f02984\") " pod="ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt" Jul 10 15:06:47.174843 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:47.174820 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-br9vx\" (UniqueName: \"kubernetes.io/projected/ead6913a-cd05-4bde-89c1-40c749f02984-kube-api-access-br9vx\") pod \"auth-test-model-f923ab-kserve-74cdfb974c-9c8mt\" (UID: \"ead6913a-cd05-4bde-89c1-40c749f02984\") " pod="ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt" Jul 10 15:06:47.306514 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:47.306427 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt" Jul 10 15:06:47.435690 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:47.435652 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt"] Jul 10 15:06:47.438857 ip-10-0-137-101 kubenswrapper[2571]: W0710 15:06:47.438831 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podead6913a_cd05_4bde_89c1_40c749f02984.slice/crio-5c2e835b73b6af32ed900557e56d8268793d95df97fe53d61f9885696079ef90 WatchSource:0}: Error finding container 5c2e835b73b6af32ed900557e56d8268793d95df97fe53d61f9885696079ef90: Status 404 returned error can't find the container with id 5c2e835b73b6af32ed900557e56d8268793d95df97fe53d61f9885696079ef90 Jul 10 15:06:47.843316 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:47.843249 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt" event={"ID":"ead6913a-cd05-4bde-89c1-40c749f02984","Type":"ContainerStarted","Data":"28d1573ee2e7f27d04b592e185f7c5dd6827bea5515952e3ba51a07d40e7a193"} Jul 10 15:06:47.843479 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:47.843323 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt" event={"ID":"ead6913a-cd05-4bde-89c1-40c749f02984","Type":"ContainerStarted","Data":"5c2e835b73b6af32ed900557e56d8268793d95df97fe53d61f9885696079ef90"} Jul 10 15:06:47.858285 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:47.858229 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt" podStartSLOduration=1.858208823 podStartE2EDuration="1.858208823s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:06:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:06:47.857701809 +0000 UTC m=+2125.935363370" watchObservedRunningTime="2026-07-10 15:06:47.858208823 +0000 UTC m=+2125.935870370" Jul 10 15:06:57.307280 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:57.307230 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt" Jul 10 15:06:57.307780 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:57.307297 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt" Jul 10 15:06:57.319636 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:57.319612 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt" Jul 10 15:06:57.900235 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:06:57.900206 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt" Jul 10 15:08:46.003931 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:08:46.003859 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt"] Jul 10 15:09:01.023709 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:01.023647 2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt" podUID="ead6913a-cd05-4bde-89c1-40c749f02984" containerName="main" containerID="cri-o://28d1573ee2e7f27d04b592e185f7c5dd6827bea5515952e3ba51a07d40e7a193" gracePeriod=45 Jul 10 15:09:01.268209 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:01.268183 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt" Jul 10 15:09:01.388888 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:01.388822 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ead6913a-cd05-4bde-89c1-40c749f02984-tmp-dir\") pod \"ead6913a-cd05-4bde-89c1-40c749f02984\" (UID: \"ead6913a-cd05-4bde-89c1-40c749f02984\") " Jul 10 15:09:01.388888 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:01.388859 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ead6913a-cd05-4bde-89c1-40c749f02984-home\") pod \"ead6913a-cd05-4bde-89c1-40c749f02984\" (UID: \"ead6913a-cd05-4bde-89c1-40c749f02984\") " Jul 10 15:09:01.389130 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:01.388893 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ead6913a-cd05-4bde-89c1-40c749f02984-tls-certs\") pod \"ead6913a-cd05-4bde-89c1-40c749f02984\" (UID: \"ead6913a-cd05-4bde-89c1-40c749f02984\") " Jul 10 15:09:01.389130 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:01.388916 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-br9vx\" (UniqueName: \"kubernetes.io/projected/ead6913a-cd05-4bde-89c1-40c749f02984-kube-api-access-br9vx\") pod \"ead6913a-cd05-4bde-89c1-40c749f02984\" (UID: \"ead6913a-cd05-4bde-89c1-40c749f02984\") " Jul 10 15:09:01.389130 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:01.388935 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ead6913a-cd05-4bde-89c1-40c749f02984-dshm\") pod \"ead6913a-cd05-4bde-89c1-40c749f02984\" (UID: \"ead6913a-cd05-4bde-89c1-40c749f02984\") " Jul 10 15:09:01.389130 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:01.388998 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ead6913a-cd05-4bde-89c1-40c749f02984-model-cache\") pod \"ead6913a-cd05-4bde-89c1-40c749f02984\" (UID: \"ead6913a-cd05-4bde-89c1-40c749f02984\") " Jul 10 15:09:01.389339 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:01.389168 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ead6913a-cd05-4bde-89c1-40c749f02984-home" (OuterVolumeSpecName: "home") pod "ead6913a-cd05-4bde-89c1-40c749f02984" (UID: "ead6913a-cd05-4bde-89c1-40c749f02984"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:09:01.389339 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:01.389179 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ead6913a-cd05-4bde-89c1-40c749f02984-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ead6913a-cd05-4bde-89c1-40c749f02984" (UID: "ead6913a-cd05-4bde-89c1-40c749f02984"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:09:01.389339 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:01.389323 2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ead6913a-cd05-4bde-89c1-40c749f02984-tmp-dir\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 15:09:01.389491 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:01.389340 2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ead6913a-cd05-4bde-89c1-40c749f02984-home\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 15:09:01.389491 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:01.389337 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ead6913a-cd05-4bde-89c1-40c749f02984-model-cache" (OuterVolumeSpecName: "model-cache") pod "ead6913a-cd05-4bde-89c1-40c749f02984" (UID: "ead6913a-cd05-4bde-89c1-40c749f02984"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:09:01.391256 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:01.391232 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ead6913a-cd05-4bde-89c1-40c749f02984-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ead6913a-cd05-4bde-89c1-40c749f02984" (UID: "ead6913a-cd05-4bde-89c1-40c749f02984"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:09:01.391348 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:01.391321 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ead6913a-cd05-4bde-89c1-40c749f02984-dshm" (OuterVolumeSpecName: "dshm") pod "ead6913a-cd05-4bde-89c1-40c749f02984" (UID: "ead6913a-cd05-4bde-89c1-40c749f02984"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:09:01.391429 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:01.391330 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ead6913a-cd05-4bde-89c1-40c749f02984-kube-api-access-br9vx" (OuterVolumeSpecName: "kube-api-access-br9vx") pod "ead6913a-cd05-4bde-89c1-40c749f02984" (UID: "ead6913a-cd05-4bde-89c1-40c749f02984"). InnerVolumeSpecName "kube-api-access-br9vx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 15:09:01.442569 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:01.442542 2571 generic.go:356] "Generic (PLEG): container finished" podID="ead6913a-cd05-4bde-89c1-40c749f02984" containerID="28d1573ee2e7f27d04b592e185f7c5dd6827bea5515952e3ba51a07d40e7a193" exitCode=0 Jul 10 15:09:01.442672 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:01.442580 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt" Jul 10 15:09:01.442672 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:01.442583 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt" event={"ID":"ead6913a-cd05-4bde-89c1-40c749f02984","Type":"ContainerDied","Data":"28d1573ee2e7f27d04b592e185f7c5dd6827bea5515952e3ba51a07d40e7a193"} Jul 10 15:09:01.442672 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:01.442620 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt" event={"ID":"ead6913a-cd05-4bde-89c1-40c749f02984","Type":"ContainerDied","Data":"5c2e835b73b6af32ed900557e56d8268793d95df97fe53d61f9885696079ef90"} Jul 10 15:09:01.442672 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:01.442638 2571 scope.go:117] "RemoveContainer" containerID="28d1573ee2e7f27d04b592e185f7c5dd6827bea5515952e3ba51a07d40e7a193" Jul 10 15:09:01.458026 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:01.458005 2571 scope.go:117] "RemoveContainer" containerID="28d1573ee2e7f27d04b592e185f7c5dd6827bea5515952e3ba51a07d40e7a193" Jul 10 15:09:01.458296 ip-10-0-137-101 kubenswrapper[2571]: E0710 15:09:01.458276 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28d1573ee2e7f27d04b592e185f7c5dd6827bea5515952e3ba51a07d40e7a193\": container with ID starting with 28d1573ee2e7f27d04b592e185f7c5dd6827bea5515952e3ba51a07d40e7a193 not found: ID does not exist" containerID="28d1573ee2e7f27d04b592e185f7c5dd6827bea5515952e3ba51a07d40e7a193" Jul 10 15:09:01.458351 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:01.458305 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28d1573ee2e7f27d04b592e185f7c5dd6827bea5515952e3ba51a07d40e7a193"} err="failed to get container status \"28d1573ee2e7f27d04b592e185f7c5dd6827bea5515952e3ba51a07d40e7a193\": rpc error: code = NotFound desc = could not find container \"28d1573ee2e7f27d04b592e185f7c5dd6827bea5515952e3ba51a07d40e7a193\": container with ID starting with 28d1573ee2e7f27d04b592e185f7c5dd6827bea5515952e3ba51a07d40e7a193 not found: ID does not exist" Jul 10 15:09:01.466889 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:01.466867 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt"] Jul 10 15:09:01.470037 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:01.470018 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f923ab/auth-test-model-f923ab-kserve-74cdfb974c-9c8mt"] Jul 10 15:09:01.489697 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:01.489681 2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ead6913a-cd05-4bde-89c1-40c749f02984-tls-certs\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 15:09:01.489766 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:01.489700 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-br9vx\" (UniqueName: \"kubernetes.io/projected/ead6913a-cd05-4bde-89c1-40c749f02984-kube-api-access-br9vx\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 15:09:01.489766 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:01.489710 2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ead6913a-cd05-4bde-89c1-40c749f02984-dshm\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 15:09:01.489766 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:01.489721 2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ead6913a-cd05-4bde-89c1-40c749f02984-model-cache\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 15:09:02.462037 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:02.462004 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ead6913a-cd05-4bde-89c1-40c749f02984" path="/var/lib/kubelet/pods/ead6913a-cd05-4bde-89c1-40c749f02984/volumes" Jul 10 15:09:32.787061 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:32.787023 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5"] Jul 10 15:09:32.787450 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:32.787350 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ead6913a-cd05-4bde-89c1-40c749f02984" containerName="main" Jul 10 15:09:32.787450 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:32.787364 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ead6913a-cd05-4bde-89c1-40c749f02984" containerName="main" Jul 10 15:09:32.787450 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:32.787444 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ead6913a-cd05-4bde-89c1-40c749f02984" containerName="main" Jul 10 15:09:32.790374 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:32.790354 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5" Jul 10 15:09:32.793885 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:32.793858 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f923ab\"/\"openshift-service-ca.crt\"" Jul 10 15:09:32.794033 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:32.793897 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f923ab\"/\"default-dockercfg-kdtmk\"" Jul 10 15:09:32.794033 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:32.793907 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-f923ab\"/\"sub-test-model-f923ab-kserve-self-signed-certs\"" Jul 10 15:09:32.794033 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:32.793909 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-f923ab\"/\"kube-root-ca.crt\"" Jul 10 15:09:32.800911 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:32.800891 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5"] Jul 10 15:09:32.846452 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:32.846428 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-tmp-dir\") pod \"sub-test-model-f923ab-kserve-5d9b6f6845-82ng5\" (UID: \"b48e9f3d-1e77-4bfc-8408-b9fd873033ca\") " pod="ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5" Jul 10 15:09:32.846581 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:32.846467 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6ct7\" (UniqueName: \"kubernetes.io/projected/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-kube-api-access-w6ct7\") pod \"sub-test-model-f923ab-kserve-5d9b6f6845-82ng5\" (UID: \"b48e9f3d-1e77-4bfc-8408-b9fd873033ca\") " pod="ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5" Jul 10 15:09:32.846581 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:32.846504 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-home\") pod \"sub-test-model-f923ab-kserve-5d9b6f6845-82ng5\" (UID: \"b48e9f3d-1e77-4bfc-8408-b9fd873033ca\") " pod="ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5" Jul 10 15:09:32.846581 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:32.846525 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-dshm\") pod \"sub-test-model-f923ab-kserve-5d9b6f6845-82ng5\" (UID: \"b48e9f3d-1e77-4bfc-8408-b9fd873033ca\") " pod="ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5" Jul 10 15:09:32.846581 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:32.846550 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-model-cache\") pod \"sub-test-model-f923ab-kserve-5d9b6f6845-82ng5\" (UID: \"b48e9f3d-1e77-4bfc-8408-b9fd873033ca\") " pod="ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5" Jul 10 15:09:32.846744 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:32.846621 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-tls-certs\") pod \"sub-test-model-f923ab-kserve-5d9b6f6845-82ng5\" (UID: \"b48e9f3d-1e77-4bfc-8408-b9fd873033ca\") " pod="ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5" Jul 10 15:09:32.947428 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:32.947396 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-model-cache\") pod \"sub-test-model-f923ab-kserve-5d9b6f6845-82ng5\" (UID: \"b48e9f3d-1e77-4bfc-8408-b9fd873033ca\") " pod="ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5" Jul 10 15:09:32.947596 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:32.947459 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-tls-certs\") pod \"sub-test-model-f923ab-kserve-5d9b6f6845-82ng5\" (UID: \"b48e9f3d-1e77-4bfc-8408-b9fd873033ca\") " pod="ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5" Jul 10 15:09:32.947596 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:32.947531 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-tmp-dir\") pod \"sub-test-model-f923ab-kserve-5d9b6f6845-82ng5\" (UID: \"b48e9f3d-1e77-4bfc-8408-b9fd873033ca\") " pod="ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5" Jul 10 15:09:32.947596 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:32.947572 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6ct7\" (UniqueName: \"kubernetes.io/projected/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-kube-api-access-w6ct7\") pod \"sub-test-model-f923ab-kserve-5d9b6f6845-82ng5\" (UID: \"b48e9f3d-1e77-4bfc-8408-b9fd873033ca\") " pod="ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5" Jul 10 15:09:32.947754 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:32.947611 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-home\") pod \"sub-test-model-f923ab-kserve-5d9b6f6845-82ng5\" (UID: \"b48e9f3d-1e77-4bfc-8408-b9fd873033ca\") " pod="ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5" Jul 10 15:09:32.947754 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:32.947633 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-dshm\") pod \"sub-test-model-f923ab-kserve-5d9b6f6845-82ng5\" (UID: \"b48e9f3d-1e77-4bfc-8408-b9fd873033ca\") " pod="ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5" Jul 10 15:09:32.947899 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:32.947874 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-model-cache\") pod \"sub-test-model-f923ab-kserve-5d9b6f6845-82ng5\" (UID: \"b48e9f3d-1e77-4bfc-8408-b9fd873033ca\") " pod="ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5" Jul 10 15:09:32.947952 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:32.947912 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-tmp-dir\") pod \"sub-test-model-f923ab-kserve-5d9b6f6845-82ng5\" (UID: \"b48e9f3d-1e77-4bfc-8408-b9fd873033ca\") " pod="ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5" Jul 10 15:09:32.948030 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:32.948012 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-home\") pod \"sub-test-model-f923ab-kserve-5d9b6f6845-82ng5\" (UID: \"b48e9f3d-1e77-4bfc-8408-b9fd873033ca\") " pod="ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5" Jul 10 15:09:32.949715 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:32.949698 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-dshm\") pod \"sub-test-model-f923ab-kserve-5d9b6f6845-82ng5\" (UID: \"b48e9f3d-1e77-4bfc-8408-b9fd873033ca\") " pod="ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5" Jul 10 15:09:32.950009 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:32.949991 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-tls-certs\") pod \"sub-test-model-f923ab-kserve-5d9b6f6845-82ng5\" (UID: \"b48e9f3d-1e77-4bfc-8408-b9fd873033ca\") " pod="ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5" Jul 10 15:09:32.958381 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:32.958359 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6ct7\" (UniqueName: \"kubernetes.io/projected/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-kube-api-access-w6ct7\") pod \"sub-test-model-f923ab-kserve-5d9b6f6845-82ng5\" (UID: \"b48e9f3d-1e77-4bfc-8408-b9fd873033ca\") " pod="ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5" Jul 10 15:09:33.099053 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:33.098941 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5" Jul 10 15:09:33.224032 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:33.224010 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5"] Jul 10 15:09:33.226071 ip-10-0-137-101 kubenswrapper[2571]: W0710 15:09:33.226042 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb48e9f3d_1e77_4bfc_8408_b9fd873033ca.slice/crio-e15c5a305f5c34954594613670ae3df5de2936927e25bfda4478f56079f2240c WatchSource:0}: Error finding container e15c5a305f5c34954594613670ae3df5de2936927e25bfda4478f56079f2240c: Status 404 returned error can't find the container with id e15c5a305f5c34954594613670ae3df5de2936927e25bfda4478f56079f2240c Jul 10 15:09:33.590109 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:33.590074 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5" event={"ID":"b48e9f3d-1e77-4bfc-8408-b9fd873033ca","Type":"ContainerStarted","Data":"3527d3800564e8997502b48414b76aa6d2075d42845684a95f32f95457413862"} Jul 10 15:09:33.590247 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:33.590119 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5" event={"ID":"b48e9f3d-1e77-4bfc-8408-b9fd873033ca","Type":"ContainerStarted","Data":"e15c5a305f5c34954594613670ae3df5de2936927e25bfda4478f56079f2240c"} Jul 10 15:09:33.607088 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:33.607042 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5" podStartSLOduration=1.607024373 podStartE2EDuration="1.607024373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:09:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:09:33.606452422 +0000 UTC m=+2291.684113966" watchObservedRunningTime="2026-07-10 15:09:33.607024373 +0000 UTC m=+2291.684685919" Jul 10 15:09:43.099173 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:43.099133 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5" Jul 10 15:09:43.099561 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:43.099192 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5" Jul 10 15:09:43.111577 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:43.111555 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5" Jul 10 15:09:43.643981 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:09:43.643934 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5" Jul 10 15:10:22.307485 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:22.307445 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5"] Jul 10 15:10:25.799430 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:25.799389 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l"] Jul 10 15:10:25.803298 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:25.803278 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l" Jul 10 15:10:25.805914 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:25.805886 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-1f1c9a\"/\"kube-root-ca.crt\"" Jul 10 15:10:25.806899 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:25.806878 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-1f1c9a\"/\"default-dockercfg-lvz4r\"" Jul 10 15:10:25.807030 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:25.806886 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-1f1c9a\"/\"openshift-service-ca.crt\"" Jul 10 15:10:25.807030 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:25.806887 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-1f1c9a\"/\"rate-test-model-1f1c9a-kserve-self-signed-certs\"" Jul 10 15:10:25.812919 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:25.812894 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l"] Jul 10 15:10:25.894692 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:25.894660 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66d1723b-e833-4757-a88a-c26e56a5d918-tls-certs\") pod \"rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l\" (UID: \"66d1723b-e833-4757-a88a-c26e56a5d918\") " pod="ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l" Jul 10 15:10:25.894848 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:25.894712 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66d1723b-e833-4757-a88a-c26e56a5d918-tmp-dir\") pod \"rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l\" (UID: \"66d1723b-e833-4757-a88a-c26e56a5d918\") " pod="ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l" Jul 10 15:10:25.894848 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:25.894737 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t68s\" (UniqueName: \"kubernetes.io/projected/66d1723b-e833-4757-a88a-c26e56a5d918-kube-api-access-4t68s\") pod \"rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l\" (UID: \"66d1723b-e833-4757-a88a-c26e56a5d918\") " pod="ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l" Jul 10 15:10:25.894848 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:25.894811 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66d1723b-e833-4757-a88a-c26e56a5d918-model-cache\") pod \"rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l\" (UID: \"66d1723b-e833-4757-a88a-c26e56a5d918\") " pod="ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l" Jul 10 15:10:25.894953 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:25.894862 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66d1723b-e833-4757-a88a-c26e56a5d918-home\") pod \"rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l\" (UID: \"66d1723b-e833-4757-a88a-c26e56a5d918\") " pod="ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l" Jul 10 15:10:25.894953 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:25.894925 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66d1723b-e833-4757-a88a-c26e56a5d918-dshm\") pod \"rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l\" (UID: \"66d1723b-e833-4757-a88a-c26e56a5d918\") " pod="ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l" Jul 10 15:10:25.995920 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:25.995886 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66d1723b-e833-4757-a88a-c26e56a5d918-home\") pod \"rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l\" (UID: \"66d1723b-e833-4757-a88a-c26e56a5d918\") " pod="ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l" Jul 10 15:10:25.996072 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:25.995936 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66d1723b-e833-4757-a88a-c26e56a5d918-dshm\") pod \"rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l\" (UID: \"66d1723b-e833-4757-a88a-c26e56a5d918\") " pod="ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l" Jul 10 15:10:25.996072 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:25.995953 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66d1723b-e833-4757-a88a-c26e56a5d918-tls-certs\") pod \"rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l\" (UID: \"66d1723b-e833-4757-a88a-c26e56a5d918\") " pod="ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l" Jul 10 15:10:25.996072 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:25.996007 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66d1723b-e833-4757-a88a-c26e56a5d918-tmp-dir\") pod \"rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l\" (UID: \"66d1723b-e833-4757-a88a-c26e56a5d918\") " pod="ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l" Jul 10 15:10:25.996072 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:25.996024 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t68s\" (UniqueName: \"kubernetes.io/projected/66d1723b-e833-4757-a88a-c26e56a5d918-kube-api-access-4t68s\") pod \"rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l\" (UID: \"66d1723b-e833-4757-a88a-c26e56a5d918\") " pod="ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l" Jul 10 15:10:25.996225 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:25.996073 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66d1723b-e833-4757-a88a-c26e56a5d918-model-cache\") pod \"rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l\" (UID: \"66d1723b-e833-4757-a88a-c26e56a5d918\") " pod="ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l" Jul 10 15:10:25.996368 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:25.996344 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66d1723b-e833-4757-a88a-c26e56a5d918-home\") pod \"rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l\" (UID: \"66d1723b-e833-4757-a88a-c26e56a5d918\") " pod="ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l" Jul 10 15:10:25.996445 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:25.996425 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66d1723b-e833-4757-a88a-c26e56a5d918-tmp-dir\") pod \"rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l\" (UID: \"66d1723b-e833-4757-a88a-c26e56a5d918\") " pod="ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l" Jul 10 15:10:25.996502 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:25.996476 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66d1723b-e833-4757-a88a-c26e56a5d918-model-cache\") pod \"rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l\" (UID: \"66d1723b-e833-4757-a88a-c26e56a5d918\") " pod="ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l" Jul 10 15:10:25.998274 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:25.998245 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66d1723b-e833-4757-a88a-c26e56a5d918-dshm\") pod \"rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l\" (UID: \"66d1723b-e833-4757-a88a-c26e56a5d918\") " pod="ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l" Jul 10 15:10:25.998885 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:25.998861 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66d1723b-e833-4757-a88a-c26e56a5d918-tls-certs\") pod \"rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l\" (UID: \"66d1723b-e833-4757-a88a-c26e56a5d918\") " pod="ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l" Jul 10 15:10:26.003691 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:26.003673 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t68s\" (UniqueName: \"kubernetes.io/projected/66d1723b-e833-4757-a88a-c26e56a5d918-kube-api-access-4t68s\") pod \"rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l\" (UID: \"66d1723b-e833-4757-a88a-c26e56a5d918\") " pod="ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l" Jul 10 15:10:26.113208 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:26.113152 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l" Jul 10 15:10:26.243229 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:26.243203 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l"] Jul 10 15:10:26.244950 ip-10-0-137-101 kubenswrapper[2571]: W0710 15:10:26.244911 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod66d1723b_e833_4757_a88a_c26e56a5d918.slice/crio-cc720ac454b0a9fe3723f20594751610a5dc59677d43ee66b09b46d4a85dae5a WatchSource:0}: Error finding container cc720ac454b0a9fe3723f20594751610a5dc59677d43ee66b09b46d4a85dae5a: Status 404 returned error can't find the container with id cc720ac454b0a9fe3723f20594751610a5dc59677d43ee66b09b46d4a85dae5a Jul 10 15:10:26.824293 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:26.824262 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l" event={"ID":"66d1723b-e833-4757-a88a-c26e56a5d918","Type":"ContainerStarted","Data":"f97a49f0feb1368f882c2448a571a518638c2c9863a899500439c318e5f96188"} Jul 10 15:10:26.824293 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:26.824299 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l" event={"ID":"66d1723b-e833-4757-a88a-c26e56a5d918","Type":"ContainerStarted","Data":"cc720ac454b0a9fe3723f20594751610a5dc59677d43ee66b09b46d4a85dae5a"} Jul 10 15:10:26.839867 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:26.839776 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l" podStartSLOduration=1.839757243 podStartE2EDuration="1.839757243s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-10 15:10:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:10:26.839129205 +0000 UTC m=+2344.916790755" watchObservedRunningTime="2026-07-10 15:10:26.839757243 +0000 UTC m=+2344.917418788" Jul 10 15:10:36.113414 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:36.113382 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l" Jul 10 15:10:36.113790 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:36.113428 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l" Jul 10 15:10:36.125656 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:36.125623 2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l" Jul 10 15:10:36.878113 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:36.878078 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l" Jul 10 15:10:37.327251 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:37.327189 2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5" podUID="b48e9f3d-1e77-4bfc-8408-b9fd873033ca" containerName="main" containerID="cri-o://3527d3800564e8997502b48414b76aa6d2075d42845684a95f32f95457413862" gracePeriod=45 Jul 10 15:10:37.576959 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:37.576936 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5" Jul 10 15:10:37.699366 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:37.699342 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-model-cache\") pod \"b48e9f3d-1e77-4bfc-8408-b9fd873033ca\" (UID: \"b48e9f3d-1e77-4bfc-8408-b9fd873033ca\") " Jul 10 15:10:37.699507 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:37.699384 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-tls-certs\") pod \"b48e9f3d-1e77-4bfc-8408-b9fd873033ca\" (UID: \"b48e9f3d-1e77-4bfc-8408-b9fd873033ca\") " Jul 10 15:10:37.699507 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:37.699429 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-dshm\") pod \"b48e9f3d-1e77-4bfc-8408-b9fd873033ca\" (UID: \"b48e9f3d-1e77-4bfc-8408-b9fd873033ca\") " Jul 10 15:10:37.699507 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:37.699459 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w6ct7\" (UniqueName: \"kubernetes.io/projected/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-kube-api-access-w6ct7\") pod \"b48e9f3d-1e77-4bfc-8408-b9fd873033ca\" (UID: \"b48e9f3d-1e77-4bfc-8408-b9fd873033ca\") " Jul 10 15:10:37.699507 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:37.699483 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-tmp-dir\") pod \"b48e9f3d-1e77-4bfc-8408-b9fd873033ca\" (UID: \"b48e9f3d-1e77-4bfc-8408-b9fd873033ca\") " Jul 10 15:10:37.699507 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:37.699497 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-home\") pod \"b48e9f3d-1e77-4bfc-8408-b9fd873033ca\" (UID: \"b48e9f3d-1e77-4bfc-8408-b9fd873033ca\") " Jul 10 15:10:37.699767 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:37.699630 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-model-cache" (OuterVolumeSpecName: "model-cache") pod "b48e9f3d-1e77-4bfc-8408-b9fd873033ca" (UID: "b48e9f3d-1e77-4bfc-8408-b9fd873033ca"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:10:37.699767 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:37.699758 2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-model-cache\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 15:10:37.699860 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:37.699782 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b48e9f3d-1e77-4bfc-8408-b9fd873033ca" (UID: "b48e9f3d-1e77-4bfc-8408-b9fd873033ca"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:10:37.699860 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:37.699804 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-home" (OuterVolumeSpecName: "home") pod "b48e9f3d-1e77-4bfc-8408-b9fd873033ca" (UID: "b48e9f3d-1e77-4bfc-8408-b9fd873033ca"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:10:37.701597 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:37.701576 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-kube-api-access-w6ct7" (OuterVolumeSpecName: "kube-api-access-w6ct7") pod "b48e9f3d-1e77-4bfc-8408-b9fd873033ca" (UID: "b48e9f3d-1e77-4bfc-8408-b9fd873033ca"). InnerVolumeSpecName "kube-api-access-w6ct7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 15:10:37.701683 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:37.701623 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b48e9f3d-1e77-4bfc-8408-b9fd873033ca" (UID: "b48e9f3d-1e77-4bfc-8408-b9fd873033ca"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:10:37.701683 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:37.701651 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-dshm" (OuterVolumeSpecName: "dshm") pod "b48e9f3d-1e77-4bfc-8408-b9fd873033ca" (UID: "b48e9f3d-1e77-4bfc-8408-b9fd873033ca"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:10:37.801062 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:37.801030 2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-tls-certs\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 15:10:37.801062 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:37.801055 2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-dshm\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 15:10:37.801209 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:37.801068 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w6ct7\" (UniqueName: \"kubernetes.io/projected/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-kube-api-access-w6ct7\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 15:10:37.801209 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:37.801081 2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-tmp-dir\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 15:10:37.801209 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:37.801093 2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b48e9f3d-1e77-4bfc-8408-b9fd873033ca-home\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 15:10:37.872586 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:37.872558 2571 generic.go:356] "Generic (PLEG): container finished" podID="b48e9f3d-1e77-4bfc-8408-b9fd873033ca" containerID="3527d3800564e8997502b48414b76aa6d2075d42845684a95f32f95457413862" exitCode=0 Jul 10 15:10:37.872723 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:37.872607 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5" Jul 10 15:10:37.872723 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:37.872646 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5" event={"ID":"b48e9f3d-1e77-4bfc-8408-b9fd873033ca","Type":"ContainerDied","Data":"3527d3800564e8997502b48414b76aa6d2075d42845684a95f32f95457413862"} Jul 10 15:10:37.872723 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:37.872688 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5" event={"ID":"b48e9f3d-1e77-4bfc-8408-b9fd873033ca","Type":"ContainerDied","Data":"e15c5a305f5c34954594613670ae3df5de2936927e25bfda4478f56079f2240c"} Jul 10 15:10:37.872723 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:37.872704 2571 scope.go:117] "RemoveContainer" containerID="3527d3800564e8997502b48414b76aa6d2075d42845684a95f32f95457413862" Jul 10 15:10:37.881016 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:37.880995 2571 scope.go:117] "RemoveContainer" containerID="3527d3800564e8997502b48414b76aa6d2075d42845684a95f32f95457413862" Jul 10 15:10:37.881258 ip-10-0-137-101 kubenswrapper[2571]: E0710 15:10:37.881241 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3527d3800564e8997502b48414b76aa6d2075d42845684a95f32f95457413862\": container with ID starting with 3527d3800564e8997502b48414b76aa6d2075d42845684a95f32f95457413862 not found: ID does not exist" containerID="3527d3800564e8997502b48414b76aa6d2075d42845684a95f32f95457413862" Jul 10 15:10:37.881311 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:37.881267 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3527d3800564e8997502b48414b76aa6d2075d42845684a95f32f95457413862"} err="failed to get container status \"3527d3800564e8997502b48414b76aa6d2075d42845684a95f32f95457413862\": rpc error: code = NotFound desc = could not find container \"3527d3800564e8997502b48414b76aa6d2075d42845684a95f32f95457413862\": container with ID starting with 3527d3800564e8997502b48414b76aa6d2075d42845684a95f32f95457413862 not found: ID does not exist" Jul 10 15:10:37.893111 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:37.893088 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5"] Jul 10 15:10:37.895169 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:37.895149 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-f923ab/sub-test-model-f923ab-kserve-5d9b6f6845-82ng5"] Jul 10 15:10:38.462397 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:10:38.462366 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b48e9f3d-1e77-4bfc-8408-b9fd873033ca" path="/var/lib/kubelet/pods/b48e9f3d-1e77-4bfc-8408-b9fd873033ca/volumes" Jul 10 15:11:22.511783 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:11:22.511673 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7clbv_b7c12f35-7b1f-4341-9302-0dfe837776f8/ovn-acl-logging/0.log" Jul 10 15:11:22.519136 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:11:22.519110 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7clbv_b7c12f35-7b1f-4341-9302-0dfe837776f8/ovn-acl-logging/0.log" Jul 10 15:11:49.311222 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:11:49.311147 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l"] Jul 10 15:12:04.331222 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:04.331163 2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l" podUID="66d1723b-e833-4757-a88a-c26e56a5d918" containerName="main" containerID="cri-o://f97a49f0feb1368f882c2448a571a518638c2c9863a899500439c318e5f96188" gracePeriod=45 Jul 10 15:12:04.578354 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:04.578329 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l" Jul 10 15:12:04.624137 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:04.624075 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66d1723b-e833-4757-a88a-c26e56a5d918-dshm\") pod \"66d1723b-e833-4757-a88a-c26e56a5d918\" (UID: \"66d1723b-e833-4757-a88a-c26e56a5d918\") " Jul 10 15:12:04.624137 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:04.624117 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66d1723b-e833-4757-a88a-c26e56a5d918-tmp-dir\") pod \"66d1723b-e833-4757-a88a-c26e56a5d918\" (UID: \"66d1723b-e833-4757-a88a-c26e56a5d918\") " Jul 10 15:12:04.624137 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:04.624137 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66d1723b-e833-4757-a88a-c26e56a5d918-tls-certs\") pod \"66d1723b-e833-4757-a88a-c26e56a5d918\" (UID: \"66d1723b-e833-4757-a88a-c26e56a5d918\") " Jul 10 15:12:04.624371 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:04.624170 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66d1723b-e833-4757-a88a-c26e56a5d918-model-cache\") pod \"66d1723b-e833-4757-a88a-c26e56a5d918\" (UID: \"66d1723b-e833-4757-a88a-c26e56a5d918\") " Jul 10 15:12:04.624371 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:04.624194 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66d1723b-e833-4757-a88a-c26e56a5d918-home\") pod \"66d1723b-e833-4757-a88a-c26e56a5d918\" (UID: \"66d1723b-e833-4757-a88a-c26e56a5d918\") " Jul 10 15:12:04.624371 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:04.624223 2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4t68s\" (UniqueName: \"kubernetes.io/projected/66d1723b-e833-4757-a88a-c26e56a5d918-kube-api-access-4t68s\") pod \"66d1723b-e833-4757-a88a-c26e56a5d918\" (UID: \"66d1723b-e833-4757-a88a-c26e56a5d918\") " Jul 10 15:12:04.624584 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:04.624394 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66d1723b-e833-4757-a88a-c26e56a5d918-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "66d1723b-e833-4757-a88a-c26e56a5d918" (UID: "66d1723b-e833-4757-a88a-c26e56a5d918"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:12:04.624584 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:04.624443 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66d1723b-e833-4757-a88a-c26e56a5d918-home" (OuterVolumeSpecName: "home") pod "66d1723b-e833-4757-a88a-c26e56a5d918" (UID: "66d1723b-e833-4757-a88a-c26e56a5d918"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:12:04.624584 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:04.624472 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66d1723b-e833-4757-a88a-c26e56a5d918-model-cache" (OuterVolumeSpecName: "model-cache") pod "66d1723b-e833-4757-a88a-c26e56a5d918" (UID: "66d1723b-e833-4757-a88a-c26e56a5d918"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:12:04.626149 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:04.626126 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/66d1723b-e833-4757-a88a-c26e56a5d918-dshm" (OuterVolumeSpecName: "dshm") pod "66d1723b-e833-4757-a88a-c26e56a5d918" (UID: "66d1723b-e833-4757-a88a-c26e56a5d918"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 10 15:12:04.626322 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:04.626302 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/66d1723b-e833-4757-a88a-c26e56a5d918-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "66d1723b-e833-4757-a88a-c26e56a5d918" (UID: "66d1723b-e833-4757-a88a-c26e56a5d918"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 10 15:12:04.626408 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:04.626389 2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/66d1723b-e833-4757-a88a-c26e56a5d918-kube-api-access-4t68s" (OuterVolumeSpecName: "kube-api-access-4t68s") pod "66d1723b-e833-4757-a88a-c26e56a5d918" (UID: "66d1723b-e833-4757-a88a-c26e56a5d918"). InnerVolumeSpecName "kube-api-access-4t68s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 10 15:12:04.725308 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:04.725269 2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66d1723b-e833-4757-a88a-c26e56a5d918-dshm\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 15:12:04.725308 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:04.725302 2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/66d1723b-e833-4757-a88a-c26e56a5d918-tmp-dir\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 15:12:04.725308 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:04.725312 2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66d1723b-e833-4757-a88a-c26e56a5d918-tls-certs\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 15:12:04.725308 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:04.725319 2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66d1723b-e833-4757-a88a-c26e56a5d918-model-cache\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 15:12:04.725538 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:04.725327 2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66d1723b-e833-4757-a88a-c26e56a5d918-home\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 15:12:04.725538 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:04.725335 2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4t68s\" (UniqueName: \"kubernetes.io/projected/66d1723b-e833-4757-a88a-c26e56a5d918-kube-api-access-4t68s\") on node \"ip-10-0-137-101.ec2.internal\" DevicePath \"\"" Jul 10 15:12:05.250167 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:05.250130 2571 generic.go:356] "Generic (PLEG): container finished" podID="66d1723b-e833-4757-a88a-c26e56a5d918" containerID="f97a49f0feb1368f882c2448a571a518638c2c9863a899500439c318e5f96188" exitCode=0 Jul 10 15:12:05.250167 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:05.250170 2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l" Jul 10 15:12:05.250358 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:05.250217 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l" event={"ID":"66d1723b-e833-4757-a88a-c26e56a5d918","Type":"ContainerDied","Data":"f97a49f0feb1368f882c2448a571a518638c2c9863a899500439c318e5f96188"} Jul 10 15:12:05.250358 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:05.250258 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l" event={"ID":"66d1723b-e833-4757-a88a-c26e56a5d918","Type":"ContainerDied","Data":"cc720ac454b0a9fe3723f20594751610a5dc59677d43ee66b09b46d4a85dae5a"} Jul 10 15:12:05.250358 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:05.250277 2571 scope.go:117] "RemoveContainer" containerID="f97a49f0feb1368f882c2448a571a518638c2c9863a899500439c318e5f96188" Jul 10 15:12:05.263572 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:05.263552 2571 scope.go:117] "RemoveContainer" containerID="f97a49f0feb1368f882c2448a571a518638c2c9863a899500439c318e5f96188" Jul 10 15:12:05.263834 ip-10-0-137-101 kubenswrapper[2571]: E0710 15:12:05.263815 2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f97a49f0feb1368f882c2448a571a518638c2c9863a899500439c318e5f96188\": container with ID starting with f97a49f0feb1368f882c2448a571a518638c2c9863a899500439c318e5f96188 not found: ID does not exist" containerID="f97a49f0feb1368f882c2448a571a518638c2c9863a899500439c318e5f96188" Jul 10 15:12:05.263923 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:05.263843 2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f97a49f0feb1368f882c2448a571a518638c2c9863a899500439c318e5f96188"} err="failed to get container status \"f97a49f0feb1368f882c2448a571a518638c2c9863a899500439c318e5f96188\": rpc error: code = NotFound desc = could not find container \"f97a49f0feb1368f882c2448a571a518638c2c9863a899500439c318e5f96188\": container with ID starting with f97a49f0feb1368f882c2448a571a518638c2c9863a899500439c318e5f96188 not found: ID does not exist" Jul 10 15:12:05.273329 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:05.273303 2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l"] Jul 10 15:12:05.276836 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:05.276815 2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-1f1c9a/rate-test-model-1f1c9a-kserve-7ffdbf8487-xjd4l"] Jul 10 15:12:06.463664 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:06.463627 2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="66d1723b-e833-4757-a88a-c26e56a5d918" path="/var/lib/kubelet/pods/66d1723b-e833-4757-a88a-c26e56a5d918/volumes" Jul 10 15:12:29.764908 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:29.764881 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-547957cd78-zsm5q_7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287/copy-manifests/0.log" Jul 10 15:12:29.772288 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:29.772266 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-547957cd78-zsm5q_7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287/manager/0.log" Jul 10 15:12:33.160120 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:33.160089 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xgg58_393ed4f2-6eb7-4710-8319-cb8ccf5a2b56/discovery/0.log" Jul 10 15:12:33.417740 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:33.417667 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65d766598b-q9plf_adb3da3b-85b5-4dd4-a21f-af7d50e5e1ae/kube-auth-proxy/0.log" Jul 10 15:12:34.525061 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:34.525016 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-5ghsv_86f22a40-9f52-45c7-91bf-f77ff4ab4c99/main/0.log" Jul 10 15:12:34.896130 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:34.896031 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-d8297_acf94efa-27b6-4c66-8b20-e7506913466b/main/0.log" Jul 10 15:12:41.834613 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:41.834585 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tc6vj_031289f7-f9ec-407f-8fa5-98afbc1755a3/global-pull-secret-syncer/0.log" Jul 10 15:12:41.917939 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:41.917903 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-blxtv_7d133399-fc4f-49c3-9dca-7fd75f87add1/konnectivity-agent/0.log" Jul 10 15:12:41.968652 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:41.968623 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-101.ec2.internal_43b50c0f30ea9d35967a41671db4af49/haproxy/0.log" Jul 10 15:12:49.468810 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:49.468773 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_98683e94-703e-455c-a069-def463432e0f/alertmanager/0.log" Jul 10 15:12:49.492388 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:49.492366 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_98683e94-703e-455c-a069-def463432e0f/config-reloader/0.log" Jul 10 15:12:49.512774 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:49.512753 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_98683e94-703e-455c-a069-def463432e0f/kube-rbac-proxy-web/0.log" Jul 10 15:12:49.536512 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:49.536495 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_98683e94-703e-455c-a069-def463432e0f/kube-rbac-proxy/0.log" Jul 10 15:12:49.555419 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:49.555399 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_98683e94-703e-455c-a069-def463432e0f/kube-rbac-proxy-metric/0.log" Jul 10 15:12:49.573283 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:49.573265 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_98683e94-703e-455c-a069-def463432e0f/prom-label-proxy/0.log" Jul 10 15:12:49.591764 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:49.591742 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_98683e94-703e-455c-a069-def463432e0f/init-config-reloader/0.log" Jul 10 15:12:49.743087 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:49.743019 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-jhqqr_c11e10d3-bb73-455b-b57b-3e88b4cc3855/monitoring-plugin/0.log" Jul 10 15:12:49.919493 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:49.919470 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mg4gr_85833fc3-8c9e-41a7-94bc-aba18096e17d/node-exporter/0.log" Jul 10 15:12:49.937465 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:49.937441 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mg4gr_85833fc3-8c9e-41a7-94bc-aba18096e17d/kube-rbac-proxy/0.log" Jul 10 15:12:49.955936 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:49.955916 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mg4gr_85833fc3-8c9e-41a7-94bc-aba18096e17d/init-textfile/0.log" Jul 10 15:12:50.048122 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:50.048036 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_127cdd83-4138-4109-a8ba-fcb01b8a7eed/prometheus/0.log" Jul 10 15:12:50.067001 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:50.066950 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_127cdd83-4138-4109-a8ba-fcb01b8a7eed/config-reloader/0.log" Jul 10 15:12:50.085940 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:50.085919 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_127cdd83-4138-4109-a8ba-fcb01b8a7eed/thanos-sidecar/0.log" Jul 10 15:12:50.103276 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:50.103253 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_127cdd83-4138-4109-a8ba-fcb01b8a7eed/kube-rbac-proxy-web/0.log" Jul 10 15:12:50.121150 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:50.121131 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_127cdd83-4138-4109-a8ba-fcb01b8a7eed/kube-rbac-proxy/0.log" Jul 10 15:12:50.139916 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:50.139895 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_127cdd83-4138-4109-a8ba-fcb01b8a7eed/kube-rbac-proxy-thanos/0.log" Jul 10 15:12:50.161126 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:50.161107 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_127cdd83-4138-4109-a8ba-fcb01b8a7eed/init-config-reloader/0.log" Jul 10 15:12:50.187000 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:50.186962 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-p44lx_cf383efe-1048-46b7-9024-288da2f39ef7/prometheus-operator/0.log" Jul 10 15:12:50.200354 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:50.200335 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-p44lx_cf383efe-1048-46b7-9024-288da2f39ef7/kube-rbac-proxy/0.log" Jul 10 15:12:50.251690 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:50.251666 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-84599b86b6-5vt2d_a598e8d8-ceee-4f31-9597-e6a2f6d39685/telemeter-client/0.log" Jul 10 15:12:50.272218 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:50.272198 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-84599b86b6-5vt2d_a598e8d8-ceee-4f31-9597-e6a2f6d39685/reload/0.log" Jul 10 15:12:50.296694 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:50.296666 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-84599b86b6-5vt2d_a598e8d8-ceee-4f31-9597-e6a2f6d39685/kube-rbac-proxy/0.log" Jul 10 15:12:50.320473 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:50.320411 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c6d66b8b7-t7dsd_b83f2b41-b0c7-4516-a51d-e28730a1de64/thanos-query/0.log" Jul 10 15:12:50.335924 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:50.335902 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c6d66b8b7-t7dsd_b83f2b41-b0c7-4516-a51d-e28730a1de64/kube-rbac-proxy-web/0.log" Jul 10 15:12:50.357760 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:50.357743 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c6d66b8b7-t7dsd_b83f2b41-b0c7-4516-a51d-e28730a1de64/kube-rbac-proxy/0.log" Jul 10 15:12:50.374125 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:50.374106 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c6d66b8b7-t7dsd_b83f2b41-b0c7-4516-a51d-e28730a1de64/prom-label-proxy/0.log" Jul 10 15:12:50.391891 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:50.391864 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c6d66b8b7-t7dsd_b83f2b41-b0c7-4516-a51d-e28730a1de64/kube-rbac-proxy-rules/0.log" Jul 10 15:12:50.409131 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:50.409112 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c6d66b8b7-t7dsd_b83f2b41-b0c7-4516-a51d-e28730a1de64/kube-rbac-proxy-metrics/0.log" Jul 10 15:12:51.791312 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:51.791276 2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n89zh/perf-node-gather-daemonset-m85dr"] Jul 10 15:12:51.791782 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:51.791762 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="66d1723b-e833-4757-a88a-c26e56a5d918" containerName="main" Jul 10 15:12:51.791854 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:51.791786 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="66d1723b-e833-4757-a88a-c26e56a5d918" containerName="main" Jul 10 15:12:51.791854 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:51.791812 2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b48e9f3d-1e77-4bfc-8408-b9fd873033ca" containerName="main" Jul 10 15:12:51.791854 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:51.791821 2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b48e9f3d-1e77-4bfc-8408-b9fd873033ca" containerName="main" Jul 10 15:12:51.792044 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:51.791904 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b48e9f3d-1e77-4bfc-8408-b9fd873033ca" containerName="main" Jul 10 15:12:51.792044 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:51.791920 2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="66d1723b-e833-4757-a88a-c26e56a5d918" containerName="main" Jul 10 15:12:51.795214 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:51.795194 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-m85dr" Jul 10 15:12:51.797592 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:51.797571 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n89zh\"/\"openshift-service-ca.crt\"" Jul 10 15:12:51.798551 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:51.798525 2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n89zh\"/\"default-dockercfg-h7l2f\"" Jul 10 15:12:51.798643 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:51.798557 2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n89zh\"/\"kube-root-ca.crt\"" Jul 10 15:12:51.803931 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:51.803912 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n89zh/perf-node-gather-daemonset-m85dr"] Jul 10 15:12:51.832210 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:51.832185 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c43d1fb5-d33c-43d5-8cd1-7e93026b8f36-lib-modules\") pod \"perf-node-gather-daemonset-m85dr\" (UID: \"c43d1fb5-d33c-43d5-8cd1-7e93026b8f36\") " pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-m85dr" Jul 10 15:12:51.832313 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:51.832225 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c43d1fb5-d33c-43d5-8cd1-7e93026b8f36-proc\") pod \"perf-node-gather-daemonset-m85dr\" (UID: \"c43d1fb5-d33c-43d5-8cd1-7e93026b8f36\") " pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-m85dr" Jul 10 15:12:51.832313 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:51.832244 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c43d1fb5-d33c-43d5-8cd1-7e93026b8f36-sys\") pod \"perf-node-gather-daemonset-m85dr\" (UID: \"c43d1fb5-d33c-43d5-8cd1-7e93026b8f36\") " pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-m85dr" Jul 10 15:12:51.832438 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:51.832340 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgz49\" (UniqueName: \"kubernetes.io/projected/c43d1fb5-d33c-43d5-8cd1-7e93026b8f36-kube-api-access-tgz49\") pod \"perf-node-gather-daemonset-m85dr\" (UID: \"c43d1fb5-d33c-43d5-8cd1-7e93026b8f36\") " pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-m85dr" Jul 10 15:12:51.832438 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:51.832404 2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c43d1fb5-d33c-43d5-8cd1-7e93026b8f36-podres\") pod \"perf-node-gather-daemonset-m85dr\" (UID: \"c43d1fb5-d33c-43d5-8cd1-7e93026b8f36\") " pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-m85dr" Jul 10 15:12:51.933077 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:51.933046 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c43d1fb5-d33c-43d5-8cd1-7e93026b8f36-proc\") pod \"perf-node-gather-daemonset-m85dr\" (UID: \"c43d1fb5-d33c-43d5-8cd1-7e93026b8f36\") " pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-m85dr" Jul 10 15:12:51.933077 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:51.933078 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c43d1fb5-d33c-43d5-8cd1-7e93026b8f36-sys\") pod \"perf-node-gather-daemonset-m85dr\" (UID: \"c43d1fb5-d33c-43d5-8cd1-7e93026b8f36\") " pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-m85dr" Jul 10 15:12:51.933221 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:51.933109 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgz49\" (UniqueName: \"kubernetes.io/projected/c43d1fb5-d33c-43d5-8cd1-7e93026b8f36-kube-api-access-tgz49\") pod \"perf-node-gather-daemonset-m85dr\" (UID: \"c43d1fb5-d33c-43d5-8cd1-7e93026b8f36\") " pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-m85dr" Jul 10 15:12:51.933221 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:51.933154 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c43d1fb5-d33c-43d5-8cd1-7e93026b8f36-podres\") pod \"perf-node-gather-daemonset-m85dr\" (UID: \"c43d1fb5-d33c-43d5-8cd1-7e93026b8f36\") " pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-m85dr" Jul 10 15:12:51.933221 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:51.933162 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c43d1fb5-d33c-43d5-8cd1-7e93026b8f36-proc\") pod \"perf-node-gather-daemonset-m85dr\" (UID: \"c43d1fb5-d33c-43d5-8cd1-7e93026b8f36\") " pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-m85dr" Jul 10 15:12:51.933221 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:51.933173 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c43d1fb5-d33c-43d5-8cd1-7e93026b8f36-sys\") pod \"perf-node-gather-daemonset-m85dr\" (UID: \"c43d1fb5-d33c-43d5-8cd1-7e93026b8f36\") " pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-m85dr" Jul 10 15:12:51.933348 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:51.933230 2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c43d1fb5-d33c-43d5-8cd1-7e93026b8f36-lib-modules\") pod \"perf-node-gather-daemonset-m85dr\" (UID: \"c43d1fb5-d33c-43d5-8cd1-7e93026b8f36\") " pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-m85dr" Jul 10 15:12:51.933348 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:51.933289 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c43d1fb5-d33c-43d5-8cd1-7e93026b8f36-podres\") pod \"perf-node-gather-daemonset-m85dr\" (UID: \"c43d1fb5-d33c-43d5-8cd1-7e93026b8f36\") " pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-m85dr" Jul 10 15:12:51.933348 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:51.933336 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c43d1fb5-d33c-43d5-8cd1-7e93026b8f36-lib-modules\") pod \"perf-node-gather-daemonset-m85dr\" (UID: \"c43d1fb5-d33c-43d5-8cd1-7e93026b8f36\") " pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-m85dr" Jul 10 15:12:51.941021 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:51.940992 2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgz49\" (UniqueName: \"kubernetes.io/projected/c43d1fb5-d33c-43d5-8cd1-7e93026b8f36-kube-api-access-tgz49\") pod \"perf-node-gather-daemonset-m85dr\" (UID: \"c43d1fb5-d33c-43d5-8cd1-7e93026b8f36\") " pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-m85dr" Jul 10 15:12:52.105341 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:52.105259 2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-m85dr" Jul 10 15:12:52.242271 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:52.242237 2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n89zh/perf-node-gather-daemonset-m85dr"] Jul 10 15:12:52.250151 ip-10-0-137-101 kubenswrapper[2571]: W0710 15:12:52.250121 2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc43d1fb5_d33c_43d5_8cd1_7e93026b8f36.slice/crio-853c9122d15937f3d38faffee4db58f0c8ee8a6e30ebe06900191f9f39bdc325 WatchSource:0}: Error finding container 853c9122d15937f3d38faffee4db58f0c8ee8a6e30ebe06900191f9f39bdc325: Status 404 returned error can't find the container with id 853c9122d15937f3d38faffee4db58f0c8ee8a6e30ebe06900191f9f39bdc325 Jul 10 15:12:52.465912 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:52.465873 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-m85dr" event={"ID":"c43d1fb5-d33c-43d5-8cd1-7e93026b8f36","Type":"ContainerStarted","Data":"e5bf1f5c305882e06aff747400eeb1c6c14be7343e0b5d5282a01a74c36f04a2"} Jul 10 15:12:52.466072 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:52.465927 2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-m85dr" event={"ID":"c43d1fb5-d33c-43d5-8cd1-7e93026b8f36","Type":"ContainerStarted","Data":"853c9122d15937f3d38faffee4db58f0c8ee8a6e30ebe06900191f9f39bdc325"} Jul 10 15:12:52.466072 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:52.465952 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-m85dr" Jul 10 15:12:52.481699 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:52.481656 2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-m85dr" podStartSLOduration=1.481641593 podStartE2EDuration="1.481641593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-10 15:12:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-10 15:12:52.480102503 +0000 UTC m=+2490.557764049" watchObservedRunningTime="2026-07-10 15:12:52.481641593 +0000 UTC m=+2490.559303137" Jul 10 15:12:54.222642 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:54.222613 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jfwz6_48f012e8-1e12-4df9-a332-889d32b19f44/dns/0.log" Jul 10 15:12:54.238954 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:54.238926 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jfwz6_48f012e8-1e12-4df9-a332-889d32b19f44/kube-rbac-proxy/0.log" Jul 10 15:12:54.332992 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:54.332944 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v8vnr_345640dc-39fb-4506-bc54-31d2d64a8868/dns-node-resolver/0.log" Jul 10 15:12:54.844984 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:54.844936 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2t8rd_cd58d732-88c2-4445-9682-a34d2488896e/node-ca/0.log" Jul 10 15:12:55.944075 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:55.944038 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xgg58_393ed4f2-6eb7-4710-8319-cb8ccf5a2b56/discovery/0.log" Jul 10 15:12:55.983871 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:55.983839 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65d766598b-q9plf_adb3da3b-85b5-4dd4-a21f-af7d50e5e1ae/kube-auth-proxy/0.log" Jul 10 15:12:56.859945 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:56.859915 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wdx2d_13ee1d4e-21f9-4af1-80db-98bd57925107/serve-healthcheck-canary/0.log" Jul 10 15:12:57.340874 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:57.340845 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n84n4_5e7585d6-9ee5-4459-a03d-87525c804667/kube-rbac-proxy/0.log" Jul 10 15:12:57.358736 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:57.358713 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n84n4_5e7585d6-9ee5-4459-a03d-87525c804667/exporter/0.log" Jul 10 15:12:57.375259 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:57.375238 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n84n4_5e7585d6-9ee5-4459-a03d-87525c804667/extractor/0.log" Jul 10 15:12:58.479807 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:12:58.479782 2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n89zh/perf-node-gather-daemonset-m85dr" Jul 10 15:13:00.157176 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:13:00.157147 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-547957cd78-zsm5q_7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287/manager/0.log" Jul 10 15:13:00.175023 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:13:00.175000 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-547957cd78-zsm5q_7a1e9cf9-a480-4bb5-a6fe-b5d6161e0287/copy-manifests/0.log" Jul 10 15:13:01.374607 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:13:01.374572 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-d76757ddd-4qlp6_0f99d889-8c56-487e-93eb-7b2f45714ae7/manager/0.log" Jul 10 15:13:01.422141 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:13:01.422115 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-dbsdx_73ac9da1-f6bd-48d9-a615-de88d2614e77/openshift-lws-operator/0.log" Jul 10 15:13:02.455796 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:13:02.455760 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xgg58_393ed4f2-6eb7-4710-8319-cb8ccf5a2b56/discovery/0.log" Jul 10 15:13:02.482153 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:13:02.481925 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65d766598b-q9plf_adb3da3b-85b5-4dd4-a21f-af7d50e5e1ae/kube-auth-proxy/0.log" Jul 10 15:13:04.002139 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:13:04.002107 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xgg58_393ed4f2-6eb7-4710-8319-cb8ccf5a2b56/discovery/0.log" Jul 10 15:13:04.038108 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:13:04.038030 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-65d766598b-q9plf_adb3da3b-85b5-4dd4-a21f-af7d50e5e1ae/kube-auth-proxy/0.log" Jul 10 15:13:07.864506 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:13:07.864480 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p5ggd_6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7/kube-multus-additional-cni-plugins/0.log" Jul 10 15:13:07.880609 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:13:07.880584 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p5ggd_6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7/egress-router-binary-copy/0.log" Jul 10 15:13:07.940240 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:13:07.940216 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p5ggd_6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7/cni-plugins/0.log" Jul 10 15:13:07.956862 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:13:07.956843 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p5ggd_6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7/bond-cni-plugin/0.log" Jul 10 15:13:07.973460 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:13:07.973440 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p5ggd_6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7/routeoverride-cni/0.log" Jul 10 15:13:07.996563 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:13:07.996538 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p5ggd_6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7/whereabouts-cni-bincopy/0.log" Jul 10 15:13:08.012860 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:13:08.012838 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-p5ggd_6bc21e9c-43f2-47eb-a6a3-7e4ea43e55c7/whereabouts-cni/0.log" Jul 10 15:13:08.167268 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:13:08.167202 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-d22jx_20de4a51-a82e-45c4-b3f5-7bc548674778/kube-multus/0.log" Jul 10 15:13:08.253016 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:13:08.252993 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-x4brx_ea476f2b-59d7-4272-be5c-30a782f21228/network-metrics-daemon/0.log" Jul 10 15:13:08.271475 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:13:08.271457 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-x4brx_ea476f2b-59d7-4272-be5c-30a782f21228/kube-rbac-proxy/0.log" Jul 10 15:13:09.077086 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:13:09.077051 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7clbv_b7c12f35-7b1f-4341-9302-0dfe837776f8/ovn-controller/0.log" Jul 10 15:13:09.091803 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:13:09.091772 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7clbv_b7c12f35-7b1f-4341-9302-0dfe837776f8/ovn-acl-logging/1.log" Jul 10 15:13:09.092030 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:13:09.092013 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7clbv_b7c12f35-7b1f-4341-9302-0dfe837776f8/ovn-acl-logging/0.log" Jul 10 15:13:09.107385 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:13:09.107363 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7clbv_b7c12f35-7b1f-4341-9302-0dfe837776f8/kube-rbac-proxy-node/0.log" Jul 10 15:13:09.125591 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:13:09.125560 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7clbv_b7c12f35-7b1f-4341-9302-0dfe837776f8/kube-rbac-proxy-ovn-metrics/0.log" Jul 10 15:13:09.143915 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:13:09.143893 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7clbv_b7c12f35-7b1f-4341-9302-0dfe837776f8/northd/0.log" Jul 10 15:13:09.160885 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:13:09.160861 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7clbv_b7c12f35-7b1f-4341-9302-0dfe837776f8/nbdb/0.log" Jul 10 15:13:09.178593 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:13:09.178570 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7clbv_b7c12f35-7b1f-4341-9302-0dfe837776f8/sbdb/0.log" Jul 10 15:13:09.247049 ip-10-0-137-101 kubenswrapper[2571]: I0710 15:13:09.247022 2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7clbv_b7c12f35-7b1f-4341-9302-0dfe837776f8/ovnkube-controller/0.log"