Jul 07 14:06:58.015640 ip-10-0-130-152 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 07 14:06:58.015658 ip-10-0-130-152 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 07 14:06:58.015665 ip-10-0-130-152 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 07 14:06:58.015915 ip-10-0-130-152 systemd[1]: Failed to start Kubernetes Kubelet. Jul 07 14:07:08.160797 ip-10-0-130-152 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 07 14:07:08.160820 ip-10-0-130-152 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 2a7a14eb6a36430ab70de8588946a156 -- Jul 07 14:09:04.725109 ip-10-0-130-152 systemd[1]: Starting Kubernetes Kubelet... Jul 07 14:09:05.089558 ip-10-0-130-152 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 14:09:05.089558 ip-10-0-130-152 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 14:09:05.089558 ip-10-0-130-152 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 14:09:05.089558 ip-10-0-130-152 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 14:09:05.089558 ip-10-0-130-152 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 14:09:05.090615 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.090523 2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 14:09:05.094006 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.093988 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:09:05.094006 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094007 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:09:05.094074 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094011 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:09:05.094074 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094015 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:09:05.094074 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094019 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:09:05.094074 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094022 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:09:05.094074 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094025 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:09:05.094074 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094028 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:09:05.094074 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094031 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:09:05.094074 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094033 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:09:05.094074 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094036 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:09:05.094074 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094038 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:09:05.094074 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094041 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:09:05.094074 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094043 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:09:05.094074 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094046 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:09:05.094074 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094049 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:09:05.094074 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094051 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:09:05.094074 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094054 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:09:05.094074 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094057 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:09:05.094074 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094059 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:09:05.094074 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094062 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:09:05.094074 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094064 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:09:05.094643 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094067 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:09:05.094643 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094069 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:09:05.094643 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094072 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:09:05.094643 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094074 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:09:05.094643 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094077 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:09:05.094643 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094080 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:09:05.094643 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094083 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:09:05.094643 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094086 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:09:05.094643 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094088 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:09:05.094643 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094091 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:09:05.094643 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094094 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:09:05.094643 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094098 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:09:05.094643 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094101 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:09:05.094643 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094104 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:09:05.094643 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094107 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:09:05.094643 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094109 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:09:05.094643 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094112 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:09:05.094643 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094115 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:09:05.094643 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094117 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:09:05.094643 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094120 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:09:05.095156 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094123 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:09:05.095156 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094126 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:09:05.095156 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094128 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:09:05.095156 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094130 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:09:05.095156 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094133 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:09:05.095156 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094135 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:09:05.095156 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094138 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:09:05.095156 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094141 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:09:05.095156 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094143 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:09:05.095156 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094146 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:09:05.095156 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094148 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:09:05.095156 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094151 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:09:05.095156 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094153 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:09:05.095156 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094157 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:09:05.095156 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094160 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:09:05.095156 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094163 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:09:05.095156 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094166 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:09:05.095156 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094168 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:09:05.095156 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094171 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:09:05.095156 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094173 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:09:05.095674 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094176 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:09:05.095674 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094178 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:09:05.095674 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094181 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:09:05.095674 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094184 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:09:05.095674 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094186 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:09:05.095674 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094189 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:09:05.095674 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094191 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:09:05.095674 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094194 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:09:05.095674 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094196 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:09:05.095674 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094199 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:09:05.095674 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094202 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:09:05.095674 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094205 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:09:05.095674 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094207 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:09:05.095674 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094210 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:09:05.095674 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094212 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:09:05.095674 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094214 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:09:05.095674 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094217 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:09:05.095674 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094219 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:09:05.095674 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094222 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:09:05.096153 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094224 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:09:05.096153 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094228 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:09:05.096153 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094232 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:09:05.096153 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094235 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:09:05.096153 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094238 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:09:05.096153 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094240 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:09:05.096153 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094245 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:09:05.096153 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094249 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:09:05.096153 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094252 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:09:05.096153 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094255 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:09:05.096153 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094258 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:09:05.096153 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094260 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:09:05.096153 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094263 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:09:05.096153 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094266 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:09:05.096153 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094269 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:09:05.096153 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094271 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:09:05.096153 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094274 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:09:05.096153 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.094277 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:09:05.096153 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095005 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:09:05.096599 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095012 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:09:05.096599 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095015 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:09:05.096599 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095018 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:09:05.096599 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095021 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:09:05.096599 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095024 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:09:05.096599 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095026 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:09:05.096599 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095029 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:09:05.096599 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095031 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:09:05.096599 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095034 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:09:05.096599 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095037 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:09:05.096599 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095040 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:09:05.096599 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095042 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:09:05.096599 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095045 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:09:05.096599 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095048 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:09:05.096599 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095050 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:09:05.096599 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095053 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:09:05.096599 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095055 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:09:05.096599 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095058 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:09:05.096599 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095060 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:09:05.096599 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095064 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:09:05.097101 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095068 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:09:05.097101 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095072 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:09:05.097101 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095075 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:09:05.097101 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095078 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:09:05.097101 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095080 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:09:05.097101 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095083 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:09:05.097101 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095085 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:09:05.097101 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095088 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:09:05.097101 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095092 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:09:05.097101 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095094 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:09:05.097101 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095098 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:09:05.097101 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095100 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:09:05.097101 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095103 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:09:05.097101 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095105 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:09:05.097101 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095108 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:09:05.097101 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095110 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:09:05.097101 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095113 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:09:05.097101 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095115 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:09:05.097101 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095118 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:09:05.097101 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095120 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:09:05.097732 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095123 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:09:05.097732 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095126 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:09:05.097732 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095128 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:09:05.097732 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095131 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:09:05.097732 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095134 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:09:05.097732 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095137 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:09:05.097732 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095139 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:09:05.097732 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095142 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:09:05.097732 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095144 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:09:05.097732 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095146 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:09:05.097732 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095149 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:09:05.097732 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095152 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:09:05.097732 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095155 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:09:05.097732 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095157 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:09:05.097732 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095160 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:09:05.097732 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095162 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:09:05.097732 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095165 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:09:05.097732 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095168 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:09:05.097732 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095171 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:09:05.097732 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095173 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:09:05.098234 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095176 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:09:05.098234 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095178 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:09:05.098234 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095183 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:09:05.098234 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095187 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:09:05.098234 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095190 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:09:05.098234 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095193 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:09:05.098234 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095196 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:09:05.098234 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095199 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:09:05.098234 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095201 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:09:05.098234 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095204 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:09:05.098234 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095206 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:09:05.098234 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095208 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:09:05.098234 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095211 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:09:05.098234 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095213 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:09:05.098234 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095216 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:09:05.098234 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095218 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:09:05.098234 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095221 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:09:05.098234 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095223 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:09:05.098234 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095226 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:09:05.098683 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095228 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:09:05.098683 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095231 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:09:05.098683 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095233 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:09:05.098683 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095236 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:09:05.098683 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095239 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:09:05.098683 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095242 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:09:05.098683 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095244 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:09:05.098683 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095247 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:09:05.098683 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095249 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:09:05.098683 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095252 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:09:05.098683 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095254 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:09:05.098683 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095258 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:09:05.098683 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095262 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:09:05.098683 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095265 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:09:05.098683 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095267 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:09:05.098683 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095270 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:09:05.098683 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095274 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:09:05.098683 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095278 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:09:05.098683 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095335 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:09:05.099180 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095715 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:09:05.099180 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095734 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:09:05.099180 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095738 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:09:05.099180 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095742 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:09:05.099180 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095747 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:09:05.099180 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095751 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:09:05.099180 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095754 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:09:05.099180 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095757 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:09:05.099180 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095760 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:09:05.099180 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095763 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:09:05.099180 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095765 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:09:05.099180 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095768 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:09:05.099180 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095771 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:09:05.099180 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095774 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:09:05.099180 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095777 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:09:05.099180 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095780 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:09:05.099180 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095782 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:09:05.099180 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095785 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:09:05.099180 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095788 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:09:05.099632 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095790 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:09:05.099632 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095793 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:09:05.099632 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095795 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:09:05.099632 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095798 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:09:05.099632 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095800 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:09:05.099632 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095803 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:09:05.099632 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095805 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:09:05.099632 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095808 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:09:05.099632 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095810 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:09:05.099632 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095813 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:09:05.099632 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095815 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:09:05.099632 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095818 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:09:05.099632 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095821 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:09:05.099632 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095824 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:09:05.099632 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095826 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:09:05.099632 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095828 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:09:05.099632 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095831 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:09:05.099632 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095833 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:09:05.099632 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095836 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:09:05.099632 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095839 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:09:05.100131 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095841 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:09:05.100131 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095844 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:09:05.100131 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095847 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:09:05.100131 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095850 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:09:05.100131 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095853 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:09:05.100131 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095856 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:09:05.100131 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095858 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:09:05.100131 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095860 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:09:05.100131 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095863 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:09:05.100131 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095866 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:09:05.100131 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095868 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:09:05.100131 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095871 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:09:05.100131 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095874 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:09:05.100131 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095876 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:09:05.100131 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095879 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:09:05.100131 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095881 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:09:05.100131 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095883 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:09:05.100131 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095886 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:09:05.100131 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095889 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:09:05.100618 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095891 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:09:05.100618 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095894 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:09:05.100618 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095896 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:09:05.100618 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095898 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:09:05.100618 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095901 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:09:05.100618 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095904 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:09:05.100618 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095907 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:09:05.100618 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095909 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:09:05.100618 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095911 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:09:05.100618 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095914 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:09:05.100618 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095916 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:09:05.100618 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095919 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:09:05.100618 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095922 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:09:05.100618 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095924 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:09:05.100618 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095927 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:09:05.100618 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095929 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:09:05.100618 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095934 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:09:05.100618 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095937 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:09:05.100618 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095940 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:09:05.101098 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095943 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:09:05.101098 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095946 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:09:05.101098 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095949 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:09:05.101098 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095951 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:09:05.101098 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095955 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:09:05.101098 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095957 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:09:05.101098 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095960 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:09:05.101098 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095963 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:09:05.101098 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095966 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:09:05.101098 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095969 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:09:05.101098 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095971 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:09:05.101098 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095974 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:09:05.101098 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095976 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:09:05.101098 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095979 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:09:05.101098 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095982 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:09:05.101098 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095984 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:09:05.101098 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095987 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:09:05.101098 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095989 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:09:05.101098 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095991 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:09:05.101098 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095994 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:09:05.101575 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.095997 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:09:05.101575 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096000 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:09:05.101575 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096073 2557 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 14:09:05.101575 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096085 2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 14:09:05.101575 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096092 2557 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 14:09:05.101575 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096096 2557 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 14:09:05.101575 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096100 2557 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 14:09:05.101575 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096104 2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 14:09:05.101575 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096110 2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 14:09:05.101575 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096115 2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 14:09:05.101575 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096118 2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 14:09:05.101575 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096121 2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 14:09:05.101575 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096125 2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 14:09:05.101575 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096128 2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 14:09:05.101575 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096131 2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 14:09:05.101575 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096134 2557 flags.go:64] FLAG: --cgroup-root="" Jul 07 14:09:05.101575 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096137 2557 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 14:09:05.101575 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096140 2557 flags.go:64] FLAG: --client-ca-file="" Jul 07 14:09:05.101575 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096143 2557 flags.go:64] FLAG: --cloud-provider="external" Jul 07 14:09:05.101575 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096146 2557 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 14:09:05.101575 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096150 2557 flags.go:64] FLAG: --cluster-domain="" Jul 07 14:09:05.101575 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096153 2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 14:09:05.101575 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096156 2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 14:09:05.102130 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096159 2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 14:09:05.102130 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096162 2557 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 14:09:05.102130 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096166 2557 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 14:09:05.102130 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096169 2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 14:09:05.102130 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096172 2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 14:09:05.102130 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096176 2557 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 14:09:05.102130 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096179 2557 flags.go:64] FLAG: --contention-profiling="false" Jul 07 14:09:05.102130 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096182 2557 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 14:09:05.102130 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096185 2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 14:09:05.102130 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096189 2557 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 14:09:05.102130 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096191 2557 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 14:09:05.102130 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096195 2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 14:09:05.102130 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096199 2557 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 14:09:05.102130 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096203 2557 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 14:09:05.102130 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096206 2557 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 14:09:05.102130 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096209 2557 flags.go:64] FLAG: --enable-server="true" Jul 07 14:09:05.102130 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096212 2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 14:09:05.102130 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096221 2557 flags.go:64] FLAG: --event-burst="100" Jul 07 14:09:05.102130 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096224 2557 flags.go:64] FLAG: --event-qps="50" Jul 07 14:09:05.102130 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096227 2557 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 14:09:05.102130 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096230 2557 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 14:09:05.102130 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096233 2557 flags.go:64] FLAG: --eviction-hard="" Jul 07 14:09:05.102130 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096237 2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 14:09:05.102130 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096240 2557 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 14:09:05.102687 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096243 2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 14:09:05.102687 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096246 2557 flags.go:64] FLAG: --eviction-soft="" Jul 07 14:09:05.102687 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096248 2557 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 14:09:05.102687 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096251 2557 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 14:09:05.102687 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096254 2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 14:09:05.102687 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096257 2557 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 14:09:05.102687 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096260 2557 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 14:09:05.102687 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096262 2557 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 14:09:05.102687 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096265 2557 flags.go:64] FLAG: --feature-gates="" Jul 07 14:09:05.102687 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096269 2557 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 14:09:05.102687 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096272 2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 14:09:05.102687 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096275 2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 14:09:05.102687 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096278 2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 14:09:05.102687 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096281 2557 flags.go:64] FLAG: --healthz-port="10248" Jul 07 14:09:05.102687 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096284 2557 flags.go:64] FLAG: --help="false" Jul 07 14:09:05.102687 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096286 2557 flags.go:64] FLAG: --hostname-override="ip-10-0-130-152.ec2.internal" Jul 07 14:09:05.102687 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096289 2557 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 14:09:05.102687 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096292 2557 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 14:09:05.102687 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096296 2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 14:09:05.102687 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096299 2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 14:09:05.102687 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096302 2557 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 14:09:05.102687 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096306 2557 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 14:09:05.102687 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096309 2557 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 14:09:05.103322 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096312 2557 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 14:09:05.103322 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096315 2557 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 14:09:05.103322 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096319 2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 14:09:05.103322 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096322 2557 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 14:09:05.103322 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096325 2557 flags.go:64] FLAG: --kube-reserved="" Jul 07 14:09:05.103322 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096328 2557 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 14:09:05.103322 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096330 2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 14:09:05.103322 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096333 2557 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 14:09:05.103322 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096336 2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 14:09:05.103322 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096339 2557 flags.go:64] FLAG: --lock-file="" Jul 07 14:09:05.103322 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096341 2557 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 14:09:05.103322 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096344 2557 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 14:09:05.103322 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096347 2557 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 14:09:05.103322 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096352 2557 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 14:09:05.103322 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096355 2557 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 14:09:05.103322 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096358 2557 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 14:09:05.103322 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096360 2557 flags.go:64] FLAG: --logging-format="text" Jul 07 14:09:05.103322 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096363 2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 14:09:05.103322 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096366 2557 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 14:09:05.103322 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096369 2557 flags.go:64] FLAG: --manifest-url="" Jul 07 14:09:05.103322 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096372 2557 flags.go:64] FLAG: --manifest-url-header="" Jul 07 14:09:05.103322 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096376 2557 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 14:09:05.103322 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096379 2557 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 14:09:05.103322 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096383 2557 flags.go:64] FLAG: --max-pods="110" Jul 07 14:09:05.103322 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096385 2557 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 14:09:05.103942 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096388 2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 14:09:05.103942 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096391 2557 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 14:09:05.103942 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096393 2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 14:09:05.103942 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096396 2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 14:09:05.103942 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096399 2557 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 14:09:05.103942 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096404 2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 14:09:05.103942 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096411 2557 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 14:09:05.103942 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096414 2557 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 14:09:05.103942 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096416 2557 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 14:09:05.103942 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096421 2557 flags.go:64] FLAG: --pod-cidr="" Jul 07 14:09:05.103942 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096423 2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 14:09:05.103942 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096429 2557 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 14:09:05.103942 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096432 2557 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 14:09:05.103942 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096435 2557 flags.go:64] FLAG: --pods-per-core="0" Jul 07 14:09:05.103942 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096437 2557 flags.go:64] FLAG: --port="10250" Jul 07 14:09:05.103942 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096440 2557 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 14:09:05.103942 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096443 2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06f55bf352cbbd100" Jul 07 14:09:05.103942 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096446 2557 flags.go:64] FLAG: --qos-reserved="" Jul 07 14:09:05.103942 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096449 2557 flags.go:64] FLAG: --read-only-port="10255" Jul 07 14:09:05.103942 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096452 2557 flags.go:64] FLAG: --register-node="true" Jul 07 14:09:05.103942 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096455 2557 flags.go:64] FLAG: --register-with-taints="" Jul 07 14:09:05.103942 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096458 2557 flags.go:64] FLAG: --registry-burst="10" Jul 07 14:09:05.103942 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096461 2557 flags.go:64] FLAG: --registry-qps="5" Jul 07 14:09:05.103942 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096464 2557 flags.go:64] FLAG: --reserved-cpus="" Jul 07 14:09:05.104867 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096466 2557 flags.go:64] FLAG: --reserved-memory="" Jul 07 14:09:05.104867 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096470 2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 14:09:05.104867 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096474 2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 14:09:05.104867 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096476 2557 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 14:09:05.104867 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096479 2557 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 14:09:05.104867 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096482 2557 flags.go:64] FLAG: --runonce="false" Jul 07 14:09:05.104867 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096484 2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 14:09:05.104867 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096487 2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 14:09:05.104867 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096490 2557 flags.go:64] FLAG: --seccomp-default="false" Jul 07 14:09:05.104867 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096493 2557 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 14:09:05.104867 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096495 2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 14:09:05.104867 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096498 2557 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 14:09:05.104867 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096502 2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 14:09:05.104867 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096505 2557 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 14:09:05.104867 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096509 2557 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 14:09:05.104867 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096511 2557 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 14:09:05.104867 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096514 2557 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 14:09:05.104867 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096519 2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 14:09:05.104867 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096521 2557 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 14:09:05.104867 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096524 2557 flags.go:64] FLAG: --system-cgroups="" Jul 07 14:09:05.104867 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096527 2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 14:09:05.104867 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096532 2557 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 14:09:05.104867 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096535 2557 flags.go:64] FLAG: --tls-cert-file="" Jul 07 14:09:05.104867 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096538 2557 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 14:09:05.104867 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096542 2557 flags.go:64] FLAG: --tls-min-version="" Jul 07 14:09:05.105812 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096545 2557 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 14:09:05.105812 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096547 2557 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 14:09:05.105812 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096550 2557 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 14:09:05.105812 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096553 2557 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 14:09:05.105812 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096555 2557 flags.go:64] FLAG: --v="2" Jul 07 14:09:05.105812 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096559 2557 flags.go:64] FLAG: --version="false" Jul 07 14:09:05.105812 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096563 2557 flags.go:64] FLAG: --vmodule="" Jul 07 14:09:05.105812 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096567 2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 14:09:05.105812 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.096570 2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 14:09:05.105812 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096685 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:09:05.105812 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096689 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:09:05.105812 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096692 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:09:05.105812 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096694 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:09:05.105812 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096697 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:09:05.105812 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096699 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:09:05.105812 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096701 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:09:05.105812 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096704 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:09:05.105812 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096706 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:09:05.105812 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096709 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:09:05.105812 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096712 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:09:05.105812 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096715 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:09:05.105812 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096734 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:09:05.106350 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096737 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:09:05.106350 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096739 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:09:05.106350 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096743 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:09:05.106350 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096746 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:09:05.106350 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096748 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:09:05.106350 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096751 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:09:05.106350 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096754 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:09:05.106350 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096757 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:09:05.106350 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096759 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:09:05.106350 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096762 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:09:05.106350 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096765 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:09:05.106350 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096767 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:09:05.106350 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096769 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:09:05.106350 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096772 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:09:05.106350 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096774 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:09:05.106350 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096777 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:09:05.106350 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096779 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:09:05.106350 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096782 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:09:05.106350 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096784 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:09:05.106841 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096787 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:09:05.106841 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096789 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:09:05.106841 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096792 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:09:05.106841 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096794 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:09:05.106841 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096797 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:09:05.106841 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096800 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:09:05.106841 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096802 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:09:05.106841 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096805 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:09:05.106841 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096808 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:09:05.106841 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096810 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:09:05.106841 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096813 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:09:05.106841 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096815 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:09:05.106841 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096821 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:09:05.106841 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096825 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:09:05.106841 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096828 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:09:05.106841 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096833 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:09:05.106841 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096836 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:09:05.106841 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096838 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:09:05.106841 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096841 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:09:05.107306 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096843 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:09:05.107306 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096846 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:09:05.107306 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096848 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:09:05.107306 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096851 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:09:05.107306 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096853 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:09:05.107306 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096856 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:09:05.107306 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096859 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:09:05.107306 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096861 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:09:05.107306 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096864 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:09:05.107306 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096866 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:09:05.107306 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096869 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:09:05.107306 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096872 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:09:05.107306 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096874 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:09:05.107306 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096878 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:09:05.107306 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096881 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:09:05.107306 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096885 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:09:05.107306 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096888 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:09:05.107306 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096891 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:09:05.107306 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096894 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:09:05.107306 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096897 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:09:05.107799 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096900 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:09:05.107799 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096903 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:09:05.107799 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096906 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:09:05.107799 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096908 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:09:05.107799 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096911 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:09:05.107799 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096915 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:09:05.107799 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096918 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:09:05.107799 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096921 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:09:05.107799 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096924 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:09:05.107799 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096927 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:09:05.107799 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096929 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:09:05.107799 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096932 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:09:05.107799 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096934 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:09:05.107799 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096937 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:09:05.107799 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096939 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:09:05.107799 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096942 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:09:05.107799 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096944 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:09:05.107799 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096947 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:09:05.107799 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096949 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:09:05.107799 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096952 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:09:05.108289 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096954 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:09:05.108289 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096957 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:09:05.108289 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096959 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:09:05.108289 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096962 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:09:05.108289 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096964 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:09:05.108289 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096966 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:09:05.108289 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096969 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:09:05.108289 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.096971 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:09:05.108289 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.097470 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 14:09:05.108289 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.104981 2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 14:09:05.108289 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.105009 2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 14:09:05.108289 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.105035 2557 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 14:09:05.108289 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.105044 2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 14:09:05.108289 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105348 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:09:05.108289 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105356 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:09:05.108666 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105361 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:09:05.108666 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105366 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:09:05.108666 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105379 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:09:05.108666 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105417 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:09:05.108666 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105422 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:09:05.108666 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105427 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:09:05.108666 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105431 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:09:05.108666 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105435 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:09:05.108666 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105439 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:09:05.108666 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105443 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:09:05.108666 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105447 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:09:05.108666 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105451 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:09:05.108666 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105456 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:09:05.108666 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105460 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:09:05.108666 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105464 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:09:05.108666 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105473 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:09:05.108666 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105477 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:09:05.108666 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105481 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:09:05.108666 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105485 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:09:05.108666 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105489 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:09:05.109169 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105493 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:09:05.109169 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105497 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:09:05.109169 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105501 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:09:05.109169 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105505 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:09:05.109169 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105509 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:09:05.109169 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105513 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:09:05.109169 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105518 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:09:05.109169 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105527 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:09:05.109169 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105532 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:09:05.109169 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105536 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:09:05.109169 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105540 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:09:05.109169 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105544 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:09:05.109169 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105580 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:09:05.109169 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105588 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:09:05.109169 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105593 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:09:05.109169 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105598 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:09:05.109169 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105631 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:09:05.109169 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105636 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:09:05.109614 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105640 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:09:05.109614 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105645 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:09:05.109614 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105654 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:09:05.109614 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105658 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:09:05.109614 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105663 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:09:05.109614 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105667 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:09:05.109614 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105671 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:09:05.109614 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105675 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:09:05.109614 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105678 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:09:05.109614 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105681 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:09:05.109614 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105683 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:09:05.109614 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105686 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:09:05.109614 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105689 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:09:05.109614 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105692 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:09:05.109614 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105697 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:09:05.109614 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105700 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:09:05.109614 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105710 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:09:05.109614 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105713 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:09:05.109614 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105716 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:09:05.109614 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105735 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:09:05.110103 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105741 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:09:05.110103 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105746 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:09:05.110103 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105750 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:09:05.110103 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105754 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:09:05.110103 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105756 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:09:05.110103 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105759 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:09:05.110103 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105763 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:09:05.110103 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105767 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:09:05.110103 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105775 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:09:05.110103 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105779 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:09:05.110103 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105782 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:09:05.110103 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105796 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:09:05.110103 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105799 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:09:05.110103 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105802 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:09:05.110103 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105805 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:09:05.110103 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105807 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:09:05.110103 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105810 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:09:05.110103 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105813 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:09:05.110103 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105815 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:09:05.110103 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105818 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:09:05.110622 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105821 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:09:05.110622 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105826 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:09:05.110622 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105829 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:09:05.110622 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105832 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:09:05.110622 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105834 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:09:05.110622 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105837 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:09:05.110622 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105839 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:09:05.110622 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105842 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:09:05.110622 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105845 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:09:05.110622 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105847 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:09:05.110622 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105850 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:09:05.110622 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105852 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:09:05.110622 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105856 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:09:05.110622 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105859 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:09:05.110622 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105865 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:09:05.110622 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105868 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:09:05.110622 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105870 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:09:05.110622 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105873 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:09:05.110622 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.105887 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:09:05.111222 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.105897 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 14:09:05.111222 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106208 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:09:05.111222 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106219 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:09:05.111222 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106222 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:09:05.111222 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106225 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:09:05.111222 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106228 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:09:05.111222 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106231 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:09:05.111222 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106234 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:09:05.111222 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106236 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:09:05.111222 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106239 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:09:05.111222 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106242 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:09:05.111222 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106245 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:09:05.111222 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106248 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:09:05.111222 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106250 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:09:05.111222 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106253 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:09:05.111590 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106256 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:09:05.111590 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106258 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:09:05.111590 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106263 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:09:05.111590 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106267 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:09:05.111590 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106270 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:09:05.111590 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106273 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:09:05.111590 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106276 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:09:05.111590 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106279 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:09:05.111590 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106282 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:09:05.111590 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106284 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:09:05.111590 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106287 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:09:05.111590 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106290 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:09:05.111590 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106293 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:09:05.111590 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106296 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:09:05.111590 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106299 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:09:05.111590 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106301 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:09:05.111590 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106305 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:09:05.111590 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106308 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:09:05.111590 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106311 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:09:05.112094 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106314 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:09:05.112094 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106317 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:09:05.112094 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106320 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:09:05.112094 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106322 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:09:05.112094 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106325 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:09:05.112094 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106328 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:09:05.112094 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106330 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:09:05.112094 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106332 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:09:05.112094 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106335 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:09:05.112094 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106338 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:09:05.112094 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106340 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:09:05.112094 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106343 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:09:05.112094 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106346 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:09:05.112094 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106348 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:09:05.112094 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106351 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:09:05.112094 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106354 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:09:05.112094 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106356 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:09:05.112094 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106359 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:09:05.112094 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106361 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:09:05.112094 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106364 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:09:05.112560 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106367 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:09:05.112560 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106369 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:09:05.112560 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106372 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:09:05.112560 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106375 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:09:05.112560 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106378 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:09:05.112560 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106380 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:09:05.112560 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106383 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:09:05.112560 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106385 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:09:05.112560 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106387 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:09:05.112560 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106391 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:09:05.112560 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106394 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:09:05.112560 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106398 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:09:05.112560 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106401 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:09:05.112560 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106404 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:09:05.112560 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106407 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:09:05.112560 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106409 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:09:05.112560 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106412 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:09:05.112560 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106414 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:09:05.112560 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106417 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:09:05.113064 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106420 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:09:05.113064 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106422 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:09:05.113064 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106425 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:09:05.113064 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106427 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:09:05.113064 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106429 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:09:05.113064 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106432 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:09:05.113064 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106435 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:09:05.113064 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106437 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:09:05.113064 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106439 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:09:05.113064 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106442 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:09:05.113064 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106445 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:09:05.113064 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106447 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:09:05.113064 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106449 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:09:05.113064 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106452 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:09:05.113064 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106455 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:09:05.113064 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106458 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:09:05.113064 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106461 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:09:05.113064 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106463 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:09:05.113064 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106465 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:09:05.113064 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106468 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:09:05.113540 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106470 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:09:05.113540 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106473 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:09:05.113540 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106475 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:09:05.113540 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106478 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:09:05.113540 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106480 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:09:05.113540 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106483 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:09:05.113540 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:05.106487 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:09:05.113540 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.106492 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 14:09:05.113540 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.106649 2557 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 14:09:05.113540 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.110037 2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 14:09:05.113540 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.111503 2557 server.go:1019] "Starting client certificate rotation" Jul 07 14:09:05.113540 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.111614 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 14:09:05.113540 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.111644 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 14:09:05.114213 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.114196 2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 14:09:05.115906 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.115890 2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 14:09:05.126833 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.126808 2557 log.go:25] "Validated CRI v1 runtime API" Jul 07 14:09:05.129048 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.129030 2557 log.go:25] "Validated CRI v1 image API" Jul 07 14:09:05.129884 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.129853 2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 14:09:05.133821 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.133798 2557 fs.go:135] Filesystem UUIDs: map[4554e2c9-0a8e-45d6-b083-ec1845776801:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 bce838a0-4769-4ad8-9020-0f66586d4713:/dev/nvme0n1p4] Jul 07 14:09:05.133867 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.133823 2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 14:09:05.139652 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.139524 2557 manager.go:216] Machine: {Timestamp:2026-07-07 14:09:05.138313245 +0000 UTC m=+0.304930852 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3112530 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24d43c027b988cf2f81bc03300a990 SystemUUID:ec24d43c-027b-988c-f2f8-1bc03300a990 BootID:2a7a14eb-6a36-430a-b70d-e8588946a156 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4b:b8:8d:e0:f5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4b:b8:8d:e0:f5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:6f:bf:63:db:b8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 14:09:05.139652 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.139649 2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 14:09:05.139778 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.139755 2557 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 14:09:05.142655 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.142628 2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 14:09:05.142822 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.142660 2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-152.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 14:09:05.143858 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.143847 2557 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 14:09:05.143899 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.143861 2557 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 14:09:05.143899 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.143869 2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 14:09:05.144405 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.144395 2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 14:09:05.145536 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.145524 2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 14:09:05.148364 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.148351 2557 state_mem.go:36] "Initialized new in-memory state store" Jul 07 14:09:05.148525 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.148516 2557 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 14:09:05.149096 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.149087 2557 kubelet.go:486] "Attempting to sync node with API server" Jul 07 14:09:05.149133 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.149107 2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 14:09:05.149133 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.149126 2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 14:09:05.149190 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.149136 2557 kubelet.go:398] "Adding apiserver pod source" Jul 07 14:09:05.149190 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.149146 2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 14:09:05.149561 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.149549 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 14:09:05.149599 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.149565 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 14:09:05.154140 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.154117 2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 14:09:05.155930 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.155911 2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 14:09:05.156022 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.155959 2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 14:09:05.156962 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.156947 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 14:09:05.157035 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.156967 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 14:09:05.157035 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.156976 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 14:09:05.157035 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.156983 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 14:09:05.157035 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.156997 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 14:09:05.157035 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.157006 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 14:09:05.157035 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.157018 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 14:09:05.157035 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.157026 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 14:09:05.157035 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.157036 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 14:09:05.157277 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.157045 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 14:09:05.157277 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.157057 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 14:09:05.157277 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.157067 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 14:09:05.158668 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.158655 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 14:09:05.158759 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.158671 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 14:09:05.160097 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:05.160065 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 14:09:05.160255 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:05.160235 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-152.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 14:09:05.162312 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.162295 2557 server.go:1268] "Started kubelet" Jul 07 14:09:05.162423 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.162395 2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 14:09:05.162482 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.162391 2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 14:09:05.162523 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.162479 2557 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 14:09:05.163280 ip-10-0-130-152 systemd[1]: Started Kubernetes Kubelet. Jul 07 14:09:05.164214 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.164201 2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 14:09:05.164424 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.164366 2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-152.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 14:09:05.165417 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.165398 2557 server.go:310] "Adding debug handlers to kubelet server" Jul 07 14:09:05.168185 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.168160 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 14:09:05.169166 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:05.169140 2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 14:09:05.170958 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:05.170067 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-152.ec2.internal.18c0072daafbc38b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-152.ec2.internal,UID:ip-10-0-130-152.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-152.ec2.internal,},FirstTimestamp:2026-07-07 14:09:05.162265483 +0000 UTC m=+0.328883090,LastTimestamp:2026-07-07 14:09:05.162265483 +0000 UTC m=+0.328883090,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-152.ec2.internal,}" Jul 07 14:09:05.171215 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.171193 2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 14:09:05.171279 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.171218 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 14:09:05.171355 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:05.171317 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-152.ec2.internal\" not found" Jul 07 14:09:05.171757 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.171739 2557 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 14:09:05.171840 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.171760 2557 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 14:09:05.172177 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.172071 2557 reconstruct.go:97] "Volume reconstruction finished" Jul 07 14:09:05.172177 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.172090 2557 reconciler.go:29] "Reconciler: start to sync state" Jul 07 14:09:05.172458 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.172187 2557 factory.go:55] Registering systemd factory Jul 07 14:09:05.172458 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.172199 2557 factory.go:223] Registration of the systemd container factory successfully Jul 07 14:09:05.172458 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.171739 2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 14:09:05.172458 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.172401 2557 factory.go:153] Registering CRI-O factory Jul 07 14:09:05.172458 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.172415 2557 factory.go:223] Registration of the crio container factory successfully Jul 07 14:09:05.172659 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.172467 2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 14:09:05.172659 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.172497 2557 factory.go:103] Registering Raw factory Jul 07 14:09:05.172659 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.172516 2557 manager.go:1196] Started watching for new ooms in manager Jul 07 14:09:05.173138 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.173122 2557 manager.go:349] Starting recovery of all containers Jul 07 14:09:05.180357 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:05.180329 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 07 14:09:05.186808 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.186591 2557 manager.go:354] Recovery completed Jul 07 14:09:05.187079 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:05.186637 2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-152.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 07 14:09:05.188828 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:05.188804 2557 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 07 14:09:05.192114 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.192101 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:09:05.194153 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.194133 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:09:05.194252 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.194167 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:09:05.194252 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.194178 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:09:05.194766 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.194747 2557 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 14:09:05.194766 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.194764 2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 14:09:05.194881 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.194783 2557 state_mem.go:36] "Initialized new in-memory state store" Jul 07 14:09:05.194881 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.194756 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:09:05.195547 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.195529 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:09:05.195631 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.195560 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:09:05.195631 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.195571 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:09:05.196011 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.195999 2557 policy_none.go:49] "None policy: Start" Jul 07 14:09:05.196048 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.196016 2557 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 14:09:05.196048 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.196027 2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 14:09:05.196940 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.196930 2557 policy_none.go:47] "Start" Jul 07 14:09:05.200904 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:05.200819 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-152.ec2.internal.18c0072dace25542 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-152.ec2.internal,UID:ip-10-0-130-152.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-152.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-152.ec2.internal,},FirstTimestamp:2026-07-07 14:09:05.194153282 +0000 UTC m=+0.360770889,LastTimestamp:2026-07-07 14:09:05.194153282 +0000 UTC m=+0.360770889,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-152.ec2.internal,}" Jul 07 14:09:05.211122 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:05.211031 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-152.ec2.internal.18c0072dace29d9f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-152.ec2.internal,UID:ip-10-0-130-152.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-152.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-152.ec2.internal,},FirstTimestamp:2026-07-07 14:09:05.194171807 +0000 UTC m=+0.360789418,LastTimestamp:2026-07-07 14:09:05.194171807 +0000 UTC m=+0.360789418,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-152.ec2.internal,}" Jul 07 14:09:05.221884 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:05.221809 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-152.ec2.internal.18c0072dace2c536 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-152.ec2.internal,UID:ip-10-0-130-152.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-130-152.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-130-152.ec2.internal,},FirstTimestamp:2026-07-07 14:09:05.194181942 +0000 UTC m=+0.360799553,LastTimestamp:2026-07-07 14:09:05.194181942 +0000 UTC m=+0.360799553,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-152.ec2.internal,}" Jul 07 14:09:05.231739 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:05.231645 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-130-152.ec2.internal.18c0072dace25542\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-152.ec2.internal.18c0072dace25542 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-152.ec2.internal,UID:ip-10-0-130-152.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-152.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-152.ec2.internal,},FirstTimestamp:2026-07-07 14:09:05.194153282 +0000 UTC m=+0.360770889,LastTimestamp:2026-07-07 14:09:05.195546862 +0000 UTC m=+0.362164469,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-152.ec2.internal,}" Jul 07 14:09:05.238421 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.238404 2557 manager.go:337] "Starting Device Plugin manager" Jul 07 14:09:05.238509 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:05.238458 2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 14:09:05.238509 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.238472 2557 server.go:87] "Starting device plugin registration server" Jul 07 14:09:05.238792 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.238778 2557 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 14:09:05.238844 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.238799 2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 14:09:05.238936 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.238912 2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 14:09:05.239035 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.239023 2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 14:09:05.239035 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.239035 2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 14:09:05.239483 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.239460 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6qd26" Jul 07 14:09:05.239599 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:05.239579 2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 14:09:05.239650 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:05.239637 2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-152.ec2.internal\" not found" Jul 07 14:09:05.248683 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:05.248605 2557 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-130-152.ec2.internal.18c0072dace29d9f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-152.ec2.internal.18c0072dace29d9f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-152.ec2.internal,UID:ip-10-0-130-152.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-152.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-152.ec2.internal,},FirstTimestamp:2026-07-07 14:09:05.194171807 +0000 UTC m=+0.360789418,LastTimestamp:2026-07-07 14:09:05.195565305 +0000 UTC m=+0.362182913,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-152.ec2.internal,}" Jul 07 14:09:05.264108 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.264087 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6qd26" Jul 07 14:09:05.309585 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.309539 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 14:09:05.310907 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.310883 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 14:09:05.311012 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.310920 2557 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 14:09:05.311012 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.310943 2557 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 14:09:05.311012 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:05.310975 2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 14:09:05.313370 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.313343 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:09:05.340037 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.339971 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:09:05.340952 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.340934 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:09:05.341058 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.340971 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:09:05.341058 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.340985 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:09:05.341058 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.341016 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-152.ec2.internal" Jul 07 14:09:05.350614 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.350590 2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-152.ec2.internal" Jul 07 14:09:05.350734 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:05.350617 2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-152.ec2.internal\": node \"ip-10-0-130-152.ec2.internal\" not found" Jul 07 14:09:05.380555 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:05.380526 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-152.ec2.internal\" not found" Jul 07 14:09:05.411201 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.411159 2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-152.ec2.internal"] Jul 07 14:09:05.411364 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.411251 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:09:05.412276 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.412260 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:09:05.412367 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.412294 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:09:05.412367 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.412307 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:09:05.413603 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.413587 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:09:05.413747 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.413714 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal" Jul 07 14:09:05.413800 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.413765 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:09:05.414351 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.414332 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:09:05.414420 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.414368 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:09:05.414420 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.414380 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:09:05.414489 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.414332 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:09:05.414489 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.414446 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:09:05.414489 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.414459 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:09:05.415598 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.415583 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-152.ec2.internal" Jul 07 14:09:05.415643 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.415612 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:09:05.416331 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.416310 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:09:05.416440 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.416339 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:09:05.416440 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.416350 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:09:05.438454 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:05.438428 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-152.ec2.internal\" not found" node="ip-10-0-130-152.ec2.internal" Jul 07 14:09:05.442927 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:05.442910 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-152.ec2.internal\" not found" node="ip-10-0-130-152.ec2.internal" Jul 07 14:09:05.481239 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:05.481213 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-152.ec2.internal\" not found" Jul 07 14:09:05.573663 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.573631 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a229f29ed6471a8554089697807f4dde-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal\" (UID: \"a229f29ed6471a8554089697807f4dde\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal" Jul 07 14:09:05.573800 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.573676 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a229f29ed6471a8554089697807f4dde-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal\" (UID: \"a229f29ed6471a8554089697807f4dde\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal" Jul 07 14:09:05.573800 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.573697 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7c53c5de8c1731c73afeca96f56511a2-config\") pod \"kube-apiserver-proxy-ip-10-0-130-152.ec2.internal\" (UID: \"7c53c5de8c1731c73afeca96f56511a2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-152.ec2.internal" Jul 07 14:09:05.581734 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:05.581704 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-152.ec2.internal\" not found" Jul 07 14:09:05.674508 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.674426 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a229f29ed6471a8554089697807f4dde-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal\" (UID: \"a229f29ed6471a8554089697807f4dde\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal" Jul 07 14:09:05.674508 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.674466 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a229f29ed6471a8554089697807f4dde-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal\" (UID: \"a229f29ed6471a8554089697807f4dde\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal" Jul 07 14:09:05.674508 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.674487 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7c53c5de8c1731c73afeca96f56511a2-config\") pod \"kube-apiserver-proxy-ip-10-0-130-152.ec2.internal\" (UID: \"7c53c5de8c1731c73afeca96f56511a2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-152.ec2.internal" Jul 07 14:09:05.674683 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.674521 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7c53c5de8c1731c73afeca96f56511a2-config\") pod \"kube-apiserver-proxy-ip-10-0-130-152.ec2.internal\" (UID: \"7c53c5de8c1731c73afeca96f56511a2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-152.ec2.internal" Jul 07 14:09:05.674683 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.674527 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a229f29ed6471a8554089697807f4dde-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal\" (UID: \"a229f29ed6471a8554089697807f4dde\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal" Jul 07 14:09:05.674683 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.674529 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a229f29ed6471a8554089697807f4dde-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal\" (UID: \"a229f29ed6471a8554089697807f4dde\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal" Jul 07 14:09:05.682529 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:05.682511 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-152.ec2.internal\" not found" Jul 07 14:09:05.741746 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.741693 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal" Jul 07 14:09:05.746463 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:05.746442 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-152.ec2.internal" Jul 07 14:09:05.783585 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:05.783558 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-152.ec2.internal\" not found" Jul 07 14:09:05.884203 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:05.884164 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-152.ec2.internal\" not found" Jul 07 14:09:07.768452 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:07.768426 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-152.ec2.internal\" not found" Jul 07 14:09:07.869294 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:07.869267 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-152.ec2.internal\" not found" Jul 07 14:09:07.895443 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:07.895415 2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 14:09:07.896016 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:07.895597 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 14:09:07.969644 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:07.969617 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-152.ec2.internal\" not found" Jul 07 14:09:08.050541 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.050454 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 14:04:07 +0000 UTC" deadline="2028-04-02 04:26:25.874554258 +0000 UTC" Jul 07 14:09:08.050541 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.050489 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15230h17m17.824069417s" Jul 07 14:09:08.069977 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:08.069948 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-152.ec2.internal\" not found" Jul 07 14:09:08.139188 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.139161 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:09:08.141138 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.141114 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:09:08.141266 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.141156 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:09:08.141266 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.141169 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:09:08.141375 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.141344 2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:09:08.171106 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:08.171020 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-152.ec2.internal\" not found" Jul 07 14:09:08.181642 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:08.181612 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda229f29ed6471a8554089697807f4dde.slice/crio-f44c5caad4e0259bf8425525eece61e119e8998c116ef5bc8f6847e4ccd2e97d WatchSource:0}: Error finding container f44c5caad4e0259bf8425525eece61e119e8998c116ef5bc8f6847e4ccd2e97d: Status 404 returned error can't find the container with id f44c5caad4e0259bf8425525eece61e119e8998c116ef5bc8f6847e4ccd2e97d Jul 07 14:09:08.181893 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:08.181879 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c53c5de8c1731c73afeca96f56511a2.slice/crio-a9817b105fb9e814fd6187e864af3963d77086e82c38481fc9587ce107cebe14 WatchSource:0}: Error finding container a9817b105fb9e814fd6187e864af3963d77086e82c38481fc9587ce107cebe14: Status 404 returned error can't find the container with id a9817b105fb9e814fd6187e864af3963d77086e82c38481fc9587ce107cebe14 Jul 07 14:09:08.186203 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.186188 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 14:09:08.229798 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.229768 2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:09:08.271848 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:08.271823 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-152.ec2.internal\" not found" Jul 07 14:09:08.372440 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:08.372373 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-152.ec2.internal\" not found" Jul 07 14:09:08.473260 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:08.473233 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-152.ec2.internal\" not found" Jul 07 14:09:08.524761 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.524738 2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:09:08.555848 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.555820 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-152.ec2.internal" Jul 07 14:09:08.567920 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.567885 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 14:09:08.569138 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.569122 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal" Jul 07 14:09:08.580647 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.580625 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 14:09:08.702600 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.702498 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:09:08.934060 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.934027 2557 apiserver.go:52] "Watching apiserver" Jul 07 14:09:08.940785 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.940755 2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 14:09:08.942200 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.942166 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-s5cfz","kube-system/kube-apiserver-proxy-ip-10-0-130-152.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5kvc","openshift-dns/node-resolver-6dqdt","openshift-image-registry/node-ca-tdc99","openshift-multus/multus-6lrcb","openshift-multus/multus-additional-cni-plugins-t88rg","openshift-network-diagnostics/network-check-target-xzfg2","kube-system/konnectivity-agent-7f8r6","openshift-cluster-node-tuning-operator/tuned-swvr7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal","openshift-multus/network-metrics-daemon-rfmz4","openshift-network-operator/iptables-alerter-xzl5w","openshift-ovn-kubernetes/ovnkube-node-v7sfl"] Jul 07 14:09:08.945061 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.945037 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t88rg" Jul 07 14:09:08.947388 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.947357 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xzl5w" Jul 07 14:09:08.951568 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.950609 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 14:09:08.951568 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.950912 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 14:09:08.951568 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.951105 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 14:09:08.951568 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.951302 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:09:08.951963 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.951939 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5kvc" Jul 07 14:09:08.953163 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.952571 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 14:09:08.953163 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.952732 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 14:09:08.953163 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.952764 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xpt77\"" Jul 07 14:09:08.953163 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.952828 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 14:09:08.953163 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.952867 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 14:09:08.953163 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.952948 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-j27zg\"" Jul 07 14:09:08.955593 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.955042 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6dqdt" Jul 07 14:09:08.956534 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.955734 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 14:09:08.957828 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.957805 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 14:09:08.959945 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.958836 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 14:09:08.959945 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.959059 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5srvs\"" Jul 07 14:09:08.959945 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.959269 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 14:09:08.959945 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.959490 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 14:09:08.959945 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.959808 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 14:09:08.960216 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.959969 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-25dtn\"" Jul 07 14:09:08.960744 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.960658 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tdc99" Jul 07 14:09:08.963997 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.963456 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-l5r75\"" Jul 07 14:09:08.963997 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.963590 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 14:09:08.963997 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.963693 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 14:09:08.963997 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.963745 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6lrcb" Jul 07 14:09:08.964551 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.964328 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 14:09:08.966536 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.965745 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ft4c9\"" Jul 07 14:09:08.966536 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.965953 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 14:09:08.966536 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.966413 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7f8r6" Jul 07 14:09:08.967647 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.967604 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1093ee1a-7fa2-4027-860e-75334e677b42-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t88rg\" (UID: \"1093ee1a-7fa2-4027-860e-75334e677b42\") " pod="openshift-multus/multus-additional-cni-plugins-t88rg" Jul 07 14:09:08.967647 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.967638 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1093ee1a-7fa2-4027-860e-75334e677b42-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t88rg\" (UID: \"1093ee1a-7fa2-4027-860e-75334e677b42\") " pod="openshift-multus/multus-additional-cni-plugins-t88rg" Jul 07 14:09:08.967783 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.967664 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b4eba203-0b3a-4e5d-9ff4-acfbf975ee2d-iptables-alerter-script\") pod \"iptables-alerter-xzl5w\" (UID: \"b4eba203-0b3a-4e5d-9ff4-acfbf975ee2d\") " pod="openshift-network-operator/iptables-alerter-xzl5w" Jul 07 14:09:08.967783 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.967687 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c706292c-7966-4593-8563-b3da49b7dfcb-socket-dir\") pod \"aws-ebs-csi-driver-node-t5kvc\" (UID: \"c706292c-7966-4593-8563-b3da49b7dfcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5kvc" Jul 07 14:09:08.967783 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.967711 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c706292c-7966-4593-8563-b3da49b7dfcb-registration-dir\") pod \"aws-ebs-csi-driver-node-t5kvc\" (UID: \"c706292c-7966-4593-8563-b3da49b7dfcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5kvc" Jul 07 14:09:08.967783 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.967736 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c706292c-7966-4593-8563-b3da49b7dfcb-device-dir\") pod \"aws-ebs-csi-driver-node-t5kvc\" (UID: \"c706292c-7966-4593-8563-b3da49b7dfcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5kvc" Jul 07 14:09:08.967783 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.967760 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c706292c-7966-4593-8563-b3da49b7dfcb-etc-selinux\") pod \"aws-ebs-csi-driver-node-t5kvc\" (UID: \"c706292c-7966-4593-8563-b3da49b7dfcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5kvc" Jul 07 14:09:08.968023 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.967786 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a2d3927-7c87-4583-afec-33548d872aca-tmp-dir\") pod \"node-resolver-6dqdt\" (UID: \"6a2d3927-7c87-4583-afec-33548d872aca\") " pod="openshift-dns/node-resolver-6dqdt" Jul 07 14:09:08.968023 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.967810 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d360f1dd-1647-4c4b-8626-fe12ac3751b5-host\") pod \"node-ca-tdc99\" (UID: \"d360f1dd-1647-4c4b-8626-fe12ac3751b5\") " pod="openshift-image-registry/node-ca-tdc99" Jul 07 14:09:08.968023 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.967834 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwjwj\" (UniqueName: \"kubernetes.io/projected/d360f1dd-1647-4c4b-8626-fe12ac3751b5-kube-api-access-jwjwj\") pod \"node-ca-tdc99\" (UID: \"d360f1dd-1647-4c4b-8626-fe12ac3751b5\") " pod="openshift-image-registry/node-ca-tdc99" Jul 07 14:09:08.968023 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.967857 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxhhc\" (UniqueName: \"kubernetes.io/projected/1093ee1a-7fa2-4027-860e-75334e677b42-kube-api-access-dxhhc\") pod \"multus-additional-cni-plugins-t88rg\" (UID: \"1093ee1a-7fa2-4027-860e-75334e677b42\") " pod="openshift-multus/multus-additional-cni-plugins-t88rg" Jul 07 14:09:08.968023 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.967893 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b4eba203-0b3a-4e5d-9ff4-acfbf975ee2d-host-slash\") pod \"iptables-alerter-xzl5w\" (UID: \"b4eba203-0b3a-4e5d-9ff4-acfbf975ee2d\") " pod="openshift-network-operator/iptables-alerter-xzl5w" Jul 07 14:09:08.968023 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.967916 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c706292c-7966-4593-8563-b3da49b7dfcb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t5kvc\" (UID: \"c706292c-7966-4593-8563-b3da49b7dfcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5kvc" Jul 07 14:09:08.968023 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.967944 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbxjs\" (UniqueName: \"kubernetes.io/projected/6a2d3927-7c87-4583-afec-33548d872aca-kube-api-access-jbxjs\") pod \"node-resolver-6dqdt\" (UID: \"6a2d3927-7c87-4583-afec-33548d872aca\") " pod="openshift-dns/node-resolver-6dqdt" Jul 07 14:09:08.968023 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.967967 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d360f1dd-1647-4c4b-8626-fe12ac3751b5-serviceca\") pod \"node-ca-tdc99\" (UID: \"d360f1dd-1647-4c4b-8626-fe12ac3751b5\") " pod="openshift-image-registry/node-ca-tdc99" Jul 07 14:09:08.968023 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.967998 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1093ee1a-7fa2-4027-860e-75334e677b42-system-cni-dir\") pod \"multus-additional-cni-plugins-t88rg\" (UID: \"1093ee1a-7fa2-4027-860e-75334e677b42\") " pod="openshift-multus/multus-additional-cni-plugins-t88rg" Jul 07 14:09:08.968446 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.968035 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1093ee1a-7fa2-4027-860e-75334e677b42-cni-binary-copy\") pod \"multus-additional-cni-plugins-t88rg\" (UID: \"1093ee1a-7fa2-4027-860e-75334e677b42\") " pod="openshift-multus/multus-additional-cni-plugins-t88rg" Jul 07 14:09:08.968446 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.968077 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1093ee1a-7fa2-4027-860e-75334e677b42-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t88rg\" (UID: \"1093ee1a-7fa2-4027-860e-75334e677b42\") " pod="openshift-multus/multus-additional-cni-plugins-t88rg" Jul 07 14:09:08.968446 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.968107 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr5c5\" (UniqueName: \"kubernetes.io/projected/b4eba203-0b3a-4e5d-9ff4-acfbf975ee2d-kube-api-access-gr5c5\") pod \"iptables-alerter-xzl5w\" (UID: \"b4eba203-0b3a-4e5d-9ff4-acfbf975ee2d\") " pod="openshift-network-operator/iptables-alerter-xzl5w" Jul 07 14:09:08.968446 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.968130 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c706292c-7966-4593-8563-b3da49b7dfcb-sys-fs\") pod \"aws-ebs-csi-driver-node-t5kvc\" (UID: \"c706292c-7966-4593-8563-b3da49b7dfcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5kvc" Jul 07 14:09:08.968446 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.968155 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms9pc\" (UniqueName: \"kubernetes.io/projected/c706292c-7966-4593-8563-b3da49b7dfcb-kube-api-access-ms9pc\") pod \"aws-ebs-csi-driver-node-t5kvc\" (UID: \"c706292c-7966-4593-8563-b3da49b7dfcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5kvc" Jul 07 14:09:08.968446 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.968177 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6a2d3927-7c87-4583-afec-33548d872aca-hosts-file\") pod \"node-resolver-6dqdt\" (UID: \"6a2d3927-7c87-4583-afec-33548d872aca\") " pod="openshift-dns/node-resolver-6dqdt" Jul 07 14:09:08.968446 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.968202 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1093ee1a-7fa2-4027-860e-75334e677b42-cnibin\") pod \"multus-additional-cni-plugins-t88rg\" (UID: \"1093ee1a-7fa2-4027-860e-75334e677b42\") " pod="openshift-multus/multus-additional-cni-plugins-t88rg" Jul 07 14:09:08.968446 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.968225 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1093ee1a-7fa2-4027-860e-75334e677b42-os-release\") pod \"multus-additional-cni-plugins-t88rg\" (UID: \"1093ee1a-7fa2-4027-860e-75334e677b42\") " pod="openshift-multus/multus-additional-cni-plugins-t88rg" Jul 07 14:09:08.968869 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.968695 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:09:08.968869 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:08.968757 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5cfz" podUID="8358392b-ad0d-457c-844a-85a1b754a49e" Jul 07 14:09:08.969494 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.969118 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 14:09:08.969494 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.969372 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jsxvv\"" Jul 07 14:09:08.974127 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.971695 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 14:09:08.974127 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.971914 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 14:09:08.974127 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.972324 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:08.976456 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.974429 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:08.976456 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.976119 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6t9jr\"" Jul 07 14:09:08.976456 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.976183 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 14:09:08.976456 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.976223 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 14:09:08.976456 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.976308 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 14:09:08.976812 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.976793 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 14:09:08.977030 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.977014 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 14:09:08.977104 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.977063 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 14:09:08.977271 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.977253 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 14:09:08.977472 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.977455 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zh9wx\"" Jul 07 14:09:08.977810 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.977790 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:09:08.978056 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.978032 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzfg2" Jul 07 14:09:08.978149 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:08.978125 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzfg2" podUID="a6bce278-b340-4280-882f-2337ec23b28e" Jul 07 14:09:08.979482 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:08.979463 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:09:08.979622 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:08.979570 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfmz4" podUID="1125d082-9200-4b6f-b03b-1edd11069009" Jul 07 14:09:09.001710 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.001681 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7nkjr" Jul 07 14:09:09.007942 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.007919 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7nkjr" Jul 07 14:09:09.058184 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.058154 2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 14:09:09.069425 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.069399 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-host-slash\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.069584 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.069437 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-var-lib-openvswitch\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.069584 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.069469 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-host-cni-netd\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.069584 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.069497 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbxjs\" (UniqueName: \"kubernetes.io/projected/6a2d3927-7c87-4583-afec-33548d872aca-kube-api-access-jbxjs\") pod \"node-resolver-6dqdt\" (UID: \"6a2d3927-7c87-4583-afec-33548d872aca\") " pod="openshift-dns/node-resolver-6dqdt" Jul 07 14:09:09.069584 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.069528 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-os-release\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.069584 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.069550 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-systemd-units\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.069755 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.069587 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-var-lib-kubelet\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.069755 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.069610 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-etc-tuned\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.069755 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.069632 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1093ee1a-7fa2-4027-860e-75334e677b42-cni-binary-copy\") pod \"multus-additional-cni-plugins-t88rg\" (UID: \"1093ee1a-7fa2-4027-860e-75334e677b42\") " pod="openshift-multus/multus-additional-cni-plugins-t88rg" Jul 07 14:09:09.069755 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.069654 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1093ee1a-7fa2-4027-860e-75334e677b42-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t88rg\" (UID: \"1093ee1a-7fa2-4027-860e-75334e677b42\") " pod="openshift-multus/multus-additional-cni-plugins-t88rg" Jul 07 14:09:09.069755 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.069679 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-etc-kubernetes\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.069755 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.069702 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mtzs\" (UniqueName: \"kubernetes.io/projected/1125d082-9200-4b6f-b03b-1edd11069009-kube-api-access-2mtzs\") pod \"network-metrics-daemon-rfmz4\" (UID: \"1125d082-9200-4b6f-b03b-1edd11069009\") " pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:09:09.069755 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.069725 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1093ee1a-7fa2-4027-860e-75334e677b42-os-release\") pod \"multus-additional-cni-plugins-t88rg\" (UID: \"1093ee1a-7fa2-4027-860e-75334e677b42\") " pod="openshift-multus/multus-additional-cni-plugins-t88rg" Jul 07 14:09:09.069755 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.069749 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1093ee1a-7fa2-4027-860e-75334e677b42-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t88rg\" (UID: \"1093ee1a-7fa2-4027-860e-75334e677b42\") " pod="openshift-multus/multus-additional-cni-plugins-t88rg" Jul 07 14:09:09.069976 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.069773 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c706292c-7966-4593-8563-b3da49b7dfcb-registration-dir\") pod \"aws-ebs-csi-driver-node-t5kvc\" (UID: \"c706292c-7966-4593-8563-b3da49b7dfcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5kvc" Jul 07 14:09:09.069976 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.069824 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbmkr\" (UniqueName: \"kubernetes.io/projected/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-kube-api-access-sbmkr\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.069976 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.069849 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8358392b-ad0d-457c-844a-85a1b754a49e-kubelet-config\") pod \"global-pull-secret-syncer-s5cfz\" (UID: \"8358392b-ad0d-457c-844a-85a1b754a49e\") " pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:09:09.069976 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.069875 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxhhc\" (UniqueName: \"kubernetes.io/projected/1093ee1a-7fa2-4027-860e-75334e677b42-kube-api-access-dxhhc\") pod \"multus-additional-cni-plugins-t88rg\" (UID: \"1093ee1a-7fa2-4027-860e-75334e677b42\") " pod="openshift-multus/multus-additional-cni-plugins-t88rg" Jul 07 14:09:09.069976 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.069899 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b4eba203-0b3a-4e5d-9ff4-acfbf975ee2d-host-slash\") pod \"iptables-alerter-xzl5w\" (UID: \"b4eba203-0b3a-4e5d-9ff4-acfbf975ee2d\") " pod="openshift-network-operator/iptables-alerter-xzl5w" Jul 07 14:09:09.069976 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.069921 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e88256f8-e47a-4f61-b897-4ce91c24e80d-cni-binary-copy\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.069976 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.069954 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-host-run-k8s-cni-cncf-io\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.070161 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.069977 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b0e566be-2b4d-47a4-bce3-79b9cb20739c-agent-certs\") pod \"konnectivity-agent-7f8r6\" (UID: \"b0e566be-2b4d-47a4-bce3-79b9cb20739c\") " pod="kube-system/konnectivity-agent-7f8r6" Jul 07 14:09:09.070161 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070009 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.070161 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070034 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/89089a6f-7090-4264-bfc4-1ec644da32ab-ovnkube-config\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.070161 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070057 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dps2\" (UniqueName: \"kubernetes.io/projected/a6bce278-b340-4280-882f-2337ec23b28e-kube-api-access-7dps2\") pod \"network-check-target-xzfg2\" (UID: \"a6bce278-b340-4280-882f-2337ec23b28e\") " pod="openshift-network-diagnostics/network-check-target-xzfg2" Jul 07 14:09:09.070161 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070081 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1093ee1a-7fa2-4027-860e-75334e677b42-system-cni-dir\") pod \"multus-additional-cni-plugins-t88rg\" (UID: \"1093ee1a-7fa2-4027-860e-75334e677b42\") " pod="openshift-multus/multus-additional-cni-plugins-t88rg" Jul 07 14:09:09.070161 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070115 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b0e566be-2b4d-47a4-bce3-79b9cb20739c-konnectivity-ca\") pod \"konnectivity-agent-7f8r6\" (UID: \"b0e566be-2b4d-47a4-bce3-79b9cb20739c\") " pod="kube-system/konnectivity-agent-7f8r6" Jul 07 14:09:09.070350 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070163 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-run-openvswitch\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.070350 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070197 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f8xf\" (UniqueName: \"kubernetes.io/projected/89089a6f-7090-4264-bfc4-1ec644da32ab-kube-api-access-5f8xf\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.070350 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070234 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-etc-sysconfig\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.070350 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070239 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1093ee1a-7fa2-4027-860e-75334e677b42-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-t88rg\" (UID: \"1093ee1a-7fa2-4027-860e-75334e677b42\") " pod="openshift-multus/multus-additional-cni-plugins-t88rg" Jul 07 14:09:09.070350 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070267 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-etc-sysctl-d\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.070350 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070278 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1093ee1a-7fa2-4027-860e-75334e677b42-cni-binary-copy\") pod \"multus-additional-cni-plugins-t88rg\" (UID: \"1093ee1a-7fa2-4027-860e-75334e677b42\") " pod="openshift-multus/multus-additional-cni-plugins-t88rg" Jul 07 14:09:09.070350 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070290 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6qs2\" (UniqueName: \"kubernetes.io/projected/e88256f8-e47a-4f61-b897-4ce91c24e80d-kube-api-access-f6qs2\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.070350 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070323 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-etc-openvswitch\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.070592 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070352 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c706292c-7966-4593-8563-b3da49b7dfcb-etc-selinux\") pod \"aws-ebs-csi-driver-node-t5kvc\" (UID: \"c706292c-7966-4593-8563-b3da49b7dfcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5kvc" Jul 07 14:09:09.070592 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070325 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1093ee1a-7fa2-4027-860e-75334e677b42-os-release\") pod \"multus-additional-cni-plugins-t88rg\" (UID: \"1093ee1a-7fa2-4027-860e-75334e677b42\") " pod="openshift-multus/multus-additional-cni-plugins-t88rg" Jul 07 14:09:09.070592 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070428 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c706292c-7966-4593-8563-b3da49b7dfcb-registration-dir\") pod \"aws-ebs-csi-driver-node-t5kvc\" (UID: \"c706292c-7966-4593-8563-b3da49b7dfcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5kvc" Jul 07 14:09:09.070592 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070436 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c706292c-7966-4593-8563-b3da49b7dfcb-etc-selinux\") pod \"aws-ebs-csi-driver-node-t5kvc\" (UID: \"c706292c-7966-4593-8563-b3da49b7dfcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5kvc" Jul 07 14:09:09.070592 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070462 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1093ee1a-7fa2-4027-860e-75334e677b42-system-cni-dir\") pod \"multus-additional-cni-plugins-t88rg\" (UID: \"1093ee1a-7fa2-4027-860e-75334e677b42\") " pod="openshift-multus/multus-additional-cni-plugins-t88rg" Jul 07 14:09:09.070592 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070467 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1093ee1a-7fa2-4027-860e-75334e677b42-tuning-conf-dir\") pod \"multus-additional-cni-plugins-t88rg\" (UID: \"1093ee1a-7fa2-4027-860e-75334e677b42\") " pod="openshift-multus/multus-additional-cni-plugins-t88rg" Jul 07 14:09:09.070592 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070489 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a2d3927-7c87-4583-afec-33548d872aca-tmp-dir\") pod \"node-resolver-6dqdt\" (UID: \"6a2d3927-7c87-4583-afec-33548d872aca\") " pod="openshift-dns/node-resolver-6dqdt" Jul 07 14:09:09.070592 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070530 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b4eba203-0b3a-4e5d-9ff4-acfbf975ee2d-host-slash\") pod \"iptables-alerter-xzl5w\" (UID: \"b4eba203-0b3a-4e5d-9ff4-acfbf975ee2d\") " pod="openshift-network-operator/iptables-alerter-xzl5w" Jul 07 14:09:09.070592 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070545 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d360f1dd-1647-4c4b-8626-fe12ac3751b5-host\") pod \"node-ca-tdc99\" (UID: \"d360f1dd-1647-4c4b-8626-fe12ac3751b5\") " pod="openshift-image-registry/node-ca-tdc99" Jul 07 14:09:09.070592 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070563 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1093ee1a-7fa2-4027-860e-75334e677b42-cnibin\") pod \"multus-additional-cni-plugins-t88rg\" (UID: \"1093ee1a-7fa2-4027-860e-75334e677b42\") " pod="openshift-multus/multus-additional-cni-plugins-t88rg" Jul 07 14:09:09.070592 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070578 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1093ee1a-7fa2-4027-860e-75334e677b42-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t88rg\" (UID: \"1093ee1a-7fa2-4027-860e-75334e677b42\") " pod="openshift-multus/multus-additional-cni-plugins-t88rg" Jul 07 14:09:09.070921 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070612 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c706292c-7966-4593-8563-b3da49b7dfcb-socket-dir\") pod \"aws-ebs-csi-driver-node-t5kvc\" (UID: \"c706292c-7966-4593-8563-b3da49b7dfcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5kvc" Jul 07 14:09:09.070921 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070640 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-etc-modprobe-d\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.070921 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070723 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d360f1dd-1647-4c4b-8626-fe12ac3751b5-host\") pod \"node-ca-tdc99\" (UID: \"d360f1dd-1647-4c4b-8626-fe12ac3751b5\") " pod="openshift-image-registry/node-ca-tdc99" Jul 07 14:09:09.070921 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070770 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c706292c-7966-4593-8563-b3da49b7dfcb-socket-dir\") pod \"aws-ebs-csi-driver-node-t5kvc\" (UID: \"c706292c-7966-4593-8563-b3da49b7dfcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5kvc" Jul 07 14:09:09.070921 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070799 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-etc-sysctl-conf\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.070921 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070844 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-host\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.070921 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070870 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8358392b-ad0d-457c-844a-85a1b754a49e-dbus\") pod \"global-pull-secret-syncer-s5cfz\" (UID: \"8358392b-ad0d-457c-844a-85a1b754a49e\") " pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:09:09.070921 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070896 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c706292c-7966-4593-8563-b3da49b7dfcb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t5kvc\" (UID: \"c706292c-7966-4593-8563-b3da49b7dfcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5kvc" Jul 07 14:09:09.071204 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070931 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1093ee1a-7fa2-4027-860e-75334e677b42-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-t88rg\" (UID: \"1093ee1a-7fa2-4027-860e-75334e677b42\") " pod="openshift-multus/multus-additional-cni-plugins-t88rg" Jul 07 14:09:09.071204 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070938 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-hostroot\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.071204 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070963 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e88256f8-e47a-4f61-b897-4ce91c24e80d-multus-daemon-config\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.071204 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070972 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1093ee1a-7fa2-4027-860e-75334e677b42-cnibin\") pod \"multus-additional-cni-plugins-t88rg\" (UID: \"1093ee1a-7fa2-4027-860e-75334e677b42\") " pod="openshift-multus/multus-additional-cni-plugins-t88rg" Jul 07 14:09:09.071204 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070972 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6a2d3927-7c87-4583-afec-33548d872aca-tmp-dir\") pod \"node-resolver-6dqdt\" (UID: \"6a2d3927-7c87-4583-afec-33548d872aca\") " pod="openshift-dns/node-resolver-6dqdt" Jul 07 14:09:09.071204 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.070987 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-node-log\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.071204 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.071010 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c706292c-7966-4593-8563-b3da49b7dfcb-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t5kvc\" (UID: \"c706292c-7966-4593-8563-b3da49b7dfcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5kvc" Jul 07 14:09:09.071204 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.071015 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-tmp\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.071204 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.071036 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d360f1dd-1647-4c4b-8626-fe12ac3751b5-serviceca\") pod \"node-ca-tdc99\" (UID: \"d360f1dd-1647-4c4b-8626-fe12ac3751b5\") " pod="openshift-image-registry/node-ca-tdc99" Jul 07 14:09:09.071204 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.071064 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr5c5\" (UniqueName: \"kubernetes.io/projected/b4eba203-0b3a-4e5d-9ff4-acfbf975ee2d-kube-api-access-gr5c5\") pod \"iptables-alerter-xzl5w\" (UID: \"b4eba203-0b3a-4e5d-9ff4-acfbf975ee2d\") " pod="openshift-network-operator/iptables-alerter-xzl5w" Jul 07 14:09:09.071204 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.071152 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6a2d3927-7c87-4583-afec-33548d872aca-hosts-file\") pod \"node-resolver-6dqdt\" (UID: \"6a2d3927-7c87-4583-afec-33548d872aca\") " pod="openshift-dns/node-resolver-6dqdt" Jul 07 14:09:09.071666 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.071266 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-cnibin\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.071666 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.071295 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-host-run-netns\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.071666 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.071334 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-host-var-lib-cni-multus\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.071666 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.071358 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-run-ovn\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.071666 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.071371 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6a2d3927-7c87-4583-afec-33548d872aca-hosts-file\") pod \"node-resolver-6dqdt\" (UID: \"6a2d3927-7c87-4583-afec-33548d872aca\") " pod="openshift-dns/node-resolver-6dqdt" Jul 07 14:09:09.071666 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.071387 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-host-cni-bin\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.071666 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.071431 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-host-run-netns\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.071666 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.071432 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d360f1dd-1647-4c4b-8626-fe12ac3751b5-serviceca\") pod \"node-ca-tdc99\" (UID: \"d360f1dd-1647-4c4b-8626-fe12ac3751b5\") " pod="openshift-image-registry/node-ca-tdc99" Jul 07 14:09:09.071666 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.071460 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-run-systemd\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.071666 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.071486 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/89089a6f-7090-4264-bfc4-1ec644da32ab-ovn-node-metrics-cert\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.071666 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.071530 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-etc-kubernetes\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.071666 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.071547 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-run\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.071666 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.071576 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-lib-modules\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.071666 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.071600 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-host-var-lib-cni-bin\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.071666 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.071615 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-multus-conf-dir\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.071666 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.071656 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/89089a6f-7090-4264-bfc4-1ec644da32ab-env-overrides\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.072325 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.071682 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/89089a6f-7090-4264-bfc4-1ec644da32ab-ovnkube-script-lib\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.072325 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.071721 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-host-var-lib-kubelet\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.072325 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.071740 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8358392b-ad0d-457c-844a-85a1b754a49e-original-pull-secret\") pod \"global-pull-secret-syncer-s5cfz\" (UID: \"8358392b-ad0d-457c-844a-85a1b754a49e\") " pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:09:09.072325 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.071757 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c706292c-7966-4593-8563-b3da49b7dfcb-sys-fs\") pod \"aws-ebs-csi-driver-node-t5kvc\" (UID: \"c706292c-7966-4593-8563-b3da49b7dfcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5kvc" Jul 07 14:09:09.072325 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.071774 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms9pc\" (UniqueName: \"kubernetes.io/projected/c706292c-7966-4593-8563-b3da49b7dfcb-kube-api-access-ms9pc\") pod \"aws-ebs-csi-driver-node-t5kvc\" (UID: \"c706292c-7966-4593-8563-b3da49b7dfcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5kvc" Jul 07 14:09:09.072325 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.071788 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-multus-cni-dir\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.072325 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.071820 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-log-socket\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.072325 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.071882 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-etc-systemd\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.072325 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.071900 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c706292c-7966-4593-8563-b3da49b7dfcb-sys-fs\") pod \"aws-ebs-csi-driver-node-t5kvc\" (UID: \"c706292c-7966-4593-8563-b3da49b7dfcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5kvc" Jul 07 14:09:09.072325 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.071910 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-sys\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.072325 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.071943 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-host-run-multus-certs\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.072325 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.071974 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-host-kubelet\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.072325 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.072019 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwjwj\" (UniqueName: \"kubernetes.io/projected/d360f1dd-1647-4c4b-8626-fe12ac3751b5-kube-api-access-jwjwj\") pod \"node-ca-tdc99\" (UID: \"d360f1dd-1647-4c4b-8626-fe12ac3751b5\") " pod="openshift-image-registry/node-ca-tdc99" Jul 07 14:09:09.072325 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.072076 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b4eba203-0b3a-4e5d-9ff4-acfbf975ee2d-iptables-alerter-script\") pod \"iptables-alerter-xzl5w\" (UID: \"b4eba203-0b3a-4e5d-9ff4-acfbf975ee2d\") " pod="openshift-network-operator/iptables-alerter-xzl5w" Jul 07 14:09:09.072325 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.072181 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-host-run-ovn-kubernetes\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.072325 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.072212 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1125d082-9200-4b6f-b03b-1edd11069009-metrics-certs\") pod \"network-metrics-daemon-rfmz4\" (UID: \"1125d082-9200-4b6f-b03b-1edd11069009\") " pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:09:09.073001 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.072232 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c706292c-7966-4593-8563-b3da49b7dfcb-device-dir\") pod \"aws-ebs-csi-driver-node-t5kvc\" (UID: \"c706292c-7966-4593-8563-b3da49b7dfcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5kvc" Jul 07 14:09:09.073001 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.072246 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-system-cni-dir\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.073001 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.072263 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-multus-socket-dir-parent\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.073001 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.072349 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c706292c-7966-4593-8563-b3da49b7dfcb-device-dir\") pod \"aws-ebs-csi-driver-node-t5kvc\" (UID: \"c706292c-7966-4593-8563-b3da49b7dfcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5kvc" Jul 07 14:09:09.073001 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.072617 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b4eba203-0b3a-4e5d-9ff4-acfbf975ee2d-iptables-alerter-script\") pod \"iptables-alerter-xzl5w\" (UID: \"b4eba203-0b3a-4e5d-9ff4-acfbf975ee2d\") " pod="openshift-network-operator/iptables-alerter-xzl5w" Jul 07 14:09:09.075598 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.075576 2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 14:09:09.079246 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.079224 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbxjs\" (UniqueName: \"kubernetes.io/projected/6a2d3927-7c87-4583-afec-33548d872aca-kube-api-access-jbxjs\") pod \"node-resolver-6dqdt\" (UID: \"6a2d3927-7c87-4583-afec-33548d872aca\") " pod="openshift-dns/node-resolver-6dqdt" Jul 07 14:09:09.083826 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.083796 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms9pc\" (UniqueName: \"kubernetes.io/projected/c706292c-7966-4593-8563-b3da49b7dfcb-kube-api-access-ms9pc\") pod \"aws-ebs-csi-driver-node-t5kvc\" (UID: \"c706292c-7966-4593-8563-b3da49b7dfcb\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5kvc" Jul 07 14:09:09.084414 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.084388 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxhhc\" (UniqueName: \"kubernetes.io/projected/1093ee1a-7fa2-4027-860e-75334e677b42-kube-api-access-dxhhc\") pod \"multus-additional-cni-plugins-t88rg\" (UID: \"1093ee1a-7fa2-4027-860e-75334e677b42\") " pod="openshift-multus/multus-additional-cni-plugins-t88rg" Jul 07 14:09:09.084414 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.084394 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr5c5\" (UniqueName: \"kubernetes.io/projected/b4eba203-0b3a-4e5d-9ff4-acfbf975ee2d-kube-api-access-gr5c5\") pod \"iptables-alerter-xzl5w\" (UID: \"b4eba203-0b3a-4e5d-9ff4-acfbf975ee2d\") " pod="openshift-network-operator/iptables-alerter-xzl5w" Jul 07 14:09:09.084578 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.084561 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwjwj\" (UniqueName: \"kubernetes.io/projected/d360f1dd-1647-4c4b-8626-fe12ac3751b5-kube-api-access-jwjwj\") pod \"node-ca-tdc99\" (UID: \"d360f1dd-1647-4c4b-8626-fe12ac3751b5\") " pod="openshift-image-registry/node-ca-tdc99" Jul 07 14:09:09.099475 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.099426 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-152.ec2.internal" event={"ID":"7c53c5de8c1731c73afeca96f56511a2","Type":"ContainerStarted","Data":"a9817b105fb9e814fd6187e864af3963d77086e82c38481fc9587ce107cebe14"} Jul 07 14:09:09.100642 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.100618 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal" event={"ID":"a229f29ed6471a8554089697807f4dde","Type":"ContainerStarted","Data":"f44c5caad4e0259bf8425525eece61e119e8998c116ef5bc8f6847e4ccd2e97d"} Jul 07 14:09:09.172788 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.172750 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbmkr\" (UniqueName: \"kubernetes.io/projected/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-kube-api-access-sbmkr\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.172966 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.172797 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8358392b-ad0d-457c-844a-85a1b754a49e-kubelet-config\") pod \"global-pull-secret-syncer-s5cfz\" (UID: \"8358392b-ad0d-457c-844a-85a1b754a49e\") " pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:09:09.172966 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.172824 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e88256f8-e47a-4f61-b897-4ce91c24e80d-cni-binary-copy\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.172966 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.172847 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-host-run-k8s-cni-cncf-io\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.172966 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.172871 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b0e566be-2b4d-47a4-bce3-79b9cb20739c-agent-certs\") pod \"konnectivity-agent-7f8r6\" (UID: \"b0e566be-2b4d-47a4-bce3-79b9cb20739c\") " pod="kube-system/konnectivity-agent-7f8r6" Jul 07 14:09:09.172966 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.172896 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.172966 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.172920 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/89089a6f-7090-4264-bfc4-1ec644da32ab-ovnkube-config\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.172966 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.172945 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dps2\" (UniqueName: \"kubernetes.io/projected/a6bce278-b340-4280-882f-2337ec23b28e-kube-api-access-7dps2\") pod \"network-check-target-xzfg2\" (UID: \"a6bce278-b340-4280-882f-2337ec23b28e\") " pod="openshift-network-diagnostics/network-check-target-xzfg2" Jul 07 14:09:09.172966 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.172969 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b0e566be-2b4d-47a4-bce3-79b9cb20739c-konnectivity-ca\") pod \"konnectivity-agent-7f8r6\" (UID: \"b0e566be-2b4d-47a4-bce3-79b9cb20739c\") " pod="kube-system/konnectivity-agent-7f8r6" Jul 07 14:09:09.173353 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.172984 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-run-openvswitch\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.173353 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173000 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f8xf\" (UniqueName: \"kubernetes.io/projected/89089a6f-7090-4264-bfc4-1ec644da32ab-kube-api-access-5f8xf\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.173353 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173014 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-etc-sysconfig\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.173353 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173028 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-etc-sysctl-d\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.173353 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173042 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6qs2\" (UniqueName: \"kubernetes.io/projected/e88256f8-e47a-4f61-b897-4ce91c24e80d-kube-api-access-f6qs2\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.173353 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173065 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-etc-openvswitch\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.173353 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173084 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-etc-modprobe-d\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.173353 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173100 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-etc-sysctl-conf\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.173353 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173119 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-host\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.173353 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173133 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8358392b-ad0d-457c-844a-85a1b754a49e-dbus\") pod \"global-pull-secret-syncer-s5cfz\" (UID: \"8358392b-ad0d-457c-844a-85a1b754a49e\") " pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:09:09.173353 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173147 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-hostroot\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.173353 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173163 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e88256f8-e47a-4f61-b897-4ce91c24e80d-multus-daemon-config\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.173353 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173185 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-node-log\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.173353 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173205 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-tmp\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.173353 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173217 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-host-run-k8s-cni-cncf-io\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.173353 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173230 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-cnibin\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.173353 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173277 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-etc-openvswitch\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.173353 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173306 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-host-run-netns\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.174254 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173334 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-host-var-lib-cni-multus\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.174254 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173421 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-run-ovn\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.174254 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173425 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-etc-modprobe-d\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.174254 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173448 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-host-cni-bin\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.174254 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173533 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-host-run-netns\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.174254 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173558 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-run-systemd\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.174254 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173582 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/89089a6f-7090-4264-bfc4-1ec644da32ab-ovn-node-metrics-cert\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.174254 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173593 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-etc-sysctl-conf\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.174254 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173607 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-etc-kubernetes\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.174254 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173631 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-run\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.174254 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173662 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-etc-sysconfig\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.174254 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173669 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-lib-modules\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.174254 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173673 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/89089a6f-7090-4264-bfc4-1ec644da32ab-ovnkube-config\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.174254 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173709 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-host\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.174254 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173722 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-host-var-lib-cni-bin\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.174254 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173731 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8358392b-ad0d-457c-844a-85a1b754a49e-dbus\") pod \"global-pull-secret-syncer-s5cfz\" (UID: \"8358392b-ad0d-457c-844a-85a1b754a49e\") " pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:09:09.174254 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173778 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-multus-conf-dir\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.175022 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.174397 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/89089a6f-7090-4264-bfc4-1ec644da32ab-env-overrides\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.175022 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.174416 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-etc-sysctl-d\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.175022 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.174428 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/89089a6f-7090-4264-bfc4-1ec644da32ab-ovnkube-script-lib\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.175022 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.174358 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b0e566be-2b4d-47a4-bce3-79b9cb20739c-konnectivity-ca\") pod \"konnectivity-agent-7f8r6\" (UID: \"b0e566be-2b4d-47a4-bce3-79b9cb20739c\") " pod="kube-system/konnectivity-agent-7f8r6" Jul 07 14:09:09.175022 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.174456 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-host-var-lib-kubelet\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.175022 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173770 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-hostroot\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.175022 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.174483 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8358392b-ad0d-457c-844a-85a1b754a49e-original-pull-secret\") pod \"global-pull-secret-syncer-s5cfz\" (UID: \"8358392b-ad0d-457c-844a-85a1b754a49e\") " pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:09:09.175022 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.174558 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-multus-cni-dir\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.175022 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:09.174586 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:09.175022 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.174594 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-log-socket\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.175022 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.174627 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-etc-systemd\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.175022 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:09.174671 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8358392b-ad0d-457c-844a-85a1b754a49e-original-pull-secret podName:8358392b-ad0d-457c-844a-85a1b754a49e nodeName:}" failed. No retries permitted until 2026-07-07 14:09:09.674639338 +0000 UTC m=+3.057476765 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8358392b-ad0d-457c-844a-85a1b754a49e-original-pull-secret") pod "global-pull-secret-syncer-s5cfz" (UID: "8358392b-ad0d-457c-844a-85a1b754a49e") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:09.175022 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.174686 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-sys\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.175022 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.174702 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-etc-systemd\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.175022 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.174720 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-host-run-multus-certs\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.175022 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.174750 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-host-run-multus-certs\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.175022 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.174761 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-host-kubelet\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.175824 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.173741 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.175824 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.174814 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-host-kubelet\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.175824 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.174852 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-host-run-ovn-kubernetes\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.175824 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.174884 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1125d082-9200-4b6f-b03b-1edd11069009-metrics-certs\") pod \"network-metrics-daemon-rfmz4\" (UID: \"1125d082-9200-4b6f-b03b-1edd11069009\") " pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:09:09.175824 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.174915 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-system-cni-dir\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.175824 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.174941 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-multus-socket-dir-parent\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.175824 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.175000 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-cnibin\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.175824 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.175016 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-multus-socket-dir-parent\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.175824 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.175074 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-multus-cni-dir\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.175824 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.175116 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-log-socket\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.175824 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.174161 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-run-openvswitch\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.175824 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.175114 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/89089a6f-7090-4264-bfc4-1ec644da32ab-env-overrides\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.175824 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.175185 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-system-cni-dir\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.175824 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.175579 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/89089a6f-7090-4264-bfc4-1ec644da32ab-ovnkube-script-lib\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.175824 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.175652 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-host-run-ovn-kubernetes\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.175824 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:09.175741 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:09.175824 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:09.175792 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1125d082-9200-4b6f-b03b-1edd11069009-metrics-certs podName:1125d082-9200-4b6f-b03b-1edd11069009 nodeName:}" failed. No retries permitted until 2026-07-07 14:09:09.675775634 +0000 UTC m=+3.058613044 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1125d082-9200-4b6f-b03b-1edd11069009-metrics-certs") pod "network-metrics-daemon-rfmz4" (UID: "1125d082-9200-4b6f-b03b-1edd11069009") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:09.176566 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.175805 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-node-log\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.176566 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.175838 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-host-var-lib-kubelet\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.176566 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.176068 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-sys\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.176566 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.176121 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-host-run-netns\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.176566 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.176170 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8358392b-ad0d-457c-844a-85a1b754a49e-kubelet-config\") pod \"global-pull-secret-syncer-s5cfz\" (UID: \"8358392b-ad0d-457c-844a-85a1b754a49e\") " pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:09:09.176566 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.176367 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e88256f8-e47a-4f61-b897-4ce91c24e80d-multus-daemon-config\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.176566 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.176461 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-host-var-lib-cni-multus\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.176566 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.176536 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-host-run-netns\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.176962 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.176579 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e88256f8-e47a-4f61-b897-4ce91c24e80d-cni-binary-copy\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.176962 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.176631 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-run-ovn\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.176962 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.176668 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-host-cni-bin\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.176962 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.176706 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-run\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.176962 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.176744 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-run-systemd\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.176962 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.176930 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-etc-kubernetes\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.177207 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.176998 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-host-var-lib-cni-bin\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.177207 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.177123 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-lib-modules\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.177207 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.177184 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-multus-conf-dir\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.177338 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.177296 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-host-slash\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.177385 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.177338 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-var-lib-openvswitch\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.177385 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.177371 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-host-cni-netd\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.177477 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.177403 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-os-release\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.177477 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.177435 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-systemd-units\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.177477 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.177467 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-var-lib-kubelet\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.177640 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.177496 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-etc-tuned\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.177640 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.177551 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-etc-kubernetes\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.177640 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.177580 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-var-lib-openvswitch\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.177765 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.177653 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-var-lib-kubelet\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.177831 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.177585 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mtzs\" (UniqueName: \"kubernetes.io/projected/1125d082-9200-4b6f-b03b-1edd11069009-kube-api-access-2mtzs\") pod \"network-metrics-daemon-rfmz4\" (UID: \"1125d082-9200-4b6f-b03b-1edd11069009\") " pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:09:09.177937 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.177918 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-host-slash\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.178043 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.177996 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-os-release\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.178098 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.178057 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-systemd-units\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.178141 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.178102 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/89089a6f-7090-4264-bfc4-1ec644da32ab-host-cni-netd\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.178182 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.178151 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e88256f8-e47a-4f61-b897-4ce91c24e80d-etc-kubernetes\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.180163 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.179962 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/89089a6f-7090-4264-bfc4-1ec644da32ab-ovn-node-metrics-cert\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.180163 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.180139 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-tmp\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.180627 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.180602 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-etc-tuned\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.181523 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:09.181486 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:09:09.181622 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:09.181533 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:09:09.181622 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:09.181549 2557 projected.go:196] Error preparing data for projected volume kube-api-access-7dps2 for pod openshift-network-diagnostics/network-check-target-xzfg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:09.181622 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:09.181612 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6bce278-b340-4280-882f-2337ec23b28e-kube-api-access-7dps2 podName:a6bce278-b340-4280-882f-2337ec23b28e nodeName:}" failed. No retries permitted until 2026-07-07 14:09:09.681595703 +0000 UTC m=+3.064433128 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7dps2" (UniqueName: "kubernetes.io/projected/a6bce278-b340-4280-882f-2337ec23b28e-kube-api-access-7dps2") pod "network-check-target-xzfg2" (UID: "a6bce278-b340-4280-882f-2337ec23b28e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:09.181939 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.181915 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b0e566be-2b4d-47a4-bce3-79b9cb20739c-agent-certs\") pod \"konnectivity-agent-7f8r6\" (UID: \"b0e566be-2b4d-47a4-bce3-79b9cb20739c\") " pod="kube-system/konnectivity-agent-7f8r6" Jul 07 14:09:09.184282 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.183562 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbmkr\" (UniqueName: \"kubernetes.io/projected/fd093dc2-b2a4-4c5a-9b12-5a65cef25df4-kube-api-access-sbmkr\") pod \"tuned-swvr7\" (UID: \"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4\") " pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.184282 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.183798 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6qs2\" (UniqueName: \"kubernetes.io/projected/e88256f8-e47a-4f61-b897-4ce91c24e80d-kube-api-access-f6qs2\") pod \"multus-6lrcb\" (UID: \"e88256f8-e47a-4f61-b897-4ce91c24e80d\") " pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.186022 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.185995 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f8xf\" (UniqueName: \"kubernetes.io/projected/89089a6f-7090-4264-bfc4-1ec644da32ab-kube-api-access-5f8xf\") pod \"ovnkube-node-v7sfl\" (UID: \"89089a6f-7090-4264-bfc4-1ec644da32ab\") " pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.187798 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.187483 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mtzs\" (UniqueName: \"kubernetes.io/projected/1125d082-9200-4b6f-b03b-1edd11069009-kube-api-access-2mtzs\") pod \"network-metrics-daemon-rfmz4\" (UID: \"1125d082-9200-4b6f-b03b-1edd11069009\") " pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:09:09.263690 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.263597 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-t88rg" Jul 07 14:09:09.274605 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.274572 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xzl5w" Jul 07 14:09:09.276133 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:09.276101 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1093ee1a_7fa2_4027_860e_75334e677b42.slice/crio-fef4bb4a8bd873a5f49e54068abd1827688e9ea20849b508b0a2c6d46df68bbb WatchSource:0}: Error finding container fef4bb4a8bd873a5f49e54068abd1827688e9ea20849b508b0a2c6d46df68bbb: Status 404 returned error can't find the container with id fef4bb4a8bd873a5f49e54068abd1827688e9ea20849b508b0a2c6d46df68bbb Jul 07 14:09:09.283929 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:09.283891 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4eba203_0b3a_4e5d_9ff4_acfbf975ee2d.slice/crio-aa8f2447d901b481207a6b2e4d2ab31c785990910d758f7d6ed9ef1fa035dce2 WatchSource:0}: Error finding container aa8f2447d901b481207a6b2e4d2ab31c785990910d758f7d6ed9ef1fa035dce2: Status 404 returned error can't find the container with id aa8f2447d901b481207a6b2e4d2ab31c785990910d758f7d6ed9ef1fa035dce2 Jul 07 14:09:09.284758 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.284730 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5kvc" Jul 07 14:09:09.295873 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:09.295585 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc706292c_7966_4593_8563_b3da49b7dfcb.slice/crio-9906c15d9497356bcab94c1aabb3a29be123e69ae63be99fc0ba9bfa0144ebc7 WatchSource:0}: Error finding container 9906c15d9497356bcab94c1aabb3a29be123e69ae63be99fc0ba9bfa0144ebc7: Status 404 returned error can't find the container with id 9906c15d9497356bcab94c1aabb3a29be123e69ae63be99fc0ba9bfa0144ebc7 Jul 07 14:09:09.295873 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.295655 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6dqdt" Jul 07 14:09:09.302625 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.302603 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tdc99" Jul 07 14:09:09.306004 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:09.305981 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a2d3927_7c87_4583_afec_33548d872aca.slice/crio-6ca9e47b04d3bb8cb02776a347bb8e3de60d024ff73846579d31511d719b04b0 WatchSource:0}: Error finding container 6ca9e47b04d3bb8cb02776a347bb8e3de60d024ff73846579d31511d719b04b0: Status 404 returned error can't find the container with id 6ca9e47b04d3bb8cb02776a347bb8e3de60d024ff73846579d31511d719b04b0 Jul 07 14:09:09.310830 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.310806 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6lrcb" Jul 07 14:09:09.311891 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:09.311866 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd360f1dd_1647_4c4b_8626_fe12ac3751b5.slice/crio-a920bfdac418e5adfca60a11e2135d6bad8d10650319ae48d954f2b1047e7d69 WatchSource:0}: Error finding container a920bfdac418e5adfca60a11e2135d6bad8d10650319ae48d954f2b1047e7d69: Status 404 returned error can't find the container with id a920bfdac418e5adfca60a11e2135d6bad8d10650319ae48d954f2b1047e7d69 Jul 07 14:09:09.320404 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.320380 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7f8r6" Jul 07 14:09:09.320738 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:09.320710 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode88256f8_e47a_4f61_b897_4ce91c24e80d.slice/crio-99599a4f895da59cc2be489d8e0293f0b71a0ac5694d3d2ae731bc75a4c9def1 WatchSource:0}: Error finding container 99599a4f895da59cc2be489d8e0293f0b71a0ac5694d3d2ae731bc75a4c9def1: Status 404 returned error can't find the container with id 99599a4f895da59cc2be489d8e0293f0b71a0ac5694d3d2ae731bc75a4c9def1 Jul 07 14:09:09.326611 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.326429 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:09.328953 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:09.328926 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0e566be_2b4d_47a4_bce3_79b9cb20739c.slice/crio-4f8233dfbe6bcbcdbb79ff62923f5e6cde0def7e3d58ded3dfebab2a381797bd WatchSource:0}: Error finding container 4f8233dfbe6bcbcdbb79ff62923f5e6cde0def7e3d58ded3dfebab2a381797bd: Status 404 returned error can't find the container with id 4f8233dfbe6bcbcdbb79ff62923f5e6cde0def7e3d58ded3dfebab2a381797bd Jul 07 14:09:09.334298 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.334279 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-swvr7" Jul 07 14:09:09.335848 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:09.335820 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89089a6f_7090_4264_bfc4_1ec644da32ab.slice/crio-ec362fca2015827fe38a587988f9bd4e090baa49cc6dc4a2a4449175837a229c WatchSource:0}: Error finding container ec362fca2015827fe38a587988f9bd4e090baa49cc6dc4a2a4449175837a229c: Status 404 returned error can't find the container with id ec362fca2015827fe38a587988f9bd4e090baa49cc6dc4a2a4449175837a229c Jul 07 14:09:09.346363 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:09.346334 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd093dc2_b2a4_4c5a_9b12_5a65cef25df4.slice/crio-294562589da21ddca96c86e5f4914d0dad9b780bbf5b477662abca458d8d3e74 WatchSource:0}: Error finding container 294562589da21ddca96c86e5f4914d0dad9b780bbf5b477662abca458d8d3e74: Status 404 returned error can't find the container with id 294562589da21ddca96c86e5f4914d0dad9b780bbf5b477662abca458d8d3e74 Jul 07 14:09:09.681541 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.681440 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8358392b-ad0d-457c-844a-85a1b754a49e-original-pull-secret\") pod \"global-pull-secret-syncer-s5cfz\" (UID: \"8358392b-ad0d-457c-844a-85a1b754a49e\") " pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:09:09.681541 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.681481 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1125d082-9200-4b6f-b03b-1edd11069009-metrics-certs\") pod \"network-metrics-daemon-rfmz4\" (UID: \"1125d082-9200-4b6f-b03b-1edd11069009\") " pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:09:09.681745 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:09.681623 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:09.681745 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:09.681631 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:09.681745 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:09.681682 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1125d082-9200-4b6f-b03b-1edd11069009-metrics-certs podName:1125d082-9200-4b6f-b03b-1edd11069009 nodeName:}" failed. No retries permitted until 2026-07-07 14:09:10.681666953 +0000 UTC m=+4.064504360 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1125d082-9200-4b6f-b03b-1edd11069009-metrics-certs") pod "network-metrics-daemon-rfmz4" (UID: "1125d082-9200-4b6f-b03b-1edd11069009") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:09.681745 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:09.681702 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8358392b-ad0d-457c-844a-85a1b754a49e-original-pull-secret podName:8358392b-ad0d-457c-844a-85a1b754a49e nodeName:}" failed. No retries permitted until 2026-07-07 14:09:10.681693155 +0000 UTC m=+4.064530563 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8358392b-ad0d-457c-844a-85a1b754a49e-original-pull-secret") pod "global-pull-secret-syncer-s5cfz" (UID: "8358392b-ad0d-457c-844a-85a1b754a49e") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:09.782556 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:09.782515 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dps2\" (UniqueName: \"kubernetes.io/projected/a6bce278-b340-4280-882f-2337ec23b28e-kube-api-access-7dps2\") pod \"network-check-target-xzfg2\" (UID: \"a6bce278-b340-4280-882f-2337ec23b28e\") " pod="openshift-network-diagnostics/network-check-target-xzfg2" Jul 07 14:09:09.782744 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:09.782704 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:09:09.782744 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:09.782728 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:09:09.782744 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:09.782740 2557 projected.go:196] Error preparing data for projected volume kube-api-access-7dps2 for pod openshift-network-diagnostics/network-check-target-xzfg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:09.782887 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:09.782812 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6bce278-b340-4280-882f-2337ec23b28e-kube-api-access-7dps2 podName:a6bce278-b340-4280-882f-2337ec23b28e nodeName:}" failed. No retries permitted until 2026-07-07 14:09:10.782792355 +0000 UTC m=+4.165629776 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7dps2" (UniqueName: "kubernetes.io/projected/a6bce278-b340-4280-882f-2337ec23b28e-kube-api-access-7dps2") pod "network-check-target-xzfg2" (UID: "a6bce278-b340-4280-882f-2337ec23b28e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:10.012346 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:10.012260 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 14:04:09 +0000 UTC" deadline="2028-02-25 00:45:28.068261792 +0000 UTC" Jul 07 14:09:10.012346 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:10.012293 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14338h36m18.055972134s" Jul 07 14:09:10.103634 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:10.103597 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7f8r6" event={"ID":"b0e566be-2b4d-47a4-bce3-79b9cb20739c","Type":"ContainerStarted","Data":"4f8233dfbe6bcbcdbb79ff62923f5e6cde0def7e3d58ded3dfebab2a381797bd"} Jul 07 14:09:10.104832 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:10.104783 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6lrcb" event={"ID":"e88256f8-e47a-4f61-b897-4ce91c24e80d","Type":"ContainerStarted","Data":"99599a4f895da59cc2be489d8e0293f0b71a0ac5694d3d2ae731bc75a4c9def1"} Jul 07 14:09:10.106066 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:10.106038 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tdc99" event={"ID":"d360f1dd-1647-4c4b-8626-fe12ac3751b5","Type":"ContainerStarted","Data":"a920bfdac418e5adfca60a11e2135d6bad8d10650319ae48d954f2b1047e7d69"} Jul 07 14:09:10.107189 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:10.107161 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6dqdt" event={"ID":"6a2d3927-7c87-4583-afec-33548d872aca","Type":"ContainerStarted","Data":"6ca9e47b04d3bb8cb02776a347bb8e3de60d024ff73846579d31511d719b04b0"} Jul 07 14:09:10.108281 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:10.108255 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5kvc" event={"ID":"c706292c-7966-4593-8563-b3da49b7dfcb","Type":"ContainerStarted","Data":"9906c15d9497356bcab94c1aabb3a29be123e69ae63be99fc0ba9bfa0144ebc7"} Jul 07 14:09:10.109431 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:10.109395 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xzl5w" event={"ID":"b4eba203-0b3a-4e5d-9ff4-acfbf975ee2d","Type":"ContainerStarted","Data":"aa8f2447d901b481207a6b2e4d2ab31c785990910d758f7d6ed9ef1fa035dce2"} Jul 07 14:09:10.110621 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:10.110601 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" event={"ID":"89089a6f-7090-4264-bfc4-1ec644da32ab","Type":"ContainerStarted","Data":"ec362fca2015827fe38a587988f9bd4e090baa49cc6dc4a2a4449175837a229c"} Jul 07 14:09:10.111824 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:10.111805 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t88rg" event={"ID":"1093ee1a-7fa2-4027-860e-75334e677b42","Type":"ContainerStarted","Data":"fef4bb4a8bd873a5f49e54068abd1827688e9ea20849b508b0a2c6d46df68bbb"} Jul 07 14:09:10.112901 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:10.112881 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-swvr7" event={"ID":"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4","Type":"ContainerStarted","Data":"294562589da21ddca96c86e5f4914d0dad9b780bbf5b477662abca458d8d3e74"} Jul 07 14:09:10.690071 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:10.690033 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1125d082-9200-4b6f-b03b-1edd11069009-metrics-certs\") pod \"network-metrics-daemon-rfmz4\" (UID: \"1125d082-9200-4b6f-b03b-1edd11069009\") " pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:09:10.690248 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:10.690132 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8358392b-ad0d-457c-844a-85a1b754a49e-original-pull-secret\") pod \"global-pull-secret-syncer-s5cfz\" (UID: \"8358392b-ad0d-457c-844a-85a1b754a49e\") " pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:09:10.690309 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:10.690251 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:10.690358 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:10.690313 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8358392b-ad0d-457c-844a-85a1b754a49e-original-pull-secret podName:8358392b-ad0d-457c-844a-85a1b754a49e nodeName:}" failed. No retries permitted until 2026-07-07 14:09:12.690295771 +0000 UTC m=+6.073133183 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8358392b-ad0d-457c-844a-85a1b754a49e-original-pull-secret") pod "global-pull-secret-syncer-s5cfz" (UID: "8358392b-ad0d-457c-844a-85a1b754a49e") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:10.690851 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:10.690753 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:10.690851 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:10.690815 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1125d082-9200-4b6f-b03b-1edd11069009-metrics-certs podName:1125d082-9200-4b6f-b03b-1edd11069009 nodeName:}" failed. No retries permitted until 2026-07-07 14:09:12.690800316 +0000 UTC m=+6.073637741 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1125d082-9200-4b6f-b03b-1edd11069009-metrics-certs") pod "network-metrics-daemon-rfmz4" (UID: "1125d082-9200-4b6f-b03b-1edd11069009") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:10.792309 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:10.791449 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dps2\" (UniqueName: \"kubernetes.io/projected/a6bce278-b340-4280-882f-2337ec23b28e-kube-api-access-7dps2\") pod \"network-check-target-xzfg2\" (UID: \"a6bce278-b340-4280-882f-2337ec23b28e\") " pod="openshift-network-diagnostics/network-check-target-xzfg2" Jul 07 14:09:10.792309 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:10.791864 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:09:10.792309 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:10.791890 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:09:10.792309 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:10.791904 2557 projected.go:196] Error preparing data for projected volume kube-api-access-7dps2 for pod openshift-network-diagnostics/network-check-target-xzfg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:10.792309 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:10.791964 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6bce278-b340-4280-882f-2337ec23b28e-kube-api-access-7dps2 podName:a6bce278-b340-4280-882f-2337ec23b28e nodeName:}" failed. No retries permitted until 2026-07-07 14:09:12.791945102 +0000 UTC m=+6.174782528 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7dps2" (UniqueName: "kubernetes.io/projected/a6bce278-b340-4280-882f-2337ec23b28e-kube-api-access-7dps2") pod "network-check-target-xzfg2" (UID: "a6bce278-b340-4280-882f-2337ec23b28e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:11.012665 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:11.012456 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 14:04:09 +0000 UTC" deadline="2027-12-28 02:24:48.394167697 +0000 UTC" Jul 07 14:09:11.013154 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:11.013123 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12924h15m37.38167348s" Jul 07 14:09:11.097037 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:11.097001 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:09:11.097202 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:11.097136 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5cfz" podUID="8358392b-ad0d-457c-844a-85a1b754a49e" Jul 07 14:09:11.097274 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:11.097213 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzfg2" Jul 07 14:09:11.097325 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:11.097283 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzfg2" podUID="a6bce278-b340-4280-882f-2337ec23b28e" Jul 07 14:09:11.097381 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:11.097351 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:09:11.097494 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:11.097428 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfmz4" podUID="1125d082-9200-4b6f-b03b-1edd11069009" Jul 07 14:09:11.118810 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:11.118742 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-152.ec2.internal" event={"ID":"7c53c5de8c1731c73afeca96f56511a2","Type":"ContainerStarted","Data":"fcd3948156bd2e9661c5029c34d3eddf622e048849a2aa1b8bec828dc9b6eb4f"} Jul 07 14:09:12.127644 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:12.127589 2557 generic.go:356] "Generic (PLEG): container finished" podID="a229f29ed6471a8554089697807f4dde" containerID="236711c1a1eefffdec33ee1c3a2f9fcb06b48c5d8aaa4d46c24a9e813fb74e6b" exitCode=0 Jul 07 14:09:12.128097 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:12.127725 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal" event={"ID":"a229f29ed6471a8554089697807f4dde","Type":"ContainerDied","Data":"236711c1a1eefffdec33ee1c3a2f9fcb06b48c5d8aaa4d46c24a9e813fb74e6b"} Jul 07 14:09:12.146952 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:12.146894 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-152.ec2.internal" podStartSLOduration=4.146871314 podStartE2EDuration="4.146871314s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:09:11.145087994 +0000 UTC m=+4.527925425" watchObservedRunningTime="2026-07-07 14:09:12.146871314 +0000 UTC m=+5.529708745" Jul 07 14:09:12.713082 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:12.712989 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8358392b-ad0d-457c-844a-85a1b754a49e-original-pull-secret\") pod \"global-pull-secret-syncer-s5cfz\" (UID: \"8358392b-ad0d-457c-844a-85a1b754a49e\") " pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:09:12.713082 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:12.713055 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1125d082-9200-4b6f-b03b-1edd11069009-metrics-certs\") pod \"network-metrics-daemon-rfmz4\" (UID: \"1125d082-9200-4b6f-b03b-1edd11069009\") " pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:09:12.713313 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:12.713210 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:12.713313 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:12.713274 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1125d082-9200-4b6f-b03b-1edd11069009-metrics-certs podName:1125d082-9200-4b6f-b03b-1edd11069009 nodeName:}" failed. No retries permitted until 2026-07-07 14:09:16.71325555 +0000 UTC m=+10.096092960 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1125d082-9200-4b6f-b03b-1edd11069009-metrics-certs") pod "network-metrics-daemon-rfmz4" (UID: "1125d082-9200-4b6f-b03b-1edd11069009") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:12.713734 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:12.713711 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:12.713842 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:12.713772 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8358392b-ad0d-457c-844a-85a1b754a49e-original-pull-secret podName:8358392b-ad0d-457c-844a-85a1b754a49e nodeName:}" failed. No retries permitted until 2026-07-07 14:09:16.713757153 +0000 UTC m=+10.096594585 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8358392b-ad0d-457c-844a-85a1b754a49e-original-pull-secret") pod "global-pull-secret-syncer-s5cfz" (UID: "8358392b-ad0d-457c-844a-85a1b754a49e") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:12.814607 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:12.813995 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dps2\" (UniqueName: \"kubernetes.io/projected/a6bce278-b340-4280-882f-2337ec23b28e-kube-api-access-7dps2\") pod \"network-check-target-xzfg2\" (UID: \"a6bce278-b340-4280-882f-2337ec23b28e\") " pod="openshift-network-diagnostics/network-check-target-xzfg2" Jul 07 14:09:12.814607 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:12.814165 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:09:12.814607 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:12.814185 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:09:12.814607 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:12.814198 2557 projected.go:196] Error preparing data for projected volume kube-api-access-7dps2 for pod openshift-network-diagnostics/network-check-target-xzfg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:12.814607 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:12.814257 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6bce278-b340-4280-882f-2337ec23b28e-kube-api-access-7dps2 podName:a6bce278-b340-4280-882f-2337ec23b28e nodeName:}" failed. No retries permitted until 2026-07-07 14:09:16.814238868 +0000 UTC m=+10.197076278 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7dps2" (UniqueName: "kubernetes.io/projected/a6bce278-b340-4280-882f-2337ec23b28e-kube-api-access-7dps2") pod "network-check-target-xzfg2" (UID: "a6bce278-b340-4280-882f-2337ec23b28e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:13.097914 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:13.097830 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzfg2" Jul 07 14:09:13.098042 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:13.097967 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzfg2" podUID="a6bce278-b340-4280-882f-2337ec23b28e" Jul 07 14:09:13.098409 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:13.098387 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:09:13.098545 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:13.098523 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfmz4" podUID="1125d082-9200-4b6f-b03b-1edd11069009" Jul 07 14:09:13.098609 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:13.098594 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:09:13.098705 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:13.098688 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5cfz" podUID="8358392b-ad0d-457c-844a-85a1b754a49e" Jul 07 14:09:13.134018 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:13.133422 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal" event={"ID":"a229f29ed6471a8554089697807f4dde","Type":"ContainerStarted","Data":"f407aed3feab0f7a060597382975ddffc2737bed8b530cf12dcda354b2aea48e"} Jul 07 14:09:15.103743 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:15.103649 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzfg2" Jul 07 14:09:15.104189 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:15.103667 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:09:15.104189 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:15.103863 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:09:15.104189 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:15.103861 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzfg2" podUID="a6bce278-b340-4280-882f-2337ec23b28e" Jul 07 14:09:15.104189 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:15.103996 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfmz4" podUID="1125d082-9200-4b6f-b03b-1edd11069009" Jul 07 14:09:15.104189 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:15.104073 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5cfz" podUID="8358392b-ad0d-457c-844a-85a1b754a49e" Jul 07 14:09:16.751866 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:16.751702 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8358392b-ad0d-457c-844a-85a1b754a49e-original-pull-secret\") pod \"global-pull-secret-syncer-s5cfz\" (UID: \"8358392b-ad0d-457c-844a-85a1b754a49e\") " pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:09:16.751866 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:16.751778 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1125d082-9200-4b6f-b03b-1edd11069009-metrics-certs\") pod \"network-metrics-daemon-rfmz4\" (UID: \"1125d082-9200-4b6f-b03b-1edd11069009\") " pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:09:16.751866 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:16.751851 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:16.752396 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:16.751931 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8358392b-ad0d-457c-844a-85a1b754a49e-original-pull-secret podName:8358392b-ad0d-457c-844a-85a1b754a49e nodeName:}" failed. No retries permitted until 2026-07-07 14:09:24.751909174 +0000 UTC m=+18.134746586 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8358392b-ad0d-457c-844a-85a1b754a49e-original-pull-secret") pod "global-pull-secret-syncer-s5cfz" (UID: "8358392b-ad0d-457c-844a-85a1b754a49e") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:16.752396 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:16.751936 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:16.752396 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:16.751999 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1125d082-9200-4b6f-b03b-1edd11069009-metrics-certs podName:1125d082-9200-4b6f-b03b-1edd11069009 nodeName:}" failed. No retries permitted until 2026-07-07 14:09:24.751980441 +0000 UTC m=+18.134817864 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1125d082-9200-4b6f-b03b-1edd11069009-metrics-certs") pod "network-metrics-daemon-rfmz4" (UID: "1125d082-9200-4b6f-b03b-1edd11069009") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:16.853341 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:16.852669 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dps2\" (UniqueName: \"kubernetes.io/projected/a6bce278-b340-4280-882f-2337ec23b28e-kube-api-access-7dps2\") pod \"network-check-target-xzfg2\" (UID: \"a6bce278-b340-4280-882f-2337ec23b28e\") " pod="openshift-network-diagnostics/network-check-target-xzfg2" Jul 07 14:09:16.853341 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:16.852903 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:09:16.853341 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:16.852925 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:09:16.853341 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:16.852936 2557 projected.go:196] Error preparing data for projected volume kube-api-access-7dps2 for pod openshift-network-diagnostics/network-check-target-xzfg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:16.853341 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:16.852991 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6bce278-b340-4280-882f-2337ec23b28e-kube-api-access-7dps2 podName:a6bce278-b340-4280-882f-2337ec23b28e nodeName:}" failed. No retries permitted until 2026-07-07 14:09:24.852973328 +0000 UTC m=+18.235810761 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7dps2" (UniqueName: "kubernetes.io/projected/a6bce278-b340-4280-882f-2337ec23b28e-kube-api-access-7dps2") pod "network-check-target-xzfg2" (UID: "a6bce278-b340-4280-882f-2337ec23b28e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:17.096399 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:17.096330 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:09:17.096558 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:17.096424 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5cfz" podUID="8358392b-ad0d-457c-844a-85a1b754a49e" Jul 07 14:09:17.096612 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:17.096574 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzfg2" Jul 07 14:09:17.096871 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:17.096680 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzfg2" podUID="a6bce278-b340-4280-882f-2337ec23b28e" Jul 07 14:09:17.096871 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:17.096714 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:09:17.096871 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:17.096835 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfmz4" podUID="1125d082-9200-4b6f-b03b-1edd11069009" Jul 07 14:09:19.095406 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:19.095366 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:09:19.095768 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:19.095366 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:09:19.095768 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:19.095489 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfmz4" podUID="1125d082-9200-4b6f-b03b-1edd11069009" Jul 07 14:09:19.095768 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:19.095580 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5cfz" podUID="8358392b-ad0d-457c-844a-85a1b754a49e" Jul 07 14:09:19.095768 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:19.095366 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzfg2" Jul 07 14:09:19.095768 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:19.095659 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzfg2" podUID="a6bce278-b340-4280-882f-2337ec23b28e" Jul 07 14:09:21.095466 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:21.095433 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:09:21.095929 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:21.095433 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzfg2" Jul 07 14:09:21.095929 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:21.095579 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5cfz" podUID="8358392b-ad0d-457c-844a-85a1b754a49e" Jul 07 14:09:21.095929 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:21.095904 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:09:21.096104 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:21.095996 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfmz4" podUID="1125d082-9200-4b6f-b03b-1edd11069009" Jul 07 14:09:21.096104 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:21.096079 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzfg2" podUID="a6bce278-b340-4280-882f-2337ec23b28e" Jul 07 14:09:23.095282 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:23.095242 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzfg2" Jul 07 14:09:23.095761 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:23.095243 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:09:23.095761 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:23.095375 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzfg2" podUID="a6bce278-b340-4280-882f-2337ec23b28e" Jul 07 14:09:23.095761 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:23.095454 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5cfz" podUID="8358392b-ad0d-457c-844a-85a1b754a49e" Jul 07 14:09:23.095761 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:23.095535 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:09:23.095761 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:23.095616 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfmz4" podUID="1125d082-9200-4b6f-b03b-1edd11069009" Jul 07 14:09:24.808824 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:24.808778 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8358392b-ad0d-457c-844a-85a1b754a49e-original-pull-secret\") pod \"global-pull-secret-syncer-s5cfz\" (UID: \"8358392b-ad0d-457c-844a-85a1b754a49e\") " pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:09:24.809332 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:24.808951 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:24.809332 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:24.808976 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1125d082-9200-4b6f-b03b-1edd11069009-metrics-certs\") pod \"network-metrics-daemon-rfmz4\" (UID: \"1125d082-9200-4b6f-b03b-1edd11069009\") " pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:09:24.809332 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:24.809027 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8358392b-ad0d-457c-844a-85a1b754a49e-original-pull-secret podName:8358392b-ad0d-457c-844a-85a1b754a49e nodeName:}" failed. No retries permitted until 2026-07-07 14:09:40.809004573 +0000 UTC m=+34.191841981 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8358392b-ad0d-457c-844a-85a1b754a49e-original-pull-secret") pod "global-pull-secret-syncer-s5cfz" (UID: "8358392b-ad0d-457c-844a-85a1b754a49e") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:24.809332 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:24.809081 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:24.809332 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:24.809145 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1125d082-9200-4b6f-b03b-1edd11069009-metrics-certs podName:1125d082-9200-4b6f-b03b-1edd11069009 nodeName:}" failed. No retries permitted until 2026-07-07 14:09:40.809126731 +0000 UTC m=+34.191964139 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1125d082-9200-4b6f-b03b-1edd11069009-metrics-certs") pod "network-metrics-daemon-rfmz4" (UID: "1125d082-9200-4b6f-b03b-1edd11069009") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:24.910342 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:24.910304 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dps2\" (UniqueName: \"kubernetes.io/projected/a6bce278-b340-4280-882f-2337ec23b28e-kube-api-access-7dps2\") pod \"network-check-target-xzfg2\" (UID: \"a6bce278-b340-4280-882f-2337ec23b28e\") " pod="openshift-network-diagnostics/network-check-target-xzfg2" Jul 07 14:09:24.910538 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:24.910470 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:09:24.910538 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:24.910491 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:09:24.910538 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:24.910514 2557 projected.go:196] Error preparing data for projected volume kube-api-access-7dps2 for pod openshift-network-diagnostics/network-check-target-xzfg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:24.910672 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:24.910572 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6bce278-b340-4280-882f-2337ec23b28e-kube-api-access-7dps2 podName:a6bce278-b340-4280-882f-2337ec23b28e nodeName:}" failed. No retries permitted until 2026-07-07 14:09:40.910550141 +0000 UTC m=+34.293387572 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7dps2" (UniqueName: "kubernetes.io/projected/a6bce278-b340-4280-882f-2337ec23b28e-kube-api-access-7dps2") pod "network-check-target-xzfg2" (UID: "a6bce278-b340-4280-882f-2337ec23b28e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:25.096709 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:25.096616 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:09:25.096855 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:25.096630 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzfg2" Jul 07 14:09:25.096855 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:25.096744 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5cfz" podUID="8358392b-ad0d-457c-844a-85a1b754a49e" Jul 07 14:09:25.096855 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:25.096754 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:09:25.097017 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:25.096870 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzfg2" podUID="a6bce278-b340-4280-882f-2337ec23b28e" Jul 07 14:09:25.097017 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:25.096996 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfmz4" podUID="1125d082-9200-4b6f-b03b-1edd11069009" Jul 07 14:09:27.096480 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:27.096439 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:09:27.097017 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:27.096578 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5cfz" podUID="8358392b-ad0d-457c-844a-85a1b754a49e" Jul 07 14:09:27.097017 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:27.097002 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzfg2" Jul 07 14:09:27.097120 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:27.097091 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzfg2" podUID="a6bce278-b340-4280-882f-2337ec23b28e" Jul 07 14:09:27.097282 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:27.097250 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:09:27.097402 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:27.097361 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfmz4" podUID="1125d082-9200-4b6f-b03b-1edd11069009" Jul 07 14:09:29.096458 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:29.095727 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:09:29.096458 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:29.096084 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5cfz" podUID="8358392b-ad0d-457c-844a-85a1b754a49e" Jul 07 14:09:29.096458 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:29.096154 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzfg2" Jul 07 14:09:29.096458 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:29.096230 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzfg2" podUID="a6bce278-b340-4280-882f-2337ec23b28e" Jul 07 14:09:29.096458 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:29.096280 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:09:29.096458 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:29.096353 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfmz4" podUID="1125d082-9200-4b6f-b03b-1edd11069009" Jul 07 14:09:29.167174 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:29.166967 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-swvr7" event={"ID":"fd093dc2-b2a4-4c5a-9b12-5a65cef25df4","Type":"ContainerStarted","Data":"57c2597d38fb2bba43d935284a66e7aa2fb99b1791a4de68fd342db422a62c08"} Jul 07 14:09:29.171497 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:29.171456 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7f8r6" event={"ID":"b0e566be-2b4d-47a4-bce3-79b9cb20739c","Type":"ContainerStarted","Data":"11562dba1ba8087134e289232e4d30dd7da3eef6d5b8378eb3a2fb77bc2e6cba"} Jul 07 14:09:29.174562 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:29.174531 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6lrcb" event={"ID":"e88256f8-e47a-4f61-b897-4ce91c24e80d","Type":"ContainerStarted","Data":"a2613c093d4e1fa56d2bcc9fa19d400642381b91895e705ce1515f86843effda"} Jul 07 14:09:29.176406 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:29.176379 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tdc99" event={"ID":"d360f1dd-1647-4c4b-8626-fe12ac3751b5","Type":"ContainerStarted","Data":"b6711ba3dabfa94794fb33748d4ef8072807f0d8a91fe558a70c3b4f8d235985"} Jul 07 14:09:29.177918 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:29.177896 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6dqdt" event={"ID":"6a2d3927-7c87-4583-afec-33548d872aca","Type":"ContainerStarted","Data":"1510029cdbd2a1ce5771151510ab5e95684eec5f4760d923b0c56957c0977b9e"} Jul 07 14:09:29.179315 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:29.179294 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5kvc" event={"ID":"c706292c-7966-4593-8563-b3da49b7dfcb","Type":"ContainerStarted","Data":"0139fea7041d04a0c24325ff2b653917b8653724ca97eacf84252641a72a6cf5"} Jul 07 14:09:29.180775 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:29.180751 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" event={"ID":"89089a6f-7090-4264-bfc4-1ec644da32ab","Type":"ContainerStarted","Data":"a40fe6b88ad0d6fc56d21a11589ddf427f6e7030030163887a8e9f12ab5979d3"} Jul 07 14:09:29.182136 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:29.182111 2557 generic.go:356] "Generic (PLEG): container finished" podID="1093ee1a-7fa2-4027-860e-75334e677b42" containerID="fb88a02efa63d69acc3c8562b3f0d60b1a9ae32519c4ea6625362b329bdfc9b1" exitCode=0 Jul 07 14:09:29.182227 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:29.182144 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t88rg" event={"ID":"1093ee1a-7fa2-4027-860e-75334e677b42","Type":"ContainerDied","Data":"fb88a02efa63d69acc3c8562b3f0d60b1a9ae32519c4ea6625362b329bdfc9b1"} Jul 07 14:09:29.185753 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:29.185712 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-swvr7" podStartSLOduration=2.6683389330000002 podStartE2EDuration="22.185699753s" totalImagesPullingTime="19.51736082s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:09:29.185441367 +0000 UTC m=+22.568278789" watchObservedRunningTime="2026-07-07 14:09:29.185699753 +0000 UTC m=+22.568537184" Jul 07 14:09:29.185834 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:29.185805 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-152.ec2.internal" podStartSLOduration=21.185799472 podStartE2EDuration="21.185799472s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:09:13.153858335 +0000 UTC m=+6.536695766" watchObservedRunningTime="2026-07-07 14:09:29.185799472 +0000 UTC m=+22.568636905" Jul 07 14:09:29.205753 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:29.205702 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6lrcb" podStartSLOduration=2.603384541 podStartE2EDuration="22.205684939s" totalImagesPullingTime="19.602300398s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:09:29.205257989 +0000 UTC m=+22.588095420" watchObservedRunningTime="2026-07-07 14:09:29.205684939 +0000 UTC m=+22.588522369" Jul 07 14:09:29.243168 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:29.242498 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6dqdt" podStartSLOduration=2.689616186 podStartE2EDuration="22.242479797s" totalImagesPullingTime="19.552863611s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:09:29.241926085 +0000 UTC m=+22.624763517" watchObservedRunningTime="2026-07-07 14:09:29.242479797 +0000 UTC m=+22.625317228" Jul 07 14:09:29.258516 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:29.258448 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tdc99" podStartSLOduration=2.732813505 podStartE2EDuration="22.25843257s" totalImagesPullingTime="19.525619065s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:09:29.258215893 +0000 UTC m=+22.641053319" watchObservedRunningTime="2026-07-07 14:09:29.25843257 +0000 UTC m=+22.641270047" Jul 07 14:09:29.277681 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:29.277574 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7f8r6" podStartSLOduration=2.745484326 podStartE2EDuration="22.277556469s" totalImagesPullingTime="19.532072143s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:09:29.27705459 +0000 UTC m=+22.659892020" watchObservedRunningTime="2026-07-07 14:09:29.277556469 +0000 UTC m=+22.660393899" Jul 07 14:09:29.522683 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:29.522654 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7f8r6" Jul 07 14:09:29.523197 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:29.523179 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7f8r6" Jul 07 14:09:30.186745 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:30.186713 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" event={"ID":"89089a6f-7090-4264-bfc4-1ec644da32ab","Type":"ContainerStarted","Data":"395802edb29b3a06d2b3e06b1622afcfba6157c2091670d0f409510eb06b405e"} Jul 07 14:09:30.187366 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:30.186836 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" event={"ID":"89089a6f-7090-4264-bfc4-1ec644da32ab","Type":"ContainerStarted","Data":"52b1229155c7e39c14ed8edfd9b480657f929ff2068154137d22bd7a86691961"} Jul 07 14:09:30.187366 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:30.186885 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" event={"ID":"89089a6f-7090-4264-bfc4-1ec644da32ab","Type":"ContainerStarted","Data":"3c23709c3ad03643be8ff7db197029b97fcbcd2a5259c8f3eeade0d422b596c6"} Jul 07 14:09:30.187366 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:30.186915 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" event={"ID":"89089a6f-7090-4264-bfc4-1ec644da32ab","Type":"ContainerStarted","Data":"b8af436681f0b16436427cb409870bc97276fc7bf3409a476c2aad9707143a65"} Jul 07 14:09:30.187366 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:30.186943 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" event={"ID":"89089a6f-7090-4264-bfc4-1ec644da32ab","Type":"ContainerStarted","Data":"4d30191a483bc9b1eb81c4a23d33ba9ecc1296a11bbb2ddfa4c34e0ae84178dd"} Jul 07 14:09:30.187366 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:30.187351 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7f8r6" Jul 07 14:09:30.187600 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:30.187543 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7f8r6" Jul 07 14:09:30.597704 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:30.597677 2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 14:09:31.035990 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:31.035838 2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T14:09:30.597697851Z","UUID":"eb84f55c-3bc1-440d-bf4e-e398fdfb0fb6","Handler":null,"Name":"","Endpoint":""} Jul 07 14:09:31.037327 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:31.037302 2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 14:09:31.037440 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:31.037339 2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 14:09:31.095293 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:31.095257 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:09:31.095485 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:31.095257 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzfg2" Jul 07 14:09:31.095485 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:31.095400 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5cfz" podUID="8358392b-ad0d-457c-844a-85a1b754a49e" Jul 07 14:09:31.095485 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:31.095466 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzfg2" podUID="a6bce278-b340-4280-882f-2337ec23b28e" Jul 07 14:09:31.095485 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:31.095260 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:09:31.095646 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:31.095563 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfmz4" podUID="1125d082-9200-4b6f-b03b-1edd11069009" Jul 07 14:09:31.190596 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:31.190563 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5kvc" event={"ID":"c706292c-7966-4593-8563-b3da49b7dfcb","Type":"ContainerStarted","Data":"4bafb6667940b8ab09247bcdcb0eadd76ebcbc21b88e403fdf2eeea727261d8e"} Jul 07 14:09:31.191940 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:31.191916 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xzl5w" event={"ID":"b4eba203-0b3a-4e5d-9ff4-acfbf975ee2d","Type":"ContainerStarted","Data":"eafeac55efb65dd499b5c958b4a16b729a3a4e3ef45446ce384aa609476da782"} Jul 07 14:09:31.212939 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:31.212892 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xzl5w" podStartSLOduration=4.636791834 podStartE2EDuration="24.212876998s" totalImagesPullingTime="19.576085164s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:09:31.212231811 +0000 UTC m=+24.595069242" watchObservedRunningTime="2026-07-07 14:09:31.212876998 +0000 UTC m=+24.595714428" Jul 07 14:09:32.197017 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:32.196973 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" event={"ID":"89089a6f-7090-4264-bfc4-1ec644da32ab","Type":"ContainerStarted","Data":"7380ad980d2b5cdbfa20e9544bdb4121194f14df476ccdbc42bd2f7b598cd19f"} Jul 07 14:09:33.095553 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:33.095358 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:09:33.095773 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:33.095358 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzfg2" Jul 07 14:09:33.095773 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:33.095633 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5cfz" podUID="8358392b-ad0d-457c-844a-85a1b754a49e" Jul 07 14:09:33.095773 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:33.095367 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:09:33.095773 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:33.095695 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzfg2" podUID="a6bce278-b340-4280-882f-2337ec23b28e" Jul 07 14:09:33.095990 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:33.095790 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfmz4" podUID="1125d082-9200-4b6f-b03b-1edd11069009" Jul 07 14:09:33.202902 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:33.202862 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5kvc" event={"ID":"c706292c-7966-4593-8563-b3da49b7dfcb","Type":"ContainerStarted","Data":"3e833bb3a9f48e3a7716f5353e419f249c9b64d7f5a439feb52c39c4289be7ee"} Jul 07 14:09:33.229409 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:33.229343 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t5kvc" podStartSLOduration=11.995617767 podStartE2EDuration="26.229320175s" totalImagesPullingTime="14.233702408s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:09:33.22914928 +0000 UTC m=+26.611986711" watchObservedRunningTime="2026-07-07 14:09:33.229320175 +0000 UTC m=+26.612157607" Jul 07 14:09:35.095705 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:35.095617 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:09:35.095705 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:35.095660 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:09:35.095705 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:35.095617 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzfg2" Jul 07 14:09:35.096487 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:35.095745 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5cfz" podUID="8358392b-ad0d-457c-844a-85a1b754a49e" Jul 07 14:09:35.096487 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:35.095850 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfmz4" podUID="1125d082-9200-4b6f-b03b-1edd11069009" Jul 07 14:09:35.096487 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:35.095925 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzfg2" podUID="a6bce278-b340-4280-882f-2337ec23b28e" Jul 07 14:09:36.213013 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:36.212782 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" event={"ID":"89089a6f-7090-4264-bfc4-1ec644da32ab","Type":"ContainerStarted","Data":"60b6495a507175a2bd3936d4a0d0de609a255f0e9928c4afd4895b1c6760329b"} Jul 07 14:09:36.213629 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:36.213117 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:36.215283 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:36.215258 2557 generic.go:356] "Generic (PLEG): container finished" podID="1093ee1a-7fa2-4027-860e-75334e677b42" containerID="e69946feeebb25832aa72ebf5d9412df3617e81a109bb592e9c4f4841fbf00fd" exitCode=0 Jul 07 14:09:36.215409 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:36.215293 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t88rg" event={"ID":"1093ee1a-7fa2-4027-860e-75334e677b42","Type":"ContainerDied","Data":"e69946feeebb25832aa72ebf5d9412df3617e81a109bb592e9c4f4841fbf00fd"} Jul 07 14:09:36.229599 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:36.229573 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:36.245763 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:36.245707 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" podStartSLOduration=9.649980386 podStartE2EDuration="29.245690691s" totalImagesPullingTime="19.595710305s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:09:36.244354599 +0000 UTC m=+29.627192030" watchObservedRunningTime="2026-07-07 14:09:36.245690691 +0000 UTC m=+29.628528125" Jul 07 14:09:37.096838 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:37.096802 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzfg2" Jul 07 14:09:37.097060 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:37.096930 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzfg2" podUID="a6bce278-b340-4280-882f-2337ec23b28e" Jul 07 14:09:37.097060 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:37.096977 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:09:37.097060 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:37.097009 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:09:37.097185 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:37.097109 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfmz4" podUID="1125d082-9200-4b6f-b03b-1edd11069009" Jul 07 14:09:37.097220 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:37.097191 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5cfz" podUID="8358392b-ad0d-457c-844a-85a1b754a49e" Jul 07 14:09:37.218946 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:37.218916 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:37.219394 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:37.219002 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:37.240136 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:37.240104 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:09:37.467966 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:37.467935 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s5cfz"] Jul 07 14:09:37.468148 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:37.468054 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:09:37.468208 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:37.468161 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5cfz" podUID="8358392b-ad0d-457c-844a-85a1b754a49e" Jul 07 14:09:37.470169 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:37.470128 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rfmz4"] Jul 07 14:09:37.470287 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:37.470253 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:09:37.470358 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:37.470342 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfmz4" podUID="1125d082-9200-4b6f-b03b-1edd11069009" Jul 07 14:09:37.470990 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:37.470965 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xzfg2"] Jul 07 14:09:37.471072 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:37.471058 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzfg2" Jul 07 14:09:37.471186 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:37.471163 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzfg2" podUID="a6bce278-b340-4280-882f-2337ec23b28e" Jul 07 14:09:38.222814 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:38.222781 2557 generic.go:356] "Generic (PLEG): container finished" podID="1093ee1a-7fa2-4027-860e-75334e677b42" containerID="66d15a14fa205b3a0b10bb95656bc379c77d23998ba279f6e265451741724130" exitCode=0 Jul 07 14:09:38.223169 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:38.222867 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t88rg" event={"ID":"1093ee1a-7fa2-4027-860e-75334e677b42","Type":"ContainerDied","Data":"66d15a14fa205b3a0b10bb95656bc379c77d23998ba279f6e265451741724130"} Jul 07 14:09:39.095143 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:39.094950 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:09:39.095283 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:39.094957 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzfg2" Jul 07 14:09:39.095283 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:39.095227 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfmz4" podUID="1125d082-9200-4b6f-b03b-1edd11069009" Jul 07 14:09:39.095368 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:39.095001 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:09:39.095368 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:39.095313 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzfg2" podUID="a6bce278-b340-4280-882f-2337ec23b28e" Jul 07 14:09:39.095368 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:39.095355 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5cfz" podUID="8358392b-ad0d-457c-844a-85a1b754a49e" Jul 07 14:09:40.232406 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:40.232372 2557 generic.go:356] "Generic (PLEG): container finished" podID="1093ee1a-7fa2-4027-860e-75334e677b42" containerID="86a1e14d4770e4f106a267b599a9fcc80511a0baf858082978f4a472232e1c93" exitCode=0 Jul 07 14:09:40.232930 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:40.232423 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t88rg" event={"ID":"1093ee1a-7fa2-4027-860e-75334e677b42","Type":"ContainerDied","Data":"86a1e14d4770e4f106a267b599a9fcc80511a0baf858082978f4a472232e1c93"} Jul 07 14:09:40.834716 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:40.834685 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8358392b-ad0d-457c-844a-85a1b754a49e-original-pull-secret\") pod \"global-pull-secret-syncer-s5cfz\" (UID: \"8358392b-ad0d-457c-844a-85a1b754a49e\") " pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:09:40.834898 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:40.834730 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1125d082-9200-4b6f-b03b-1edd11069009-metrics-certs\") pod \"network-metrics-daemon-rfmz4\" (UID: \"1125d082-9200-4b6f-b03b-1edd11069009\") " pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:09:40.834898 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:40.834834 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:40.834898 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:40.834858 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:40.835066 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:40.834995 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1125d082-9200-4b6f-b03b-1edd11069009-metrics-certs podName:1125d082-9200-4b6f-b03b-1edd11069009 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:12.834884649 +0000 UTC m=+66.217722058 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1125d082-9200-4b6f-b03b-1edd11069009-metrics-certs") pod "network-metrics-daemon-rfmz4" (UID: "1125d082-9200-4b6f-b03b-1edd11069009") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:09:40.835066 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:40.835037 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8358392b-ad0d-457c-844a-85a1b754a49e-original-pull-secret podName:8358392b-ad0d-457c-844a-85a1b754a49e nodeName:}" failed. No retries permitted until 2026-07-07 14:10:12.835024227 +0000 UTC m=+66.217861644 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8358392b-ad0d-457c-844a-85a1b754a49e-original-pull-secret") pod "global-pull-secret-syncer-s5cfz" (UID: "8358392b-ad0d-457c-844a-85a1b754a49e") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:09:40.935442 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:40.935404 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dps2\" (UniqueName: \"kubernetes.io/projected/a6bce278-b340-4280-882f-2337ec23b28e-kube-api-access-7dps2\") pod \"network-check-target-xzfg2\" (UID: \"a6bce278-b340-4280-882f-2337ec23b28e\") " pod="openshift-network-diagnostics/network-check-target-xzfg2" Jul 07 14:09:40.935642 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:40.935591 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:09:40.935642 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:40.935618 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:09:40.935642 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:40.935628 2557 projected.go:196] Error preparing data for projected volume kube-api-access-7dps2 for pod openshift-network-diagnostics/network-check-target-xzfg2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:40.935807 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:40.935684 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6bce278-b340-4280-882f-2337ec23b28e-kube-api-access-7dps2 podName:a6bce278-b340-4280-882f-2337ec23b28e nodeName:}" failed. No retries permitted until 2026-07-07 14:10:12.935665439 +0000 UTC m=+66.318502851 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7dps2" (UniqueName: "kubernetes.io/projected/a6bce278-b340-4280-882f-2337ec23b28e-kube-api-access-7dps2") pod "network-check-target-xzfg2" (UID: "a6bce278-b340-4280-882f-2337ec23b28e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:09:41.095371 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:41.095277 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:09:41.095371 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:41.095316 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzfg2" Jul 07 14:09:41.095614 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:41.095423 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-s5cfz" podUID="8358392b-ad0d-457c-844a-85a1b754a49e" Jul 07 14:09:41.095614 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:41.095479 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xzfg2" podUID="a6bce278-b340-4280-882f-2337ec23b28e" Jul 07 14:09:41.095614 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:41.095578 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:09:41.095738 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:41.095668 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rfmz4" podUID="1125d082-9200-4b6f-b03b-1edd11069009" Jul 07 14:09:41.932397 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:41.932365 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-152.ec2.internal" event="NodeReady" Jul 07 14:09:41.932954 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:41.932558 2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 14:09:41.969894 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:41.969858 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d84d45866-prl9z"] Jul 07 14:09:41.979015 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:41.978989 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-rxpf2"] Jul 07 14:09:41.979183 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:41.979129 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:09:41.981580 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:41.981559 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 14:09:41.981754 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:41.981559 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 14:09:41.981895 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:41.981559 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6rbz7\"" Jul 07 14:09:41.982317 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:41.982296 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 14:09:41.990407 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:41.988434 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-bshp7"] Jul 07 14:09:41.993184 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:41.990377 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 14:09:41.993184 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:41.990463 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rxpf2" Jul 07 14:09:41.993489 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:41.993470 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-xjplb\"" Jul 07 14:09:41.993715 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:41.993700 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 07 14:09:41.995134 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:41.993877 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 07 14:09:42.001548 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.001496 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d84d45866-prl9z"] Jul 07 14:09:42.001619 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.001571 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-rxpf2"] Jul 07 14:09:42.001619 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.001594 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xvg2g"] Jul 07 14:09:42.001619 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.001604 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-bshp7" Jul 07 14:09:42.004221 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.004197 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-pbxc6\"" Jul 07 14:09:42.004533 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.004493 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 14:09:42.004736 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.004494 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 14:09:42.011833 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.011815 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-m5g66"] Jul 07 14:09:42.013542 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.012460 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xvg2g" Jul 07 14:09:42.017664 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.017638 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ppbqm\"" Jul 07 14:09:42.017895 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.017880 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 14:09:42.018058 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.018045 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 14:09:42.018210 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.018197 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 14:09:42.021757 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.021736 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xvg2g"] Jul 07 14:09:42.021888 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.021876 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-bshp7"] Jul 07 14:09:42.021960 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.021909 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m5g66"] Jul 07 14:09:42.022040 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.022021 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m5g66" Jul 07 14:09:42.024648 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.024630 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 14:09:42.024920 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.024906 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 14:09:42.025016 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.024998 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2225x\"" Jul 07 14:09:42.144121 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.144088 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6ebe9a1d-a632-4029-a154-663edb83c930-image-registry-private-configuration\") pod \"image-registry-5d84d45866-prl9z\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:09:42.144121 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.144131 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr7g2\" (UniqueName: \"kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-kube-api-access-pr7g2\") pod \"image-registry-5d84d45866-prl9z\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:09:42.144354 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.144173 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6ebe9a1d-a632-4029-a154-663edb83c930-registry-certificates\") pod \"image-registry-5d84d45866-prl9z\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:09:42.144354 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.144222 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-bound-sa-token\") pod \"image-registry-5d84d45866-prl9z\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:09:42.144354 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.144320 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6ebe9a1d-a632-4029-a154-663edb83c930-ca-trust-extracted\") pod \"image-registry-5d84d45866-prl9z\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:09:42.144566 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.144373 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6ebe9a1d-a632-4029-a154-663edb83c930-trusted-ca\") pod \"image-registry-5d84d45866-prl9z\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:09:42.144566 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.144397 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhj5f\" (UniqueName: \"kubernetes.io/projected/4139e191-c46c-4737-ac93-784c0df05814-kube-api-access-fhj5f\") pod \"dns-default-m5g66\" (UID: \"4139e191-c46c-4737-ac93-784c0df05814\") " pod="openshift-dns/dns-default-m5g66" Jul 07 14:09:42.144566 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.144438 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-registry-tls\") pod \"image-registry-5d84d45866-prl9z\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:09:42.144566 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.144464 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/61c55aec-8d5a-486f-8e6d-2ed748969b6e-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-rxpf2\" (UID: \"61c55aec-8d5a-486f-8e6d-2ed748969b6e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rxpf2" Jul 07 14:09:42.144566 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.144522 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p82w\" (UniqueName: \"kubernetes.io/projected/dd2613e2-dd7c-4b3d-88e2-464f50199e05-kube-api-access-4p82w\") pod \"network-check-source-989f8b8dc-bshp7\" (UID: \"dd2613e2-dd7c-4b3d-88e2-464f50199e05\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-bshp7" Jul 07 14:09:42.144566 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.144547 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4139e191-c46c-4737-ac93-784c0df05814-metrics-tls\") pod \"dns-default-m5g66\" (UID: \"4139e191-c46c-4737-ac93-784c0df05814\") " pod="openshift-dns/dns-default-m5g66" Jul 07 14:09:42.144566 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.144565 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4139e191-c46c-4737-ac93-784c0df05814-tmp-dir\") pod \"dns-default-m5g66\" (UID: \"4139e191-c46c-4737-ac93-784c0df05814\") " pod="openshift-dns/dns-default-m5g66" Jul 07 14:09:42.144846 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.144610 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6ebe9a1d-a632-4029-a154-663edb83c930-installation-pull-secrets\") pod \"image-registry-5d84d45866-prl9z\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:09:42.144846 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.144635 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63809651-c64b-4da4-bbee-b46f25e99eef-cert\") pod \"ingress-canary-xvg2g\" (UID: \"63809651-c64b-4da4-bbee-b46f25e99eef\") " pod="openshift-ingress-canary/ingress-canary-xvg2g" Jul 07 14:09:42.144846 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.144705 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61c55aec-8d5a-486f-8e6d-2ed748969b6e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rxpf2\" (UID: \"61c55aec-8d5a-486f-8e6d-2ed748969b6e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rxpf2" Jul 07 14:09:42.144846 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.144736 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4139e191-c46c-4737-ac93-784c0df05814-config-volume\") pod \"dns-default-m5g66\" (UID: \"4139e191-c46c-4737-ac93-784c0df05814\") " pod="openshift-dns/dns-default-m5g66" Jul 07 14:09:42.144846 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.144774 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jhfb\" (UniqueName: \"kubernetes.io/projected/63809651-c64b-4da4-bbee-b46f25e99eef-kube-api-access-8jhfb\") pod \"ingress-canary-xvg2g\" (UID: \"63809651-c64b-4da4-bbee-b46f25e99eef\") " pod="openshift-ingress-canary/ingress-canary-xvg2g" Jul 07 14:09:42.245491 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.245454 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6ebe9a1d-a632-4029-a154-663edb83c930-trusted-ca\") pod \"image-registry-5d84d45866-prl9z\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:09:42.245682 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.245520 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhj5f\" (UniqueName: \"kubernetes.io/projected/4139e191-c46c-4737-ac93-784c0df05814-kube-api-access-fhj5f\") pod \"dns-default-m5g66\" (UID: \"4139e191-c46c-4737-ac93-784c0df05814\") " pod="openshift-dns/dns-default-m5g66" Jul 07 14:09:42.245682 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.245556 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-registry-tls\") pod \"image-registry-5d84d45866-prl9z\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:09:42.245682 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.245579 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/61c55aec-8d5a-486f-8e6d-2ed748969b6e-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-rxpf2\" (UID: \"61c55aec-8d5a-486f-8e6d-2ed748969b6e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rxpf2" Jul 07 14:09:42.245682 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.245609 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p82w\" (UniqueName: \"kubernetes.io/projected/dd2613e2-dd7c-4b3d-88e2-464f50199e05-kube-api-access-4p82w\") pod \"network-check-source-989f8b8dc-bshp7\" (UID: \"dd2613e2-dd7c-4b3d-88e2-464f50199e05\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-bshp7" Jul 07 14:09:42.245873 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:42.245819 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:09:42.245873 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:42.245837 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d84d45866-prl9z: secret "image-registry-tls" not found Jul 07 14:09:42.245973 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:42.245907 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-registry-tls podName:6ebe9a1d-a632-4029-a154-663edb83c930 nodeName:}" failed. No retries permitted until 2026-07-07 14:09:42.745885978 +0000 UTC m=+36.128723388 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-registry-tls") pod "image-registry-5d84d45866-prl9z" (UID: "6ebe9a1d-a632-4029-a154-663edb83c930") : secret "image-registry-tls" not found Jul 07 14:09:42.246069 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.246043 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4139e191-c46c-4737-ac93-784c0df05814-metrics-tls\") pod \"dns-default-m5g66\" (UID: \"4139e191-c46c-4737-ac93-784c0df05814\") " pod="openshift-dns/dns-default-m5g66" Jul 07 14:09:42.246200 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.246092 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4139e191-c46c-4737-ac93-784c0df05814-tmp-dir\") pod \"dns-default-m5g66\" (UID: \"4139e191-c46c-4737-ac93-784c0df05814\") " pod="openshift-dns/dns-default-m5g66" Jul 07 14:09:42.246200 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.246126 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6ebe9a1d-a632-4029-a154-663edb83c930-installation-pull-secrets\") pod \"image-registry-5d84d45866-prl9z\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:09:42.246200 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.246152 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63809651-c64b-4da4-bbee-b46f25e99eef-cert\") pod \"ingress-canary-xvg2g\" (UID: \"63809651-c64b-4da4-bbee-b46f25e99eef\") " pod="openshift-ingress-canary/ingress-canary-xvg2g" Jul 07 14:09:42.246200 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:42.246160 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:09:42.246408 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.246213 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61c55aec-8d5a-486f-8e6d-2ed748969b6e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rxpf2\" (UID: \"61c55aec-8d5a-486f-8e6d-2ed748969b6e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rxpf2" Jul 07 14:09:42.246408 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:42.246226 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4139e191-c46c-4737-ac93-784c0df05814-metrics-tls podName:4139e191-c46c-4737-ac93-784c0df05814 nodeName:}" failed. No retries permitted until 2026-07-07 14:09:42.746209337 +0000 UTC m=+36.129046747 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4139e191-c46c-4737-ac93-784c0df05814-metrics-tls") pod "dns-default-m5g66" (UID: "4139e191-c46c-4737-ac93-784c0df05814") : secret "dns-default-metrics-tls" not found Jul 07 14:09:42.246408 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.246261 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4139e191-c46c-4737-ac93-784c0df05814-config-volume\") pod \"dns-default-m5g66\" (UID: \"4139e191-c46c-4737-ac93-784c0df05814\") " pod="openshift-dns/dns-default-m5g66" Jul 07 14:09:42.246408 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:42.246288 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 14:09:42.246408 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.246306 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jhfb\" (UniqueName: \"kubernetes.io/projected/63809651-c64b-4da4-bbee-b46f25e99eef-kube-api-access-8jhfb\") pod \"ingress-canary-xvg2g\" (UID: \"63809651-c64b-4da4-bbee-b46f25e99eef\") " pod="openshift-ingress-canary/ingress-canary-xvg2g" Jul 07 14:09:42.246408 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:42.246331 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61c55aec-8d5a-486f-8e6d-2ed748969b6e-networking-console-plugin-cert podName:61c55aec-8d5a-486f-8e6d-2ed748969b6e nodeName:}" failed. No retries permitted until 2026-07-07 14:09:42.746316798 +0000 UTC m=+36.129154210 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/61c55aec-8d5a-486f-8e6d-2ed748969b6e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-rxpf2" (UID: "61c55aec-8d5a-486f-8e6d-2ed748969b6e") : secret "networking-console-plugin-cert" not found Jul 07 14:09:42.246408 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.246363 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6ebe9a1d-a632-4029-a154-663edb83c930-image-registry-private-configuration\") pod \"image-registry-5d84d45866-prl9z\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:09:42.246408 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.246383 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/61c55aec-8d5a-486f-8e6d-2ed748969b6e-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-rxpf2\" (UID: \"61c55aec-8d5a-486f-8e6d-2ed748969b6e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rxpf2" Jul 07 14:09:42.246408 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.246394 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4139e191-c46c-4737-ac93-784c0df05814-tmp-dir\") pod \"dns-default-m5g66\" (UID: \"4139e191-c46c-4737-ac93-784c0df05814\") " pod="openshift-dns/dns-default-m5g66" Jul 07 14:09:42.246862 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.246527 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6ebe9a1d-a632-4029-a154-663edb83c930-trusted-ca\") pod \"image-registry-5d84d45866-prl9z\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:09:42.246862 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.246403 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr7g2\" (UniqueName: \"kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-kube-api-access-pr7g2\") pod \"image-registry-5d84d45866-prl9z\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:09:42.246862 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.246604 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6ebe9a1d-a632-4029-a154-663edb83c930-registry-certificates\") pod \"image-registry-5d84d45866-prl9z\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:09:42.246862 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.246630 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-bound-sa-token\") pod \"image-registry-5d84d45866-prl9z\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:09:42.246862 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.246671 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6ebe9a1d-a632-4029-a154-663edb83c930-ca-trust-extracted\") pod \"image-registry-5d84d45866-prl9z\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:09:42.247102 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.246990 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6ebe9a1d-a632-4029-a154-663edb83c930-ca-trust-extracted\") pod \"image-registry-5d84d45866-prl9z\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:09:42.247102 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.247005 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4139e191-c46c-4737-ac93-784c0df05814-config-volume\") pod \"dns-default-m5g66\" (UID: \"4139e191-c46c-4737-ac93-784c0df05814\") " pod="openshift-dns/dns-default-m5g66" Jul 07 14:09:42.247198 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.247153 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6ebe9a1d-a632-4029-a154-663edb83c930-registry-certificates\") pod \"image-registry-5d84d45866-prl9z\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:09:42.251083 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.251060 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6ebe9a1d-a632-4029-a154-663edb83c930-installation-pull-secrets\") pod \"image-registry-5d84d45866-prl9z\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:09:42.251187 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.251124 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/63809651-c64b-4da4-bbee-b46f25e99eef-cert\") pod \"ingress-canary-xvg2g\" (UID: \"63809651-c64b-4da4-bbee-b46f25e99eef\") " pod="openshift-ingress-canary/ingress-canary-xvg2g" Jul 07 14:09:42.252977 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.252921 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6ebe9a1d-a632-4029-a154-663edb83c930-image-registry-private-configuration\") pod \"image-registry-5d84d45866-prl9z\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:09:42.260338 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.260312 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhj5f\" (UniqueName: \"kubernetes.io/projected/4139e191-c46c-4737-ac93-784c0df05814-kube-api-access-fhj5f\") pod \"dns-default-m5g66\" (UID: \"4139e191-c46c-4737-ac93-784c0df05814\") " pod="openshift-dns/dns-default-m5g66" Jul 07 14:09:42.262460 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.262428 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p82w\" (UniqueName: \"kubernetes.io/projected/dd2613e2-dd7c-4b3d-88e2-464f50199e05-kube-api-access-4p82w\") pod \"network-check-source-989f8b8dc-bshp7\" (UID: \"dd2613e2-dd7c-4b3d-88e2-464f50199e05\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-bshp7" Jul 07 14:09:42.262655 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.262628 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr7g2\" (UniqueName: \"kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-kube-api-access-pr7g2\") pod \"image-registry-5d84d45866-prl9z\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:09:42.262911 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.262884 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-bound-sa-token\") pod \"image-registry-5d84d45866-prl9z\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:09:42.263083 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.263065 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jhfb\" (UniqueName: \"kubernetes.io/projected/63809651-c64b-4da4-bbee-b46f25e99eef-kube-api-access-8jhfb\") pod \"ingress-canary-xvg2g\" (UID: \"63809651-c64b-4da4-bbee-b46f25e99eef\") " pod="openshift-ingress-canary/ingress-canary-xvg2g" Jul 07 14:09:42.315694 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.315662 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-bshp7" Jul 07 14:09:42.326072 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.326020 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xvg2g" Jul 07 14:09:42.512150 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.511262 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-bshp7"] Jul 07 14:09:42.514635 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.514614 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xvg2g"] Jul 07 14:09:42.517175 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:42.517142 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd2613e2_dd7c_4b3d_88e2_464f50199e05.slice/crio-0c41460bf0e42ee5a30e22f290e45c7c1ee91d7ceed89bca7601615fdd235a9e WatchSource:0}: Error finding container 0c41460bf0e42ee5a30e22f290e45c7c1ee91d7ceed89bca7601615fdd235a9e: Status 404 returned error can't find the container with id 0c41460bf0e42ee5a30e22f290e45c7c1ee91d7ceed89bca7601615fdd235a9e Jul 07 14:09:42.517700 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:09:42.517670 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63809651_c64b_4da4_bbee_b46f25e99eef.slice/crio-e50b69b5b3a4c164724cc5be4a29661e1915632c2bde40920f16530e57aef141 WatchSource:0}: Error finding container e50b69b5b3a4c164724cc5be4a29661e1915632c2bde40920f16530e57aef141: Status 404 returned error can't find the container with id e50b69b5b3a4c164724cc5be4a29661e1915632c2bde40920f16530e57aef141 Jul 07 14:09:42.754751 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.754687 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-registry-tls\") pod \"image-registry-5d84d45866-prl9z\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:09:42.754903 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.754768 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4139e191-c46c-4737-ac93-784c0df05814-metrics-tls\") pod \"dns-default-m5g66\" (UID: \"4139e191-c46c-4737-ac93-784c0df05814\") " pod="openshift-dns/dns-default-m5g66" Jul 07 14:09:42.754903 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:42.754808 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61c55aec-8d5a-486f-8e6d-2ed748969b6e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rxpf2\" (UID: \"61c55aec-8d5a-486f-8e6d-2ed748969b6e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rxpf2" Jul 07 14:09:42.755071 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:42.755038 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 14:09:42.755183 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:42.755108 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:09:42.755183 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:42.755127 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d84d45866-prl9z: secret "image-registry-tls" not found Jul 07 14:09:42.755183 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:42.755145 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61c55aec-8d5a-486f-8e6d-2ed748969b6e-networking-console-plugin-cert podName:61c55aec-8d5a-486f-8e6d-2ed748969b6e nodeName:}" failed. No retries permitted until 2026-07-07 14:09:43.755125278 +0000 UTC m=+37.137962701 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/61c55aec-8d5a-486f-8e6d-2ed748969b6e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-rxpf2" (UID: "61c55aec-8d5a-486f-8e6d-2ed748969b6e") : secret "networking-console-plugin-cert" not found Jul 07 14:09:42.755183 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:42.755176 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-registry-tls podName:6ebe9a1d-a632-4029-a154-663edb83c930 nodeName:}" failed. No retries permitted until 2026-07-07 14:09:43.755163624 +0000 UTC m=+37.138001032 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-registry-tls") pod "image-registry-5d84d45866-prl9z" (UID: "6ebe9a1d-a632-4029-a154-663edb83c930") : secret "image-registry-tls" not found Jul 07 14:09:42.755361 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:42.755108 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:09:42.755361 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:42.755243 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4139e191-c46c-4737-ac93-784c0df05814-metrics-tls podName:4139e191-c46c-4737-ac93-784c0df05814 nodeName:}" failed. No retries permitted until 2026-07-07 14:09:43.75522286 +0000 UTC m=+37.138060269 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4139e191-c46c-4737-ac93-784c0df05814-metrics-tls") pod "dns-default-m5g66" (UID: "4139e191-c46c-4737-ac93-784c0df05814") : secret "dns-default-metrics-tls" not found Jul 07 14:09:43.099710 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:43.099678 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzfg2" Jul 07 14:09:43.100282 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:43.099774 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:09:43.100282 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:43.099813 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:09:43.103262 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:43.103242 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 14:09:43.103262 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:43.103252 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x2hv7\"" Jul 07 14:09:43.103454 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:43.103252 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 14:09:43.103454 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:43.103245 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lp7v4\"" Jul 07 14:09:43.242022 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:43.241979 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-bshp7" event={"ID":"dd2613e2-dd7c-4b3d-88e2-464f50199e05","Type":"ContainerStarted","Data":"0c41460bf0e42ee5a30e22f290e45c7c1ee91d7ceed89bca7601615fdd235a9e"} Jul 07 14:09:43.243657 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:43.243624 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xvg2g" event={"ID":"63809651-c64b-4da4-bbee-b46f25e99eef","Type":"ContainerStarted","Data":"e50b69b5b3a4c164724cc5be4a29661e1915632c2bde40920f16530e57aef141"} Jul 07 14:09:43.763767 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:43.763718 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-registry-tls\") pod \"image-registry-5d84d45866-prl9z\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:09:43.763767 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:43.763773 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4139e191-c46c-4737-ac93-784c0df05814-metrics-tls\") pod \"dns-default-m5g66\" (UID: \"4139e191-c46c-4737-ac93-784c0df05814\") " pod="openshift-dns/dns-default-m5g66" Jul 07 14:09:43.763996 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:43.763814 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61c55aec-8d5a-486f-8e6d-2ed748969b6e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rxpf2\" (UID: \"61c55aec-8d5a-486f-8e6d-2ed748969b6e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rxpf2" Jul 07 14:09:43.763996 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:43.763893 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:09:43.763996 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:43.763918 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d84d45866-prl9z: secret "image-registry-tls" not found Jul 07 14:09:43.763996 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:43.763936 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:09:43.763996 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:43.763936 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 14:09:43.763996 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:43.763990 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-registry-tls podName:6ebe9a1d-a632-4029-a154-663edb83c930 nodeName:}" failed. No retries permitted until 2026-07-07 14:09:45.763965031 +0000 UTC m=+39.146802462 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-registry-tls") pod "image-registry-5d84d45866-prl9z" (UID: "6ebe9a1d-a632-4029-a154-663edb83c930") : secret "image-registry-tls" not found Jul 07 14:09:43.764216 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:43.764014 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4139e191-c46c-4737-ac93-784c0df05814-metrics-tls podName:4139e191-c46c-4737-ac93-784c0df05814 nodeName:}" failed. No retries permitted until 2026-07-07 14:09:45.764002621 +0000 UTC m=+39.146840039 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4139e191-c46c-4737-ac93-784c0df05814-metrics-tls") pod "dns-default-m5g66" (UID: "4139e191-c46c-4737-ac93-784c0df05814") : secret "dns-default-metrics-tls" not found Jul 07 14:09:43.764216 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:43.764027 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61c55aec-8d5a-486f-8e6d-2ed748969b6e-networking-console-plugin-cert podName:61c55aec-8d5a-486f-8e6d-2ed748969b6e nodeName:}" failed. No retries permitted until 2026-07-07 14:09:45.76402173 +0000 UTC m=+39.146859137 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/61c55aec-8d5a-486f-8e6d-2ed748969b6e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-rxpf2" (UID: "61c55aec-8d5a-486f-8e6d-2ed748969b6e") : secret "networking-console-plugin-cert" not found Jul 07 14:09:45.252689 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:45.252606 2557 generic.go:356] "Generic (PLEG): container finished" podID="1093ee1a-7fa2-4027-860e-75334e677b42" containerID="25503710b71b189d76df9d44ac009a74f6bf5bb9f1c659cc600705f00388e29e" exitCode=0 Jul 07 14:09:45.252689 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:45.252651 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t88rg" event={"ID":"1093ee1a-7fa2-4027-860e-75334e677b42","Type":"ContainerDied","Data":"25503710b71b189d76df9d44ac009a74f6bf5bb9f1c659cc600705f00388e29e"} Jul 07 14:09:45.788182 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:45.788137 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-registry-tls\") pod \"image-registry-5d84d45866-prl9z\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:09:45.788365 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:45.788192 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4139e191-c46c-4737-ac93-784c0df05814-metrics-tls\") pod \"dns-default-m5g66\" (UID: \"4139e191-c46c-4737-ac93-784c0df05814\") " pod="openshift-dns/dns-default-m5g66" Jul 07 14:09:45.788365 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:45.788301 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:09:45.788365 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:45.788315 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:09:45.788365 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:45.788337 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d84d45866-prl9z: secret "image-registry-tls" not found Jul 07 14:09:45.788606 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:45.788390 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61c55aec-8d5a-486f-8e6d-2ed748969b6e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rxpf2\" (UID: \"61c55aec-8d5a-486f-8e6d-2ed748969b6e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rxpf2" Jul 07 14:09:45.788606 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:45.788403 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4139e191-c46c-4737-ac93-784c0df05814-metrics-tls podName:4139e191-c46c-4737-ac93-784c0df05814 nodeName:}" failed. No retries permitted until 2026-07-07 14:09:49.788383228 +0000 UTC m=+43.171220638 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4139e191-c46c-4737-ac93-784c0df05814-metrics-tls") pod "dns-default-m5g66" (UID: "4139e191-c46c-4737-ac93-784c0df05814") : secret "dns-default-metrics-tls" not found Jul 07 14:09:45.788606 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:45.788454 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-registry-tls podName:6ebe9a1d-a632-4029-a154-663edb83c930 nodeName:}" failed. No retries permitted until 2026-07-07 14:09:49.788434745 +0000 UTC m=+43.171272163 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-registry-tls") pod "image-registry-5d84d45866-prl9z" (UID: "6ebe9a1d-a632-4029-a154-663edb83c930") : secret "image-registry-tls" not found Jul 07 14:09:45.788606 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:45.788458 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 14:09:45.788606 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:45.788524 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61c55aec-8d5a-486f-8e6d-2ed748969b6e-networking-console-plugin-cert podName:61c55aec-8d5a-486f-8e6d-2ed748969b6e nodeName:}" failed. No retries permitted until 2026-07-07 14:09:49.788488677 +0000 UTC m=+43.171326107 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/61c55aec-8d5a-486f-8e6d-2ed748969b6e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-rxpf2" (UID: "61c55aec-8d5a-486f-8e6d-2ed748969b6e") : secret "networking-console-plugin-cert" not found Jul 07 14:09:46.260153 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:46.260116 2557 generic.go:356] "Generic (PLEG): container finished" podID="1093ee1a-7fa2-4027-860e-75334e677b42" containerID="61f4aefc10381c5912faaba786c9c0414fc491f24a2bb3857f22d9d790adf6ac" exitCode=0 Jul 07 14:09:46.260682 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:46.260176 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t88rg" event={"ID":"1093ee1a-7fa2-4027-860e-75334e677b42","Type":"ContainerDied","Data":"61f4aefc10381c5912faaba786c9c0414fc491f24a2bb3857f22d9d790adf6ac"} Jul 07 14:09:46.861150 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:46.861122 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:09:46.986392 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:46.986311 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:09:47.266873 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:47.266833 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-t88rg" event={"ID":"1093ee1a-7fa2-4027-860e-75334e677b42","Type":"ContainerStarted","Data":"d7b0f73afbc731afdbf20197e8c705fa1a7ad2b051de44d4b980c536dd676019"} Jul 07 14:09:47.301310 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:47.301174 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-t88rg" podStartSLOduration=7.13022385 podStartE2EDuration="40.301153648s" totalImagesPullingTime="33.170929798s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:09:47.299722984 +0000 UTC m=+40.682560429" watchObservedRunningTime="2026-07-07 14:09:47.301153648 +0000 UTC m=+40.683991079" Jul 07 14:09:47.617134 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:47.617044 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:09:48.118544 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:48.118520 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:09:48.270893 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:48.270849 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-bshp7" event={"ID":"dd2613e2-dd7c-4b3d-88e2-464f50199e05","Type":"ContainerStarted","Data":"48daefb613411591e5f14ecbd5d54f296ce14314388024e8675344e12716deb5"} Jul 07 14:09:48.272483 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:48.272458 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xvg2g" event={"ID":"63809651-c64b-4da4-bbee-b46f25e99eef","Type":"ContainerStarted","Data":"533bad1c36b138724582fadb76417b8790f725c145856ca5f738f9601be4915f"} Jul 07 14:09:48.290884 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:48.290823 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-bshp7" podStartSLOduration=37.035775161 podStartE2EDuration="42.290801543s" totalImagesPullingTime="5.255026382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:09:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:09:48.289362238 +0000 UTC m=+41.672199667" watchObservedRunningTime="2026-07-07 14:09:48.290801543 +0000 UTC m=+41.673638974" Jul 07 14:09:48.313538 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:48.313475 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xvg2g" podStartSLOduration=1.7334048850000001 podStartE2EDuration="7.313457756s" totalImagesPullingTime="5.580052871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:09:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:09:48.312131793 +0000 UTC m=+41.694969233" watchObservedRunningTime="2026-07-07 14:09:48.313457756 +0000 UTC m=+41.696295185" Jul 07 14:09:48.560425 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:48.560390 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:09:48.661179 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:48.661142 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:09:48.864886 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:48.864804 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:09:48.938345 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:48.938313 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:09:49.529577 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:49.529544 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:09:49.823098 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:49.823014 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61c55aec-8d5a-486f-8e6d-2ed748969b6e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rxpf2\" (UID: \"61c55aec-8d5a-486f-8e6d-2ed748969b6e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rxpf2" Jul 07 14:09:49.823238 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:49.823120 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-registry-tls\") pod \"image-registry-5d84d45866-prl9z\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:09:49.823238 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:49.823156 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4139e191-c46c-4737-ac93-784c0df05814-metrics-tls\") pod \"dns-default-m5g66\" (UID: \"4139e191-c46c-4737-ac93-784c0df05814\") " pod="openshift-dns/dns-default-m5g66" Jul 07 14:09:49.823238 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:49.823176 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 14:09:49.823336 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:49.823242 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61c55aec-8d5a-486f-8e6d-2ed748969b6e-networking-console-plugin-cert podName:61c55aec-8d5a-486f-8e6d-2ed748969b6e nodeName:}" failed. No retries permitted until 2026-07-07 14:09:57.823221963 +0000 UTC m=+51.206059385 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/61c55aec-8d5a-486f-8e6d-2ed748969b6e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-rxpf2" (UID: "61c55aec-8d5a-486f-8e6d-2ed748969b6e") : secret "networking-console-plugin-cert" not found Jul 07 14:09:49.823336 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:49.823262 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:09:49.823336 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:49.823271 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:09:49.823336 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:49.823281 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d84d45866-prl9z: secret "image-registry-tls" not found Jul 07 14:09:49.823336 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:49.823319 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4139e191-c46c-4737-ac93-784c0df05814-metrics-tls podName:4139e191-c46c-4737-ac93-784c0df05814 nodeName:}" failed. No retries permitted until 2026-07-07 14:09:57.823307809 +0000 UTC m=+51.206145230 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4139e191-c46c-4737-ac93-784c0df05814-metrics-tls") pod "dns-default-m5g66" (UID: "4139e191-c46c-4737-ac93-784c0df05814") : secret "dns-default-metrics-tls" not found Jul 07 14:09:49.823336 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:49.823335 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-registry-tls podName:6ebe9a1d-a632-4029-a154-663edb83c930 nodeName:}" failed. No retries permitted until 2026-07-07 14:09:57.823326512 +0000 UTC m=+51.206163921 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-registry-tls") pod "image-registry-5d84d45866-prl9z" (UID: "6ebe9a1d-a632-4029-a154-663edb83c930") : secret "image-registry-tls" not found Jul 07 14:09:49.843905 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:49.843871 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:09:50.483271 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:50.483238 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:09:57.885888 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:57.885853 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-registry-tls\") pod \"image-registry-5d84d45866-prl9z\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:09:57.885888 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:57.885894 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4139e191-c46c-4737-ac93-784c0df05814-metrics-tls\") pod \"dns-default-m5g66\" (UID: \"4139e191-c46c-4737-ac93-784c0df05814\") " pod="openshift-dns/dns-default-m5g66" Jul 07 14:09:57.886379 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:09:57.885927 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61c55aec-8d5a-486f-8e6d-2ed748969b6e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rxpf2\" (UID: \"61c55aec-8d5a-486f-8e6d-2ed748969b6e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rxpf2" Jul 07 14:09:57.886379 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:57.885985 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:09:57.886379 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:57.886004 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d84d45866-prl9z: secret "image-registry-tls" not found Jul 07 14:09:57.886379 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:57.886032 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 14:09:57.886379 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:57.886055 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-registry-tls podName:6ebe9a1d-a632-4029-a154-663edb83c930 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:13.886039832 +0000 UTC m=+67.268877271 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-registry-tls") pod "image-registry-5d84d45866-prl9z" (UID: "6ebe9a1d-a632-4029-a154-663edb83c930") : secret "image-registry-tls" not found Jul 07 14:09:57.886379 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:57.886080 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61c55aec-8d5a-486f-8e6d-2ed748969b6e-networking-console-plugin-cert podName:61c55aec-8d5a-486f-8e6d-2ed748969b6e nodeName:}" failed. No retries permitted until 2026-07-07 14:10:13.886069668 +0000 UTC m=+67.268907075 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/61c55aec-8d5a-486f-8e6d-2ed748969b6e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-rxpf2" (UID: "61c55aec-8d5a-486f-8e6d-2ed748969b6e") : secret "networking-console-plugin-cert" not found Jul 07 14:09:57.886379 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:57.886087 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:09:57.886379 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:09:57.886159 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4139e191-c46c-4737-ac93-784c0df05814-metrics-tls podName:4139e191-c46c-4737-ac93-784c0df05814 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:13.886142233 +0000 UTC m=+67.268979642 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4139e191-c46c-4737-ac93-784c0df05814-metrics-tls") pod "dns-default-m5g66" (UID: "4139e191-c46c-4737-ac93-784c0df05814") : secret "dns-default-metrics-tls" not found Jul 07 14:10:09.236179 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:09.236145 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v7sfl" Jul 07 14:10:09.399830 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:09.399796 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:09.467797 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:09.467761 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:10.822308 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:10.822271 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:10.883787 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:10.883750 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:11.541629 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:11.541597 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:11.644177 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:11.644150 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:12.464286 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:12.464249 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:12.906569 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:12.906456 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8358392b-ad0d-457c-844a-85a1b754a49e-original-pull-secret\") pod \"global-pull-secret-syncer-s5cfz\" (UID: \"8358392b-ad0d-457c-844a-85a1b754a49e\") " pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:10:12.906569 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:12.906542 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1125d082-9200-4b6f-b03b-1edd11069009-metrics-certs\") pod \"network-metrics-daemon-rfmz4\" (UID: \"1125d082-9200-4b6f-b03b-1edd11069009\") " pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:10:12.909217 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:12.909199 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 14:10:12.909278 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:12.909209 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 14:10:12.917313 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:10:12.917283 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 07 14:10:12.917406 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:10:12.917380 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1125d082-9200-4b6f-b03b-1edd11069009-metrics-certs podName:1125d082-9200-4b6f-b03b-1edd11069009 nodeName:}" failed. No retries permitted until 2026-07-07 14:11:16.917355675 +0000 UTC m=+130.300193103 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1125d082-9200-4b6f-b03b-1edd11069009-metrics-certs") pod "network-metrics-daemon-rfmz4" (UID: "1125d082-9200-4b6f-b03b-1edd11069009") : secret "metrics-daemon-secret" not found Jul 07 14:10:12.920778 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:12.920748 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8358392b-ad0d-457c-844a-85a1b754a49e-original-pull-secret\") pod \"global-pull-secret-syncer-s5cfz\" (UID: \"8358392b-ad0d-457c-844a-85a1b754a49e\") " pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:10:13.006925 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:13.006873 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dps2\" (UniqueName: \"kubernetes.io/projected/a6bce278-b340-4280-882f-2337ec23b28e-kube-api-access-7dps2\") pod \"network-check-target-xzfg2\" (UID: \"a6bce278-b340-4280-882f-2337ec23b28e\") " pod="openshift-network-diagnostics/network-check-target-xzfg2" Jul 07 14:10:13.009542 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:13.009523 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dps2\" (UniqueName: \"kubernetes.io/projected/a6bce278-b340-4280-882f-2337ec23b28e-kube-api-access-7dps2\") pod \"network-check-target-xzfg2\" (UID: \"a6bce278-b340-4280-882f-2337ec23b28e\") " pod="openshift-network-diagnostics/network-check-target-xzfg2" Jul 07 14:10:13.113554 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:13.113496 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lp7v4\"" Jul 07 14:10:13.118812 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:13.118790 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-s5cfz" Jul 07 14:10:13.121063 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:13.121035 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xzfg2" Jul 07 14:10:13.259400 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:13.259363 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xzfg2"] Jul 07 14:10:13.265425 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:10:13.265401 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6bce278_b340_4280_882f_2337ec23b28e.slice/crio-228eef5567cf699acc027feb4531b8749412077305df57688f55ea718fa71c5f WatchSource:0}: Error finding container 228eef5567cf699acc027feb4531b8749412077305df57688f55ea718fa71c5f: Status 404 returned error can't find the container with id 228eef5567cf699acc027feb4531b8749412077305df57688f55ea718fa71c5f Jul 07 14:10:13.274089 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:13.274065 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-s5cfz"] Jul 07 14:10:13.277865 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:10:13.277840 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8358392b_ad0d_457c_844a_85a1b754a49e.slice/crio-981a2b41c81ce59e35beb39aa717287429b5f11eb4a3b172f024de57427f06e2 WatchSource:0}: Error finding container 981a2b41c81ce59e35beb39aa717287429b5f11eb4a3b172f024de57427f06e2: Status 404 returned error can't find the container with id 981a2b41c81ce59e35beb39aa717287429b5f11eb4a3b172f024de57427f06e2 Jul 07 14:10:13.334244 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:13.334212 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xzfg2" event={"ID":"a6bce278-b340-4280-882f-2337ec23b28e","Type":"ContainerStarted","Data":"9cbfaf987bb75478da60fa111ba2872b89160a5d5b270431a72fb2298645a97c"} Jul 07 14:10:13.334413 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:13.334265 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xzfg2" event={"ID":"a6bce278-b340-4280-882f-2337ec23b28e","Type":"ContainerStarted","Data":"228eef5567cf699acc027feb4531b8749412077305df57688f55ea718fa71c5f"} Jul 07 14:10:13.334413 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:13.334383 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xzfg2" Jul 07 14:10:13.335236 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:13.335215 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s5cfz" event={"ID":"8358392b-ad0d-457c-844a-85a1b754a49e","Type":"ContainerStarted","Data":"981a2b41c81ce59e35beb39aa717287429b5f11eb4a3b172f024de57427f06e2"} Jul 07 14:10:13.915439 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:13.915401 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61c55aec-8d5a-486f-8e6d-2ed748969b6e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rxpf2\" (UID: \"61c55aec-8d5a-486f-8e6d-2ed748969b6e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rxpf2" Jul 07 14:10:13.915940 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:13.915485 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-registry-tls\") pod \"image-registry-5d84d45866-prl9z\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:10:13.915940 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:13.915540 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4139e191-c46c-4737-ac93-784c0df05814-metrics-tls\") pod \"dns-default-m5g66\" (UID: \"4139e191-c46c-4737-ac93-784c0df05814\") " pod="openshift-dns/dns-default-m5g66" Jul 07 14:10:13.915940 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:10:13.915608 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 14:10:13.915940 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:10:13.915620 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:10:13.915940 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:10:13.915643 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d84d45866-prl9z: secret "image-registry-tls" not found Jul 07 14:10:13.915940 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:10:13.915664 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:10:13.915940 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:10:13.915678 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61c55aec-8d5a-486f-8e6d-2ed748969b6e-networking-console-plugin-cert podName:61c55aec-8d5a-486f-8e6d-2ed748969b6e nodeName:}" failed. No retries permitted until 2026-07-07 14:10:45.915661235 +0000 UTC m=+99.298498643 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/61c55aec-8d5a-486f-8e6d-2ed748969b6e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-rxpf2" (UID: "61c55aec-8d5a-486f-8e6d-2ed748969b6e") : secret "networking-console-plugin-cert" not found Jul 07 14:10:13.915940 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:10:13.915711 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-registry-tls podName:6ebe9a1d-a632-4029-a154-663edb83c930 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:45.915693654 +0000 UTC m=+99.298531061 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-registry-tls") pod "image-registry-5d84d45866-prl9z" (UID: "6ebe9a1d-a632-4029-a154-663edb83c930") : secret "image-registry-tls" not found Jul 07 14:10:13.915940 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:10:13.915734 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4139e191-c46c-4737-ac93-784c0df05814-metrics-tls podName:4139e191-c46c-4737-ac93-784c0df05814 nodeName:}" failed. No retries permitted until 2026-07-07 14:10:45.915724668 +0000 UTC m=+99.298562081 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4139e191-c46c-4737-ac93-784c0df05814-metrics-tls") pod "dns-default-m5g66" (UID: "4139e191-c46c-4737-ac93-784c0df05814") : secret "dns-default-metrics-tls" not found Jul 07 14:10:17.347465 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:17.347358 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-s5cfz" event={"ID":"8358392b-ad0d-457c-844a-85a1b754a49e","Type":"ContainerStarted","Data":"622b6b7936421942f2391232abb3ce5e71e9890d3d1265b7d17b2c080b746238"} Jul 07 14:10:17.364382 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:17.364336 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-s5cfz" podStartSLOduration=66.624979353 podStartE2EDuration="1m10.364321233s" totalImagesPullingTime="3.73934188s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:17.363901023 +0000 UTC m=+70.746738450" watchObservedRunningTime="2026-07-07 14:10:17.364321233 +0000 UTC m=+70.747158662" Jul 07 14:10:17.364584 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:17.364561 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xzfg2" podStartSLOduration=70.364552636 podStartE2EDuration="1m10.364552636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:09:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:10:13.374825783 +0000 UTC m=+66.757663214" watchObservedRunningTime="2026-07-07 14:10:17.364552636 +0000 UTC m=+70.747390065" Jul 07 14:10:22.872461 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:22.872411 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:22.951855 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:22.951812 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:44.340655 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:44.340620 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xzfg2" Jul 07 14:10:45.963470 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:45.963420 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-registry-tls\") pod \"image-registry-5d84d45866-prl9z\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:10:45.963470 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:45.963472 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4139e191-c46c-4737-ac93-784c0df05814-metrics-tls\") pod \"dns-default-m5g66\" (UID: \"4139e191-c46c-4737-ac93-784c0df05814\") " pod="openshift-dns/dns-default-m5g66" Jul 07 14:10:45.964046 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:45.963627 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61c55aec-8d5a-486f-8e6d-2ed748969b6e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rxpf2\" (UID: \"61c55aec-8d5a-486f-8e6d-2ed748969b6e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rxpf2" Jul 07 14:10:45.964046 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:10:45.963643 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:10:45.964046 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:10:45.963669 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d84d45866-prl9z: secret "image-registry-tls" not found Jul 07 14:10:45.964046 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:10:45.963740 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:10:45.964046 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:10:45.963740 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 14:10:45.964046 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:10:45.963753 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-registry-tls podName:6ebe9a1d-a632-4029-a154-663edb83c930 nodeName:}" failed. No retries permitted until 2026-07-07 14:11:49.963732 +0000 UTC m=+163.346569422 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-registry-tls") pod "image-registry-5d84d45866-prl9z" (UID: "6ebe9a1d-a632-4029-a154-663edb83c930") : secret "image-registry-tls" not found Jul 07 14:10:45.964046 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:10:45.963803 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4139e191-c46c-4737-ac93-784c0df05814-metrics-tls podName:4139e191-c46c-4737-ac93-784c0df05814 nodeName:}" failed. No retries permitted until 2026-07-07 14:11:49.963787571 +0000 UTC m=+163.346624979 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4139e191-c46c-4737-ac93-784c0df05814-metrics-tls") pod "dns-default-m5g66" (UID: "4139e191-c46c-4737-ac93-784c0df05814") : secret "dns-default-metrics-tls" not found Jul 07 14:10:45.964046 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:10:45.963819 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61c55aec-8d5a-486f-8e6d-2ed748969b6e-networking-console-plugin-cert podName:61c55aec-8d5a-486f-8e6d-2ed748969b6e nodeName:}" failed. No retries permitted until 2026-07-07 14:11:49.963812232 +0000 UTC m=+163.346649640 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/61c55aec-8d5a-486f-8e6d-2ed748969b6e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-rxpf2" (UID: "61c55aec-8d5a-486f-8e6d-2ed748969b6e") : secret "networking-console-plugin-cert" not found Jul 07 14:10:56.751689 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:56.751651 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:10:56.859193 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:10:56.859159 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:16.986825 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:11:16.986784 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1125d082-9200-4b6f-b03b-1edd11069009-metrics-certs\") pod \"network-metrics-daemon-rfmz4\" (UID: \"1125d082-9200-4b6f-b03b-1edd11069009\") " pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:11:16.987224 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:11:16.986938 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 07 14:11:16.987224 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:11:16.987013 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1125d082-9200-4b6f-b03b-1edd11069009-metrics-certs podName:1125d082-9200-4b6f-b03b-1edd11069009 nodeName:}" failed. No retries permitted until 2026-07-07 14:13:18.986995029 +0000 UTC m=+252.369832453 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1125d082-9200-4b6f-b03b-1edd11069009-metrics-certs") pod "network-metrics-daemon-rfmz4" (UID: "1125d082-9200-4b6f-b03b-1edd11069009") : secret "metrics-daemon-secret" not found Jul 07 14:11:25.752303 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:11:25.752266 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:11:44.993813 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:11:44.993764 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5d84d45866-prl9z" podUID="6ebe9a1d-a632-4029-a154-663edb83c930" Jul 07 14:11:45.003975 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:11:45.003935 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rxpf2" podUID="61c55aec-8d5a-486f-8e6d-2ed748969b6e" Jul 07 14:11:45.034145 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:11:45.034109 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-m5g66" podUID="4139e191-c46c-4737-ac93-784c0df05814" Jul 07 14:11:45.564320 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:11:45.564289 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:11:45.564489 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:11:45.564290 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rxpf2" Jul 07 14:11:46.123270 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:11:46.123214 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-rfmz4" podUID="1125d082-9200-4b6f-b03b-1edd11069009" Jul 07 14:11:50.033479 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:11:50.033427 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61c55aec-8d5a-486f-8e6d-2ed748969b6e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rxpf2\" (UID: \"61c55aec-8d5a-486f-8e6d-2ed748969b6e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rxpf2" Jul 07 14:11:50.033955 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:11:50.033553 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-registry-tls\") pod \"image-registry-5d84d45866-prl9z\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:11:50.033955 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:11:50.033580 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4139e191-c46c-4737-ac93-784c0df05814-metrics-tls\") pod \"dns-default-m5g66\" (UID: \"4139e191-c46c-4737-ac93-784c0df05814\") " pod="openshift-dns/dns-default-m5g66" Jul 07 14:11:50.033955 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:11:50.033624 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 14:11:50.033955 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:11:50.033677 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 07 14:11:50.033955 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:11:50.033683 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 07 14:11:50.033955 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:11:50.033697 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d84d45866-prl9z: secret "image-registry-tls" not found Jul 07 14:11:50.033955 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:11:50.033712 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61c55aec-8d5a-486f-8e6d-2ed748969b6e-networking-console-plugin-cert podName:61c55aec-8d5a-486f-8e6d-2ed748969b6e nodeName:}" failed. No retries permitted until 2026-07-07 14:13:52.033689742 +0000 UTC m=+285.416527167 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/61c55aec-8d5a-486f-8e6d-2ed748969b6e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-rxpf2" (UID: "61c55aec-8d5a-486f-8e6d-2ed748969b6e") : secret "networking-console-plugin-cert" not found Jul 07 14:11:50.033955 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:11:50.033734 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4139e191-c46c-4737-ac93-784c0df05814-metrics-tls podName:4139e191-c46c-4737-ac93-784c0df05814 nodeName:}" failed. No retries permitted until 2026-07-07 14:13:52.033723029 +0000 UTC m=+285.416560438 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4139e191-c46c-4737-ac93-784c0df05814-metrics-tls") pod "dns-default-m5g66" (UID: "4139e191-c46c-4737-ac93-784c0df05814") : secret "dns-default-metrics-tls" not found Jul 07 14:11:50.033955 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:11:50.033749 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-registry-tls podName:6ebe9a1d-a632-4029-a154-663edb83c930 nodeName:}" failed. No retries permitted until 2026-07-07 14:13:52.03374113 +0000 UTC m=+285.416578541 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-registry-tls") pod "image-registry-5d84d45866-prl9z" (UID: "6ebe9a1d-a632-4029-a154-663edb83c930") : secret "image-registry-tls" not found Jul 07 14:11:58.095079 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:11:58.094980 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:12:00.095164 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:12:00.095133 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m5g66" Jul 07 14:12:55.923766 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:12:55.923736 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:13.573955 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:13.573920 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:18.995410 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:18.995370 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1125d082-9200-4b6f-b03b-1edd11069009-metrics-certs\") pod \"network-metrics-daemon-rfmz4\" (UID: \"1125d082-9200-4b6f-b03b-1edd11069009\") " pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:13:18.995888 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:18.995530 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 07 14:13:18.995888 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:18.995589 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1125d082-9200-4b6f-b03b-1edd11069009-metrics-certs podName:1125d082-9200-4b6f-b03b-1edd11069009 nodeName:}" failed. No retries permitted until 2026-07-07 14:15:20.995574643 +0000 UTC m=+374.378412051 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1125d082-9200-4b6f-b03b-1edd11069009-metrics-certs") pod "network-metrics-daemon-rfmz4" (UID: "1125d082-9200-4b6f-b03b-1edd11069009") : secret "metrics-daemon-secret" not found Jul 07 14:13:37.721317 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.721284 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-zld8k"] Jul 07 14:13:37.724110 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.724093 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-zld8k" Jul 07 14:13:37.728120 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.728092 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-4v74k\"" Jul 07 14:13:37.728286 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.728197 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:13:37.728365 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.728341 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 07 14:13:37.728776 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.728759 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nf787"] Jul 07 14:13:37.731401 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.731380 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-ntqmk"] Jul 07 14:13:37.731544 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.731525 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nf787" Jul 07 14:13:37.734120 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.734102 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-ntqmk" Jul 07 14:13:37.734861 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.734846 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 07 14:13:37.735370 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.735358 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fbts7\"" Jul 07 14:13:37.736697 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.736676 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 14:13:37.736697 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.736697 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 07 14:13:37.736844 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.736685 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 14:13:37.738479 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.738460 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 14:13:37.740988 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.740916 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 14:13:37.741348 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.741333 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-zld8k"] Jul 07 14:13:37.749857 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.749825 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 07 14:13:37.750065 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.750049 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-grcqj\"" Jul 07 14:13:37.750448 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.750415 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 07 14:13:37.751053 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.751029 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-ntqmk"] Jul 07 14:13:37.752905 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.752887 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 07 14:13:37.767158 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.767128 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nf787"] Jul 07 14:13:37.836851 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.836818 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1eefdda1-18e3-429d-ad78-2f0b93e00b2e-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-ntqmk\" (UID: \"1eefdda1-18e3-429d-ad78-2f0b93e00b2e\") " pod="openshift-insights/insights-operator-5c847dcfc4-ntqmk" Jul 07 14:13:37.836851 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.836847 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1eefdda1-18e3-429d-ad78-2f0b93e00b2e-serving-cert\") pod \"insights-operator-5c847dcfc4-ntqmk\" (UID: \"1eefdda1-18e3-429d-ad78-2f0b93e00b2e\") " pod="openshift-insights/insights-operator-5c847dcfc4-ntqmk" Jul 07 14:13:37.837069 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.836871 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1eefdda1-18e3-429d-ad78-2f0b93e00b2e-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-ntqmk\" (UID: \"1eefdda1-18e3-429d-ad78-2f0b93e00b2e\") " pod="openshift-insights/insights-operator-5c847dcfc4-ntqmk" Jul 07 14:13:37.837069 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.836916 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7c98b12-be0e-4355-b645-7538f11358f2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nf787\" (UID: \"c7c98b12-be0e-4355-b645-7538f11358f2\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nf787" Jul 07 14:13:37.837069 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.836997 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g62g\" (UniqueName: \"kubernetes.io/projected/c7c98b12-be0e-4355-b645-7538f11358f2-kube-api-access-5g62g\") pod \"cluster-monitoring-operator-64786d9cbb-nf787\" (UID: \"c7c98b12-be0e-4355-b645-7538f11358f2\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nf787" Jul 07 14:13:37.837069 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.837021 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1eefdda1-18e3-429d-ad78-2f0b93e00b2e-snapshots\") pod \"insights-operator-5c847dcfc4-ntqmk\" (UID: \"1eefdda1-18e3-429d-ad78-2f0b93e00b2e\") " pod="openshift-insights/insights-operator-5c847dcfc4-ntqmk" Jul 07 14:13:37.837214 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.837108 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftnvz\" (UniqueName: \"kubernetes.io/projected/2dc0a674-481e-4ad4-b50b-f61fba7ba171-kube-api-access-ftnvz\") pod \"volume-data-source-validator-5d456fdbcd-zld8k\" (UID: \"2dc0a674-481e-4ad4-b50b-f61fba7ba171\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-zld8k" Jul 07 14:13:37.837214 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.837143 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7km6\" (UniqueName: \"kubernetes.io/projected/1eefdda1-18e3-429d-ad78-2f0b93e00b2e-kube-api-access-g7km6\") pod \"insights-operator-5c847dcfc4-ntqmk\" (UID: \"1eefdda1-18e3-429d-ad78-2f0b93e00b2e\") " pod="openshift-insights/insights-operator-5c847dcfc4-ntqmk" Jul 07 14:13:37.837214 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.837162 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c7c98b12-be0e-4355-b645-7538f11358f2-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-nf787\" (UID: \"c7c98b12-be0e-4355-b645-7538f11358f2\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nf787" Jul 07 14:13:37.837214 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.837185 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1eefdda1-18e3-429d-ad78-2f0b93e00b2e-tmp\") pod \"insights-operator-5c847dcfc4-ntqmk\" (UID: \"1eefdda1-18e3-429d-ad78-2f0b93e00b2e\") " pod="openshift-insights/insights-operator-5c847dcfc4-ntqmk" Jul 07 14:13:37.838881 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.838859 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-b66mb"] Jul 07 14:13:37.841725 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.841711 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-b66mb" Jul 07 14:13:37.846861 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.846840 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:13:37.848028 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.848009 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 07 14:13:37.848336 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.848316 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 07 14:13:37.848447 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.848372 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 07 14:13:37.848726 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.848708 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-mdm9z\"" Jul 07 14:13:37.855569 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.855475 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 07 14:13:37.860684 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.860658 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-b66mb"] Jul 07 14:13:37.938273 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.938239 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82df755c-beec-4653-96a6-691507fee3e7-trusted-ca\") pod \"console-operator-68b757fb67-b66mb\" (UID: \"82df755c-beec-4653-96a6-691507fee3e7\") " pod="openshift-console-operator/console-operator-68b757fb67-b66mb" Jul 07 14:13:37.938273 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.938284 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g62g\" (UniqueName: \"kubernetes.io/projected/c7c98b12-be0e-4355-b645-7538f11358f2-kube-api-access-5g62g\") pod \"cluster-monitoring-operator-64786d9cbb-nf787\" (UID: \"c7c98b12-be0e-4355-b645-7538f11358f2\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nf787" Jul 07 14:13:37.938537 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.938305 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1eefdda1-18e3-429d-ad78-2f0b93e00b2e-snapshots\") pod \"insights-operator-5c847dcfc4-ntqmk\" (UID: \"1eefdda1-18e3-429d-ad78-2f0b93e00b2e\") " pod="openshift-insights/insights-operator-5c847dcfc4-ntqmk" Jul 07 14:13:37.938537 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.938337 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/82df755c-beec-4653-96a6-691507fee3e7-serving-cert\") pod \"console-operator-68b757fb67-b66mb\" (UID: \"82df755c-beec-4653-96a6-691507fee3e7\") " pod="openshift-console-operator/console-operator-68b757fb67-b66mb" Jul 07 14:13:37.938537 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.938388 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftnvz\" (UniqueName: \"kubernetes.io/projected/2dc0a674-481e-4ad4-b50b-f61fba7ba171-kube-api-access-ftnvz\") pod \"volume-data-source-validator-5d456fdbcd-zld8k\" (UID: \"2dc0a674-481e-4ad4-b50b-f61fba7ba171\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-zld8k" Jul 07 14:13:37.938537 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.938526 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7km6\" (UniqueName: \"kubernetes.io/projected/1eefdda1-18e3-429d-ad78-2f0b93e00b2e-kube-api-access-g7km6\") pod \"insights-operator-5c847dcfc4-ntqmk\" (UID: \"1eefdda1-18e3-429d-ad78-2f0b93e00b2e\") " pod="openshift-insights/insights-operator-5c847dcfc4-ntqmk" Jul 07 14:13:37.938713 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.938548 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/82df755c-beec-4653-96a6-691507fee3e7-config\") pod \"console-operator-68b757fb67-b66mb\" (UID: \"82df755c-beec-4653-96a6-691507fee3e7\") " pod="openshift-console-operator/console-operator-68b757fb67-b66mb" Jul 07 14:13:37.938713 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.938570 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c7c98b12-be0e-4355-b645-7538f11358f2-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-nf787\" (UID: \"c7c98b12-be0e-4355-b645-7538f11358f2\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nf787" Jul 07 14:13:37.938713 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.938594 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1eefdda1-18e3-429d-ad78-2f0b93e00b2e-tmp\") pod \"insights-operator-5c847dcfc4-ntqmk\" (UID: \"1eefdda1-18e3-429d-ad78-2f0b93e00b2e\") " pod="openshift-insights/insights-operator-5c847dcfc4-ntqmk" Jul 07 14:13:37.938713 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.938640 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1eefdda1-18e3-429d-ad78-2f0b93e00b2e-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-ntqmk\" (UID: \"1eefdda1-18e3-429d-ad78-2f0b93e00b2e\") " pod="openshift-insights/insights-operator-5c847dcfc4-ntqmk" Jul 07 14:13:37.938713 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.938673 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1eefdda1-18e3-429d-ad78-2f0b93e00b2e-serving-cert\") pod \"insights-operator-5c847dcfc4-ntqmk\" (UID: \"1eefdda1-18e3-429d-ad78-2f0b93e00b2e\") " pod="openshift-insights/insights-operator-5c847dcfc4-ntqmk" Jul 07 14:13:37.938713 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.938706 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1eefdda1-18e3-429d-ad78-2f0b93e00b2e-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-ntqmk\" (UID: \"1eefdda1-18e3-429d-ad78-2f0b93e00b2e\") " pod="openshift-insights/insights-operator-5c847dcfc4-ntqmk" Jul 07 14:13:37.939024 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.938733 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-292lr\" (UniqueName: \"kubernetes.io/projected/82df755c-beec-4653-96a6-691507fee3e7-kube-api-access-292lr\") pod \"console-operator-68b757fb67-b66mb\" (UID: \"82df755c-beec-4653-96a6-691507fee3e7\") " pod="openshift-console-operator/console-operator-68b757fb67-b66mb" Jul 07 14:13:37.939024 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.938763 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7c98b12-be0e-4355-b645-7538f11358f2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nf787\" (UID: \"c7c98b12-be0e-4355-b645-7538f11358f2\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nf787" Jul 07 14:13:37.939024 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:37.938919 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 14:13:37.939024 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:37.938972 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7c98b12-be0e-4355-b645-7538f11358f2-cluster-monitoring-operator-tls podName:c7c98b12-be0e-4355-b645-7538f11358f2 nodeName:}" failed. No retries permitted until 2026-07-07 14:13:38.438954358 +0000 UTC m=+271.821791768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c7c98b12-be0e-4355-b645-7538f11358f2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-nf787" (UID: "c7c98b12-be0e-4355-b645-7538f11358f2") : secret "cluster-monitoring-operator-tls" not found Jul 07 14:13:37.939241 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.939036 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1eefdda1-18e3-429d-ad78-2f0b93e00b2e-tmp\") pod \"insights-operator-5c847dcfc4-ntqmk\" (UID: \"1eefdda1-18e3-429d-ad78-2f0b93e00b2e\") " pod="openshift-insights/insights-operator-5c847dcfc4-ntqmk" Jul 07 14:13:37.939241 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.939118 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/1eefdda1-18e3-429d-ad78-2f0b93e00b2e-snapshots\") pod \"insights-operator-5c847dcfc4-ntqmk\" (UID: \"1eefdda1-18e3-429d-ad78-2f0b93e00b2e\") " pod="openshift-insights/insights-operator-5c847dcfc4-ntqmk" Jul 07 14:13:37.939344 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.939237 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1eefdda1-18e3-429d-ad78-2f0b93e00b2e-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-ntqmk\" (UID: \"1eefdda1-18e3-429d-ad78-2f0b93e00b2e\") " pod="openshift-insights/insights-operator-5c847dcfc4-ntqmk" Jul 07 14:13:37.939403 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.939373 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c7c98b12-be0e-4355-b645-7538f11358f2-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-nf787\" (UID: \"c7c98b12-be0e-4355-b645-7538f11358f2\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nf787" Jul 07 14:13:37.939700 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.939675 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1eefdda1-18e3-429d-ad78-2f0b93e00b2e-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-ntqmk\" (UID: \"1eefdda1-18e3-429d-ad78-2f0b93e00b2e\") " pod="openshift-insights/insights-operator-5c847dcfc4-ntqmk" Jul 07 14:13:37.941326 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.941310 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1eefdda1-18e3-429d-ad78-2f0b93e00b2e-serving-cert\") pod \"insights-operator-5c847dcfc4-ntqmk\" (UID: \"1eefdda1-18e3-429d-ad78-2f0b93e00b2e\") " pod="openshift-insights/insights-operator-5c847dcfc4-ntqmk" Jul 07 14:13:37.967118 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.967088 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g62g\" (UniqueName: \"kubernetes.io/projected/c7c98b12-be0e-4355-b645-7538f11358f2-kube-api-access-5g62g\") pod \"cluster-monitoring-operator-64786d9cbb-nf787\" (UID: \"c7c98b12-be0e-4355-b645-7538f11358f2\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nf787" Jul 07 14:13:37.968493 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.968469 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7km6\" (UniqueName: \"kubernetes.io/projected/1eefdda1-18e3-429d-ad78-2f0b93e00b2e-kube-api-access-g7km6\") pod \"insights-operator-5c847dcfc4-ntqmk\" (UID: \"1eefdda1-18e3-429d-ad78-2f0b93e00b2e\") " pod="openshift-insights/insights-operator-5c847dcfc4-ntqmk" Jul 07 14:13:37.971839 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:37.971783 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftnvz\" (UniqueName: \"kubernetes.io/projected/2dc0a674-481e-4ad4-b50b-f61fba7ba171-kube-api-access-ftnvz\") pod \"volume-data-source-validator-5d456fdbcd-zld8k\" (UID: \"2dc0a674-481e-4ad4-b50b-f61fba7ba171\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-zld8k" Jul 07 14:13:38.033703 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:38.033670 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-zld8k" Jul 07 14:13:38.039932 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:38.039911 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-292lr\" (UniqueName: \"kubernetes.io/projected/82df755c-beec-4653-96a6-691507fee3e7-kube-api-access-292lr\") pod \"console-operator-68b757fb67-b66mb\" (UID: \"82df755c-beec-4653-96a6-691507fee3e7\") " pod="openshift-console-operator/console-operator-68b757fb67-b66mb" Jul 07 14:13:38.039992 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:38.039982 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82df755c-beec-4653-96a6-691507fee3e7-trusted-ca\") pod \"console-operator-68b757fb67-b66mb\" (UID: \"82df755c-beec-4653-96a6-691507fee3e7\") " pod="openshift-console-operator/console-operator-68b757fb67-b66mb" Jul 07 14:13:38.040035 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:38.040013 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/82df755c-beec-4653-96a6-691507fee3e7-serving-cert\") pod \"console-operator-68b757fb67-b66mb\" (UID: \"82df755c-beec-4653-96a6-691507fee3e7\") " pod="openshift-console-operator/console-operator-68b757fb67-b66mb" Jul 07 14:13:38.040076 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:38.040043 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/82df755c-beec-4653-96a6-691507fee3e7-config\") pod \"console-operator-68b757fb67-b66mb\" (UID: \"82df755c-beec-4653-96a6-691507fee3e7\") " pod="openshift-console-operator/console-operator-68b757fb67-b66mb" Jul 07 14:13:38.040872 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:38.040841 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/82df755c-beec-4653-96a6-691507fee3e7-config\") pod \"console-operator-68b757fb67-b66mb\" (UID: \"82df755c-beec-4653-96a6-691507fee3e7\") " pod="openshift-console-operator/console-operator-68b757fb67-b66mb" Jul 07 14:13:38.041033 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:38.040983 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/82df755c-beec-4653-96a6-691507fee3e7-trusted-ca\") pod \"console-operator-68b757fb67-b66mb\" (UID: \"82df755c-beec-4653-96a6-691507fee3e7\") " pod="openshift-console-operator/console-operator-68b757fb67-b66mb" Jul 07 14:13:38.042714 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:38.042693 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/82df755c-beec-4653-96a6-691507fee3e7-serving-cert\") pod \"console-operator-68b757fb67-b66mb\" (UID: \"82df755c-beec-4653-96a6-691507fee3e7\") " pod="openshift-console-operator/console-operator-68b757fb67-b66mb" Jul 07 14:13:38.047707 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:38.047686 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-ntqmk" Jul 07 14:13:38.062792 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:38.062770 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-292lr\" (UniqueName: \"kubernetes.io/projected/82df755c-beec-4653-96a6-691507fee3e7-kube-api-access-292lr\") pod \"console-operator-68b757fb67-b66mb\" (UID: \"82df755c-beec-4653-96a6-691507fee3e7\") " pod="openshift-console-operator/console-operator-68b757fb67-b66mb" Jul 07 14:13:38.112482 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:38.112414 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:38.150763 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:38.150731 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-b66mb" Jul 07 14:13:38.188801 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:38.188764 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-zld8k"] Jul 07 14:13:38.192928 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:13:38.192897 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dc0a674_481e_4ad4_b50b_f61fba7ba171.slice/crio-be38c9015f4cfadd265f5e95043cb1fedbec81a1b4e19d3e00174b20e2a77880 WatchSource:0}: Error finding container be38c9015f4cfadd265f5e95043cb1fedbec81a1b4e19d3e00174b20e2a77880: Status 404 returned error can't find the container with id be38c9015f4cfadd265f5e95043cb1fedbec81a1b4e19d3e00174b20e2a77880 Jul 07 14:13:38.207224 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:38.207195 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-ntqmk"] Jul 07 14:13:38.210999 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:13:38.210963 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eefdda1_18e3_429d_ad78_2f0b93e00b2e.slice/crio-eb13d849554703cf212c5e568aa8a3afe89a4714c07e4e4a06388eadc58dd849 WatchSource:0}: Error finding container eb13d849554703cf212c5e568aa8a3afe89a4714c07e4e4a06388eadc58dd849: Status 404 returned error can't find the container with id eb13d849554703cf212c5e568aa8a3afe89a4714c07e4e4a06388eadc58dd849 Jul 07 14:13:38.216072 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:38.216044 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:38.291684 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:38.291653 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-b66mb"] Jul 07 14:13:38.294751 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:13:38.294723 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82df755c_beec_4653_96a6_691507fee3e7.slice/crio-a33bb988c58dcdc8408898a5252074012a474b0bf106f9743c1f29f4a33d51b2 WatchSource:0}: Error finding container a33bb988c58dcdc8408898a5252074012a474b0bf106f9743c1f29f4a33d51b2: Status 404 returned error can't find the container with id a33bb988c58dcdc8408898a5252074012a474b0bf106f9743c1f29f4a33d51b2 Jul 07 14:13:38.444151 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:38.444112 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7c98b12-be0e-4355-b645-7538f11358f2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nf787\" (UID: \"c7c98b12-be0e-4355-b645-7538f11358f2\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nf787" Jul 07 14:13:38.444325 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:38.444260 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 14:13:38.444325 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:38.444320 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7c98b12-be0e-4355-b645-7538f11358f2-cluster-monitoring-operator-tls podName:c7c98b12-be0e-4355-b645-7538f11358f2 nodeName:}" failed. No retries permitted until 2026-07-07 14:13:39.444306175 +0000 UTC m=+272.827143587 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c7c98b12-be0e-4355-b645-7538f11358f2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-nf787" (UID: "c7c98b12-be0e-4355-b645-7538f11358f2") : secret "cluster-monitoring-operator-tls" not found Jul 07 14:13:38.832724 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:38.832690 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-zld8k" event={"ID":"2dc0a674-481e-4ad4-b50b-f61fba7ba171","Type":"ContainerStarted","Data":"be38c9015f4cfadd265f5e95043cb1fedbec81a1b4e19d3e00174b20e2a77880"} Jul 07 14:13:38.833679 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:38.833653 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-b66mb" event={"ID":"82df755c-beec-4653-96a6-691507fee3e7","Type":"ContainerStarted","Data":"a33bb988c58dcdc8408898a5252074012a474b0bf106f9743c1f29f4a33d51b2"} Jul 07 14:13:38.834745 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:38.834716 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-ntqmk" event={"ID":"1eefdda1-18e3-429d-ad78-2f0b93e00b2e","Type":"ContainerStarted","Data":"eb13d849554703cf212c5e568aa8a3afe89a4714c07e4e4a06388eadc58dd849"} Jul 07 14:13:39.452127 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:39.452089 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7c98b12-be0e-4355-b645-7538f11358f2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nf787\" (UID: \"c7c98b12-be0e-4355-b645-7538f11358f2\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nf787" Jul 07 14:13:39.452303 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:39.452259 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 14:13:39.452363 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:39.452328 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7c98b12-be0e-4355-b645-7538f11358f2-cluster-monitoring-operator-tls podName:c7c98b12-be0e-4355-b645-7538f11358f2 nodeName:}" failed. No retries permitted until 2026-07-07 14:13:41.452311911 +0000 UTC m=+274.835149321 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c7c98b12-be0e-4355-b645-7538f11358f2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-nf787" (UID: "c7c98b12-be0e-4355-b645-7538f11358f2") : secret "cluster-monitoring-operator-tls" not found Jul 07 14:13:39.839796 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:39.839758 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-zld8k" event={"ID":"2dc0a674-481e-4ad4-b50b-f61fba7ba171","Type":"ContainerStarted","Data":"e06bbb23eb3f75fc4752bba0585471b4d7c8e1f8056de057d031cbd360498ed0"} Jul 07 14:13:39.857461 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:39.857399 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-zld8k" podStartSLOduration=1.55154448 podStartE2EDuration="2.857378453s" totalImagesPullingTime="1.305833973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:13:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:13:39.857161728 +0000 UTC m=+273.239999159" watchObservedRunningTime="2026-07-07 14:13:39.857378453 +0000 UTC m=+273.240215887" Jul 07 14:13:39.940378 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:39.940342 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:40.041491 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:40.041447 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:41.469918 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:41.469883 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7c98b12-be0e-4355-b645-7538f11358f2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nf787\" (UID: \"c7c98b12-be0e-4355-b645-7538f11358f2\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nf787" Jul 07 14:13:41.470300 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:41.470077 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 14:13:41.470300 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:41.470161 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7c98b12-be0e-4355-b645-7538f11358f2-cluster-monitoring-operator-tls podName:c7c98b12-be0e-4355-b645-7538f11358f2 nodeName:}" failed. No retries permitted until 2026-07-07 14:13:45.470140638 +0000 UTC m=+278.852978050 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c7c98b12-be0e-4355-b645-7538f11358f2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-nf787" (UID: "c7c98b12-be0e-4355-b645-7538f11358f2") : secret "cluster-monitoring-operator-tls" not found Jul 07 14:13:41.847435 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:41.847352 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b66mb_82df755c-beec-4653-96a6-691507fee3e7/console-operator/0.log" Jul 07 14:13:41.847435 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:41.847397 2557 generic.go:356] "Generic (PLEG): container finished" podID="82df755c-beec-4653-96a6-691507fee3e7" containerID="8e046452db7a258bbce481aa016f543585cf7624e72a5a28d3cf2ba3a1518eaa" exitCode=255 Jul 07 14:13:41.847675 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:41.847434 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-b66mb" event={"ID":"82df755c-beec-4653-96a6-691507fee3e7","Type":"ContainerDied","Data":"8e046452db7a258bbce481aa016f543585cf7624e72a5a28d3cf2ba3a1518eaa"} Jul 07 14:13:41.847756 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:41.847741 2557 scope.go:117] "RemoveContainer" containerID="8e046452db7a258bbce481aa016f543585cf7624e72a5a28d3cf2ba3a1518eaa" Jul 07 14:13:41.849111 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:41.849087 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-ntqmk" event={"ID":"1eefdda1-18e3-429d-ad78-2f0b93e00b2e","Type":"ContainerStarted","Data":"d93eb9456d2d4fbbbe3205b453ba927330ff4150e7854b4faa9a519915bca46d"} Jul 07 14:13:41.902837 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:41.902781 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-ntqmk" podStartSLOduration=2.075341827 podStartE2EDuration="4.902763083s" totalImagesPullingTime="2.827421256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:13:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:13:41.901347215 +0000 UTC m=+275.284184646" watchObservedRunningTime="2026-07-07 14:13:41.902763083 +0000 UTC m=+275.285600513" Jul 07 14:13:42.520318 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:42.520281 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:42.563907 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:42.563875 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-4lvtr"] Jul 07 14:13:42.566921 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:42.566904 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4lvtr" Jul 07 14:13:42.570461 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:42.570431 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 07 14:13:42.570727 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:42.570704 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 07 14:13:42.571474 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:42.571452 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-646c9\"" Jul 07 14:13:42.577797 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:42.577775 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-4lvtr"] Jul 07 14:13:42.610439 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:42.610402 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:42.679634 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:42.679590 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftgkj\" (UniqueName: \"kubernetes.io/projected/7183cb56-3853-47da-90e0-6fe704d5f98d-kube-api-access-ftgkj\") pod \"migrator-d57d58cc9-4lvtr\" (UID: \"7183cb56-3853-47da-90e0-6fe704d5f98d\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4lvtr" Jul 07 14:13:42.711264 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:42.711229 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:42.780459 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:42.780371 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftgkj\" (UniqueName: \"kubernetes.io/projected/7183cb56-3853-47da-90e0-6fe704d5f98d-kube-api-access-ftgkj\") pod \"migrator-d57d58cc9-4lvtr\" (UID: \"7183cb56-3853-47da-90e0-6fe704d5f98d\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4lvtr" Jul 07 14:13:42.791375 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:42.791344 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftgkj\" (UniqueName: \"kubernetes.io/projected/7183cb56-3853-47da-90e0-6fe704d5f98d-kube-api-access-ftgkj\") pod \"migrator-d57d58cc9-4lvtr\" (UID: \"7183cb56-3853-47da-90e0-6fe704d5f98d\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4lvtr" Jul 07 14:13:42.856015 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:42.855980 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b66mb_82df755c-beec-4653-96a6-691507fee3e7/console-operator/1.log" Jul 07 14:13:42.856735 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:42.856694 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b66mb_82df755c-beec-4653-96a6-691507fee3e7/console-operator/0.log" Jul 07 14:13:42.856880 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:42.856752 2557 generic.go:356] "Generic (PLEG): container finished" podID="82df755c-beec-4653-96a6-691507fee3e7" containerID="49246a866c82f0188ead70eb6dcbc24be73a91fd9155c433297cba8c26f68794" exitCode=255 Jul 07 14:13:42.856880 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:42.856837 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-b66mb" event={"ID":"82df755c-beec-4653-96a6-691507fee3e7","Type":"ContainerDied","Data":"49246a866c82f0188ead70eb6dcbc24be73a91fd9155c433297cba8c26f68794"} Jul 07 14:13:42.856991 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:42.856927 2557 scope.go:117] "RemoveContainer" containerID="8e046452db7a258bbce481aa016f543585cf7624e72a5a28d3cf2ba3a1518eaa" Jul 07 14:13:42.857759 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:42.857728 2557 scope.go:117] "RemoveContainer" containerID="49246a866c82f0188ead70eb6dcbc24be73a91fd9155c433297cba8c26f68794" Jul 07 14:13:42.857969 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:42.857931 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-b66mb_openshift-console-operator(82df755c-beec-4653-96a6-691507fee3e7)\"" pod="openshift-console-operator/console-operator-68b757fb67-b66mb" podUID="82df755c-beec-4653-96a6-691507fee3e7" Jul 07 14:13:42.876174 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:42.876141 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4lvtr" Jul 07 14:13:42.905929 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:42.905867 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:42.906326 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:42.906294 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-82r8c"] Jul 07 14:13:42.910409 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:42.910385 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-82r8c" Jul 07 14:13:42.912540 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:42.912472 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 14:13:42.912842 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:42.912823 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 14:13:42.913058 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:42.913042 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xcd9z\"" Jul 07 14:13:42.922732 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:42.922707 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-82r8c"] Jul 07 14:13:42.971052 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:42.970807 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:43.020850 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:43.020817 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-4lvtr"] Jul 07 14:13:43.023892 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:13:43.023865 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7183cb56_3853_47da_90e0_6fe704d5f98d.slice/crio-c41a3f04ab97d56351ec41d6f6c8f01c71a22ea58c680916ee7e64965d21890c WatchSource:0}: Error finding container c41a3f04ab97d56351ec41d6f6c8f01c71a22ea58c680916ee7e64965d21890c: Status 404 returned error can't find the container with id c41a3f04ab97d56351ec41d6f6c8f01c71a22ea58c680916ee7e64965d21890c Jul 07 14:13:43.084385 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:43.084309 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01146df7-85d8-46ad-82d2-b625f84dc98d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-82r8c\" (UID: \"01146df7-85d8-46ad-82d2-b625f84dc98d\") " pod="openshift-insights/insights-runtime-extractor-82r8c" Jul 07 14:13:43.084385 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:43.084344 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01146df7-85d8-46ad-82d2-b625f84dc98d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-82r8c\" (UID: \"01146df7-85d8-46ad-82d2-b625f84dc98d\") " pod="openshift-insights/insights-runtime-extractor-82r8c" Jul 07 14:13:43.084385 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:43.084384 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bp75\" (UniqueName: \"kubernetes.io/projected/01146df7-85d8-46ad-82d2-b625f84dc98d-kube-api-access-8bp75\") pod \"insights-runtime-extractor-82r8c\" (UID: \"01146df7-85d8-46ad-82d2-b625f84dc98d\") " pod="openshift-insights/insights-runtime-extractor-82r8c" Jul 07 14:13:43.084599 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:43.084458 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01146df7-85d8-46ad-82d2-b625f84dc98d-data-volume\") pod \"insights-runtime-extractor-82r8c\" (UID: \"01146df7-85d8-46ad-82d2-b625f84dc98d\") " pod="openshift-insights/insights-runtime-extractor-82r8c" Jul 07 14:13:43.084599 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:43.084538 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01146df7-85d8-46ad-82d2-b625f84dc98d-crio-socket\") pod \"insights-runtime-extractor-82r8c\" (UID: \"01146df7-85d8-46ad-82d2-b625f84dc98d\") " pod="openshift-insights/insights-runtime-extractor-82r8c" Jul 07 14:13:43.185115 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:43.185077 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01146df7-85d8-46ad-82d2-b625f84dc98d-crio-socket\") pod \"insights-runtime-extractor-82r8c\" (UID: \"01146df7-85d8-46ad-82d2-b625f84dc98d\") " pod="openshift-insights/insights-runtime-extractor-82r8c" Jul 07 14:13:43.185266 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:43.185185 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01146df7-85d8-46ad-82d2-b625f84dc98d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-82r8c\" (UID: \"01146df7-85d8-46ad-82d2-b625f84dc98d\") " pod="openshift-insights/insights-runtime-extractor-82r8c" Jul 07 14:13:43.185266 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:43.185211 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01146df7-85d8-46ad-82d2-b625f84dc98d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-82r8c\" (UID: \"01146df7-85d8-46ad-82d2-b625f84dc98d\") " pod="openshift-insights/insights-runtime-extractor-82r8c" Jul 07 14:13:43.185266 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:43.185216 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01146df7-85d8-46ad-82d2-b625f84dc98d-crio-socket\") pod \"insights-runtime-extractor-82r8c\" (UID: \"01146df7-85d8-46ad-82d2-b625f84dc98d\") " pod="openshift-insights/insights-runtime-extractor-82r8c" Jul 07 14:13:43.185386 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:43.185293 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 14:13:43.185386 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:43.185335 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:13:43.185386 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:43.185357 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01146df7-85d8-46ad-82d2-b625f84dc98d-kube-rbac-proxy-cm podName:01146df7-85d8-46ad-82d2-b625f84dc98d nodeName:}" failed. No retries permitted until 2026-07-07 14:13:43.685339344 +0000 UTC m=+277.068176759 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01146df7-85d8-46ad-82d2-b625f84dc98d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-82r8c" (UID: "01146df7-85d8-46ad-82d2-b625f84dc98d") : configmap "kube-rbac-proxy" not found Jul 07 14:13:43.185386 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:43.185294 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bp75\" (UniqueName: \"kubernetes.io/projected/01146df7-85d8-46ad-82d2-b625f84dc98d-kube-api-access-8bp75\") pod \"insights-runtime-extractor-82r8c\" (UID: \"01146df7-85d8-46ad-82d2-b625f84dc98d\") " pod="openshift-insights/insights-runtime-extractor-82r8c" Jul 07 14:13:43.185561 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:43.185396 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01146df7-85d8-46ad-82d2-b625f84dc98d-insights-runtime-extractor-tls podName:01146df7-85d8-46ad-82d2-b625f84dc98d nodeName:}" failed. No retries permitted until 2026-07-07 14:13:43.685376856 +0000 UTC m=+277.068214263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01146df7-85d8-46ad-82d2-b625f84dc98d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-82r8c" (UID: "01146df7-85d8-46ad-82d2-b625f84dc98d") : secret "insights-runtime-extractor-tls" not found Jul 07 14:13:43.185561 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:43.185444 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01146df7-85d8-46ad-82d2-b625f84dc98d-data-volume\") pod \"insights-runtime-extractor-82r8c\" (UID: \"01146df7-85d8-46ad-82d2-b625f84dc98d\") " pod="openshift-insights/insights-runtime-extractor-82r8c" Jul 07 14:13:43.185734 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:43.185719 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01146df7-85d8-46ad-82d2-b625f84dc98d-data-volume\") pod \"insights-runtime-extractor-82r8c\" (UID: \"01146df7-85d8-46ad-82d2-b625f84dc98d\") " pod="openshift-insights/insights-runtime-extractor-82r8c" Jul 07 14:13:43.194375 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:43.194347 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bp75\" (UniqueName: \"kubernetes.io/projected/01146df7-85d8-46ad-82d2-b625f84dc98d-kube-api-access-8bp75\") pod \"insights-runtime-extractor-82r8c\" (UID: \"01146df7-85d8-46ad-82d2-b625f84dc98d\") " pod="openshift-insights/insights-runtime-extractor-82r8c" Jul 07 14:13:43.591493 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:43.591459 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:43.688523 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:43.688481 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:43.689589 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:43.689571 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01146df7-85d8-46ad-82d2-b625f84dc98d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-82r8c\" (UID: \"01146df7-85d8-46ad-82d2-b625f84dc98d\") " pod="openshift-insights/insights-runtime-extractor-82r8c" Jul 07 14:13:43.689650 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:43.689614 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01146df7-85d8-46ad-82d2-b625f84dc98d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-82r8c\" (UID: \"01146df7-85d8-46ad-82d2-b625f84dc98d\") " pod="openshift-insights/insights-runtime-extractor-82r8c" Jul 07 14:13:43.689720 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:43.689708 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 14:13:43.689755 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:43.689711 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:13:43.689784 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:43.689770 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01146df7-85d8-46ad-82d2-b625f84dc98d-insights-runtime-extractor-tls podName:01146df7-85d8-46ad-82d2-b625f84dc98d nodeName:}" failed. No retries permitted until 2026-07-07 14:13:44.689756125 +0000 UTC m=+278.072593532 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01146df7-85d8-46ad-82d2-b625f84dc98d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-82r8c" (UID: "01146df7-85d8-46ad-82d2-b625f84dc98d") : secret "insights-runtime-extractor-tls" not found Jul 07 14:13:43.689825 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:43.689786 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01146df7-85d8-46ad-82d2-b625f84dc98d-kube-rbac-proxy-cm podName:01146df7-85d8-46ad-82d2-b625f84dc98d nodeName:}" failed. No retries permitted until 2026-07-07 14:13:44.689778752 +0000 UTC m=+278.072616160 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01146df7-85d8-46ad-82d2-b625f84dc98d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-82r8c" (UID: "01146df7-85d8-46ad-82d2-b625f84dc98d") : configmap "kube-rbac-proxy" not found Jul 07 14:13:43.861809 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:43.861722 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b66mb_82df755c-beec-4653-96a6-691507fee3e7/console-operator/1.log" Jul 07 14:13:43.862175 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:43.862148 2557 scope.go:117] "RemoveContainer" containerID="49246a866c82f0188ead70eb6dcbc24be73a91fd9155c433297cba8c26f68794" Jul 07 14:13:43.862379 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:43.862351 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-b66mb_openshift-console-operator(82df755c-beec-4653-96a6-691507fee3e7)\"" pod="openshift-console-operator/console-operator-68b757fb67-b66mb" podUID="82df755c-beec-4653-96a6-691507fee3e7" Jul 07 14:13:43.863335 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:43.863313 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4lvtr" event={"ID":"7183cb56-3853-47da-90e0-6fe704d5f98d","Type":"ContainerStarted","Data":"c41a3f04ab97d56351ec41d6f6c8f01c71a22ea58c680916ee7e64965d21890c"} Jul 07 14:13:44.695332 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:44.695291 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01146df7-85d8-46ad-82d2-b625f84dc98d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-82r8c\" (UID: \"01146df7-85d8-46ad-82d2-b625f84dc98d\") " pod="openshift-insights/insights-runtime-extractor-82r8c" Jul 07 14:13:44.695797 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:44.695346 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01146df7-85d8-46ad-82d2-b625f84dc98d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-82r8c\" (UID: \"01146df7-85d8-46ad-82d2-b625f84dc98d\") " pod="openshift-insights/insights-runtime-extractor-82r8c" Jul 07 14:13:44.695797 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:44.695457 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:13:44.695797 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:44.695470 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 14:13:44.695797 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:44.695545 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01146df7-85d8-46ad-82d2-b625f84dc98d-insights-runtime-extractor-tls podName:01146df7-85d8-46ad-82d2-b625f84dc98d nodeName:}" failed. No retries permitted until 2026-07-07 14:13:46.695525951 +0000 UTC m=+280.078363358 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01146df7-85d8-46ad-82d2-b625f84dc98d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-82r8c" (UID: "01146df7-85d8-46ad-82d2-b625f84dc98d") : secret "insights-runtime-extractor-tls" not found Jul 07 14:13:44.695797 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:44.695560 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01146df7-85d8-46ad-82d2-b625f84dc98d-kube-rbac-proxy-cm podName:01146df7-85d8-46ad-82d2-b625f84dc98d nodeName:}" failed. No retries permitted until 2026-07-07 14:13:46.695553998 +0000 UTC m=+280.078391406 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01146df7-85d8-46ad-82d2-b625f84dc98d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-82r8c" (UID: "01146df7-85d8-46ad-82d2-b625f84dc98d") : configmap "kube-rbac-proxy" not found Jul 07 14:13:45.242822 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:45.242784 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:45.305041 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:45.305004 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:45.468242 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:45.468219 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6dqdt_6a2d3927-7c87-4583-afec-33548d872aca/dns-node-resolver/0.log" Jul 07 14:13:45.501908 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:45.501831 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7c98b12-be0e-4355-b645-7538f11358f2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nf787\" (UID: \"c7c98b12-be0e-4355-b645-7538f11358f2\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nf787" Jul 07 14:13:45.502050 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:45.501981 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 14:13:45.502050 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:45.502042 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7c98b12-be0e-4355-b645-7538f11358f2-cluster-monitoring-operator-tls podName:c7c98b12-be0e-4355-b645-7538f11358f2 nodeName:}" failed. No retries permitted until 2026-07-07 14:13:53.502025221 +0000 UTC m=+286.884862629 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c7c98b12-be0e-4355-b645-7538f11358f2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-nf787" (UID: "c7c98b12-be0e-4355-b645-7538f11358f2") : secret "cluster-monitoring-operator-tls" not found Jul 07 14:13:45.874620 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:45.874527 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4lvtr" event={"ID":"7183cb56-3853-47da-90e0-6fe704d5f98d","Type":"ContainerStarted","Data":"d1aba8878f8803190285f52e10510da306eedae8f32c0385c6d80d3460f54dc1"} Jul 07 14:13:45.874620 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:45.874581 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4lvtr" event={"ID":"7183cb56-3853-47da-90e0-6fe704d5f98d","Type":"ContainerStarted","Data":"772a0f0da86c298597b97b1ac13609eee5b6e2ba0d1e528c03fbeb975ce7739d"} Jul 07 14:13:45.890835 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:45.890778 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-4lvtr" podStartSLOduration=2.00929427 podStartE2EDuration="3.890763126s" totalImagesPullingTime="1.881468856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:13:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:13:45.890384416 +0000 UTC m=+279.273221847" watchObservedRunningTime="2026-07-07 14:13:45.890763126 +0000 UTC m=+279.273600555" Jul 07 14:13:45.989229 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:45.989196 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:46.172685 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:46.172604 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:46.422431 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:46.422392 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:46.710700 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:46.710657 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01146df7-85d8-46ad-82d2-b625f84dc98d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-82r8c\" (UID: \"01146df7-85d8-46ad-82d2-b625f84dc98d\") " pod="openshift-insights/insights-runtime-extractor-82r8c" Jul 07 14:13:46.710700 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:46.710697 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01146df7-85d8-46ad-82d2-b625f84dc98d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-82r8c\" (UID: \"01146df7-85d8-46ad-82d2-b625f84dc98d\") " pod="openshift-insights/insights-runtime-extractor-82r8c" Jul 07 14:13:46.710929 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:46.710818 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:13:46.710929 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:46.710858 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 14:13:46.710929 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:46.710898 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01146df7-85d8-46ad-82d2-b625f84dc98d-insights-runtime-extractor-tls podName:01146df7-85d8-46ad-82d2-b625f84dc98d nodeName:}" failed. No retries permitted until 2026-07-07 14:13:50.71088013 +0000 UTC m=+284.093717539 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01146df7-85d8-46ad-82d2-b625f84dc98d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-82r8c" (UID: "01146df7-85d8-46ad-82d2-b625f84dc98d") : secret "insights-runtime-extractor-tls" not found Jul 07 14:13:46.710929 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:46.710914 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01146df7-85d8-46ad-82d2-b625f84dc98d-kube-rbac-proxy-cm podName:01146df7-85d8-46ad-82d2-b625f84dc98d nodeName:}" failed. No retries permitted until 2026-07-07 14:13:50.710908038 +0000 UTC m=+284.093745446 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01146df7-85d8-46ad-82d2-b625f84dc98d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-82r8c" (UID: "01146df7-85d8-46ad-82d2-b625f84dc98d") : configmap "kube-rbac-proxy" not found Jul 07 14:13:46.869130 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:46.869102 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tdc99_d360f1dd-1647-4c4b-8626-fe12ac3751b5/node-ca/0.log" Jul 07 14:13:47.521289 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:47.521254 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:47.670754 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:47.670726 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xvg2g_63809651-c64b-4da4-bbee-b46f25e99eef/serve-healthcheck-canary/0.log" Jul 07 14:13:47.773401 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:47.773324 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:47.872816 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:47.872790 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-4lvtr_7183cb56-3853-47da-90e0-6fe704d5f98d/migrator/0.log" Jul 07 14:13:47.875364 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:47.875341 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:48.070061 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:48.069988 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-4lvtr_7183cb56-3853-47da-90e0-6fe704d5f98d/graceful-termination/0.log" Jul 07 14:13:48.151622 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:48.151587 2557 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-b66mb" Jul 07 14:13:48.151745 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:48.151648 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-b66mb" Jul 07 14:13:48.151997 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:48.151985 2557 scope.go:117] "RemoveContainer" containerID="49246a866c82f0188ead70eb6dcbc24be73a91fd9155c433297cba8c26f68794" Jul 07 14:13:48.152152 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:48.152127 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-b66mb_openshift-console-operator(82df755c-beec-4653-96a6-691507fee3e7)\"" pod="openshift-console-operator/console-operator-68b757fb67-b66mb" podUID="82df755c-beec-4653-96a6-691507fee3e7" Jul 07 14:13:48.565321 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:48.565278 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-5d84d45866-prl9z" podUID="6ebe9a1d-a632-4029-a154-663edb83c930" Jul 07 14:13:48.565321 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:48.565278 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rxpf2" podUID="61c55aec-8d5a-486f-8e6d-2ed748969b6e" Jul 07 14:13:48.818991 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:48.818909 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:48.885546 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:48.884469 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:13:48.885546 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:48.884959 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rxpf2" Jul 07 14:13:49.176360 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:49.176248 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:49.285993 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:49.285955 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:49.419385 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:49.419354 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:49.619620 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:49.619589 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:50.215764 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:50.215731 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:50.623813 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:50.623705 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:50.739807 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:50.739764 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01146df7-85d8-46ad-82d2-b625f84dc98d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-82r8c\" (UID: \"01146df7-85d8-46ad-82d2-b625f84dc98d\") " pod="openshift-insights/insights-runtime-extractor-82r8c" Jul 07 14:13:50.739807 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:50.739802 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01146df7-85d8-46ad-82d2-b625f84dc98d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-82r8c\" (UID: \"01146df7-85d8-46ad-82d2-b625f84dc98d\") " pod="openshift-insights/insights-runtime-extractor-82r8c" Jul 07 14:13:50.740065 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:50.739915 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 07 14:13:50.740065 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:50.739914 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 07 14:13:50.740065 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:50.739987 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01146df7-85d8-46ad-82d2-b625f84dc98d-insights-runtime-extractor-tls podName:01146df7-85d8-46ad-82d2-b625f84dc98d nodeName:}" failed. No retries permitted until 2026-07-07 14:13:58.739967899 +0000 UTC m=+292.122805308 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01146df7-85d8-46ad-82d2-b625f84dc98d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-82r8c" (UID: "01146df7-85d8-46ad-82d2-b625f84dc98d") : secret "insights-runtime-extractor-tls" not found Jul 07 14:13:50.740065 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:50.740006 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01146df7-85d8-46ad-82d2-b625f84dc98d-kube-rbac-proxy-cm podName:01146df7-85d8-46ad-82d2-b625f84dc98d nodeName:}" failed. No retries permitted until 2026-07-07 14:13:58.739997026 +0000 UTC m=+292.122834440 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01146df7-85d8-46ad-82d2-b625f84dc98d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-82r8c" (UID: "01146df7-85d8-46ad-82d2-b625f84dc98d") : configmap "kube-rbac-proxy" not found Jul 07 14:13:50.835541 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:50.835472 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:51.237894 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:51.237816 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:51.428712 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:51.428652 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:51.854258 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:51.854214 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:52.030671 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:52.030626 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:52.051466 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:52.051439 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-registry-tls\") pod \"image-registry-5d84d45866-prl9z\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:13:52.051599 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:52.051469 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4139e191-c46c-4737-ac93-784c0df05814-metrics-tls\") pod \"dns-default-m5g66\" (UID: \"4139e191-c46c-4737-ac93-784c0df05814\") " pod="openshift-dns/dns-default-m5g66" Jul 07 14:13:52.051599 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:52.051520 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61c55aec-8d5a-486f-8e6d-2ed748969b6e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rxpf2\" (UID: \"61c55aec-8d5a-486f-8e6d-2ed748969b6e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rxpf2" Jul 07 14:13:52.051677 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:52.051612 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 07 14:13:52.051677 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:52.051672 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61c55aec-8d5a-486f-8e6d-2ed748969b6e-networking-console-plugin-cert podName:61c55aec-8d5a-486f-8e6d-2ed748969b6e nodeName:}" failed. No retries permitted until 2026-07-07 14:15:54.05165372 +0000 UTC m=+407.434491148 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/61c55aec-8d5a-486f-8e6d-2ed748969b6e-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-rxpf2" (UID: "61c55aec-8d5a-486f-8e6d-2ed748969b6e") : secret "networking-console-plugin-cert" not found Jul 07 14:13:52.054122 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:52.054091 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4139e191-c46c-4737-ac93-784c0df05814-metrics-tls\") pod \"dns-default-m5g66\" (UID: \"4139e191-c46c-4737-ac93-784c0df05814\") " pod="openshift-dns/dns-default-m5g66" Jul 07 14:13:52.054122 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:52.054093 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-registry-tls\") pod \"image-registry-5d84d45866-prl9z\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:13:52.188095 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:52.188019 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-6rbz7\"" Jul 07 14:13:52.196337 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:52.196314 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:13:52.231023 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:52.230989 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:52.298600 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:52.298574 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-2225x\"" Jul 07 14:13:52.305899 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:52.305871 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-m5g66" Jul 07 14:13:52.335003 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:52.334972 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d84d45866-prl9z"] Jul 07 14:13:52.338260 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:13:52.338228 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ebe9a1d_a632_4029_a154_663edb83c930.slice/crio-b2ffc6d62cdd345b301dd4912dda5534dcfaa150c58fcb1c2089b093735d1197 WatchSource:0}: Error finding container b2ffc6d62cdd345b301dd4912dda5534dcfaa150c58fcb1c2089b093735d1197: Status 404 returned error can't find the container with id b2ffc6d62cdd345b301dd4912dda5534dcfaa150c58fcb1c2089b093735d1197 Jul 07 14:13:52.457127 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:52.457095 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-m5g66"] Jul 07 14:13:52.460391 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:13:52.460364 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4139e191_c46c_4737_ac93_784c0df05814.slice/crio-0b3281fbbb297f4bb9c7f5e152515106b5b878969da84a023620e82c682e4bf8 WatchSource:0}: Error finding container 0b3281fbbb297f4bb9c7f5e152515106b5b878969da84a023620e82c682e4bf8: Status 404 returned error can't find the container with id 0b3281fbbb297f4bb9c7f5e152515106b5b878969da84a023620e82c682e4bf8 Jul 07 14:13:52.648641 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:52.648611 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:52.724569 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:52.724466 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:52.822032 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:52.821997 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:52.897032 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:52.896995 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m5g66" event={"ID":"4139e191-c46c-4737-ac93-784c0df05814","Type":"ContainerStarted","Data":"0b3281fbbb297f4bb9c7f5e152515106b5b878969da84a023620e82c682e4bf8"} Jul 07 14:13:52.898358 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:52.898334 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d84d45866-prl9z" event={"ID":"6ebe9a1d-a632-4029-a154-663edb83c930","Type":"ContainerStarted","Data":"40a67d1e26210b6af00ec6b6879ca818aa660f180d15d882c709d71ebbb12dc6"} Jul 07 14:13:52.898479 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:52.898378 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d84d45866-prl9z" event={"ID":"6ebe9a1d-a632-4029-a154-663edb83c930","Type":"ContainerStarted","Data":"b2ffc6d62cdd345b301dd4912dda5534dcfaa150c58fcb1c2089b093735d1197"} Jul 07 14:13:52.898546 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:52.898490 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:13:52.938367 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:52.938311 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d84d45866-prl9z" podStartSLOduration=286.938293458 podStartE2EDuration="4m46.938293458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:09:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:13:52.937603202 +0000 UTC m=+286.320440632" watchObservedRunningTime="2026-07-07 14:13:52.938293458 +0000 UTC m=+286.321130913" Jul 07 14:13:53.425972 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:53.425931 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:53.565843 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:53.565798 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7c98b12-be0e-4355-b645-7538f11358f2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nf787\" (UID: \"c7c98b12-be0e-4355-b645-7538f11358f2\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nf787" Jul 07 14:13:53.566050 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:53.565967 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 07 14:13:53.566104 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:13:53.566050 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7c98b12-be0e-4355-b645-7538f11358f2-cluster-monitoring-operator-tls podName:c7c98b12-be0e-4355-b645-7538f11358f2 nodeName:}" failed. No retries permitted until 2026-07-07 14:14:09.566027574 +0000 UTC m=+302.948864985 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c7c98b12-be0e-4355-b645-7538f11358f2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-nf787" (UID: "c7c98b12-be0e-4355-b645-7538f11358f2") : secret "cluster-monitoring-operator-tls" not found Jul 07 14:13:54.063196 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:54.063162 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:54.126094 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:54.126055 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:54.268778 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:54.268738 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:54.622619 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:54.622533 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:54.841621 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:54.841592 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:54.908562 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:54.908466 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m5g66" event={"ID":"4139e191-c46c-4737-ac93-784c0df05814","Type":"ContainerStarted","Data":"32cfa61cfdd1005e8fe19c7ac5d31be65042e05dda21ae4df70ecfc63901ef90"} Jul 07 14:13:54.908715 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:54.908573 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-m5g66" event={"ID":"4139e191-c46c-4737-ac93-784c0df05814","Type":"ContainerStarted","Data":"2466a6bbfd2502b57f0915f037196adc1907768606fdd5210866363da8dcc27e"} Jul 07 14:13:54.908715 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:54.908608 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-m5g66" Jul 07 14:13:54.927358 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:54.927306 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-m5g66" podStartSLOduration=252.025354926 podStartE2EDuration="4m13.927287322s" totalImagesPullingTime="1.901932396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:09:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:13:54.926638464 +0000 UTC m=+288.309475894" watchObservedRunningTime="2026-07-07 14:13:54.927287322 +0000 UTC m=+288.310124757" Jul 07 14:13:55.232075 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:55.232035 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:55.632974 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:55.632892 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:56.042729 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:56.042696 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:56.619065 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:56.619034 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:57.024321 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:57.024288 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:57.217732 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:57.217702 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:57.619630 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:57.619597 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:57.882752 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:57.882677 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:58.025868 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:58.025832 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:58.226519 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:58.226475 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:13:58.814768 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:58.814724 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01146df7-85d8-46ad-82d2-b625f84dc98d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-82r8c\" (UID: \"01146df7-85d8-46ad-82d2-b625f84dc98d\") " pod="openshift-insights/insights-runtime-extractor-82r8c" Jul 07 14:13:58.814768 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:58.814772 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01146df7-85d8-46ad-82d2-b625f84dc98d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-82r8c\" (UID: \"01146df7-85d8-46ad-82d2-b625f84dc98d\") " pod="openshift-insights/insights-runtime-extractor-82r8c" Jul 07 14:13:58.815265 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:58.815235 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01146df7-85d8-46ad-82d2-b625f84dc98d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-82r8c\" (UID: \"01146df7-85d8-46ad-82d2-b625f84dc98d\") " pod="openshift-insights/insights-runtime-extractor-82r8c" Jul 07 14:13:58.817206 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:58.817189 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01146df7-85d8-46ad-82d2-b625f84dc98d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-82r8c\" (UID: \"01146df7-85d8-46ad-82d2-b625f84dc98d\") " pod="openshift-insights/insights-runtime-extractor-82r8c" Jul 07 14:13:58.821219 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:58.821195 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-82r8c" Jul 07 14:13:58.959240 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:58.959203 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-82r8c"] Jul 07 14:13:58.963831 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:13:58.963801 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01146df7_85d8_46ad_82d2_b625f84dc98d.slice/crio-6cd626dbdf30eb8e985793706ddad9081d1713cc97dd6e00dd14c92fdad435f6 WatchSource:0}: Error finding container 6cd626dbdf30eb8e985793706ddad9081d1713cc97dd6e00dd14c92fdad435f6: Status 404 returned error can't find the container with id 6cd626dbdf30eb8e985793706ddad9081d1713cc97dd6e00dd14c92fdad435f6 Jul 07 14:13:59.927890 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:13:59.927843 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-82r8c" event={"ID":"01146df7-85d8-46ad-82d2-b625f84dc98d","Type":"ContainerStarted","Data":"6cd626dbdf30eb8e985793706ddad9081d1713cc97dd6e00dd14c92fdad435f6"} Jul 07 14:14:01.095589 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:14:01.095523 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-rfmz4" podUID="1125d082-9200-4b6f-b03b-1edd11069009" Jul 07 14:14:02.096214 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:02.096181 2557 scope.go:117] "RemoveContainer" containerID="49246a866c82f0188ead70eb6dcbc24be73a91fd9155c433297cba8c26f68794" Jul 07 14:14:02.940241 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:02.940143 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-82r8c" event={"ID":"01146df7-85d8-46ad-82d2-b625f84dc98d","Type":"ContainerStarted","Data":"23ae1326e9ffb36540cd097bc78c3031d29329afa74cadb8523064a82c69ad41"} Jul 07 14:14:02.942272 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:02.942242 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b66mb_82df755c-beec-4653-96a6-691507fee3e7/console-operator/1.log" Jul 07 14:14:02.942399 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:02.942308 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-b66mb" event={"ID":"82df755c-beec-4653-96a6-691507fee3e7","Type":"ContainerStarted","Data":"d9a5f9ead0875b1efdbb9aeff7e9261a86e152c678f05cb9ba82b194b216bdb9"} Jul 07 14:14:02.942649 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:02.942623 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-b66mb" Jul 07 14:14:02.968242 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:02.968188 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-b66mb" podStartSLOduration=23.22774873 podStartE2EDuration="25.968171705s" totalImagesPullingTime="2.740422975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:13:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:14:02.967878593 +0000 UTC m=+296.350716022" watchObservedRunningTime="2026-07-07 14:14:02.968171705 +0000 UTC m=+296.351009171" Jul 07 14:14:02.972327 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:02.972301 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:03.073338 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:03.073305 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:03.138016 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:03.137987 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-b66mb" Jul 07 14:14:03.478752 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:03.478721 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:03.596705 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:03.596673 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:03.872897 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:03.872854 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:03.948404 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:03.948369 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-82r8c" event={"ID":"01146df7-85d8-46ad-82d2-b625f84dc98d","Type":"ContainerStarted","Data":"a060111354d4753c9aacf36c9f3ccda98e1ffd8ea8f8f1c0e35bac8a99adfb8f"} Jul 07 14:14:04.055565 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:04.055463 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:04.149137 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:04.149054 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:04.446880 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:04.446777 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:04.508824 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:04.508793 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:04.700613 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:04.700526 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:04.772963 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:04.772929 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:04.914427 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:04.914400 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-m5g66" Jul 07 14:14:05.235815 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:05.235774 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:05.463282 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:05.463213 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:05.716210 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:05.716175 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:06.864298 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:06.864266 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:06.961854 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:06.961807 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-82r8c" event={"ID":"01146df7-85d8-46ad-82d2-b625f84dc98d","Type":"ContainerStarted","Data":"14788c9a180d1238fbc8277b73fbeb5c108d7c2559f6deb94cfb4294006d7494"} Jul 07 14:14:06.963291 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:06.963266 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:06.969720 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:06.969696 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b66mb_82df755c-beec-4653-96a6-691507fee3e7/console-operator/1.log" Jul 07 14:14:06.970130 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:06.970113 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b66mb_82df755c-beec-4653-96a6-691507fee3e7/console-operator/1.log" Jul 07 14:14:06.980195 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:06.980177 2557 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 14:14:06.982854 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:06.982605 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-82r8c" podStartSLOduration=17.922237064 podStartE2EDuration="24.982589903s" totalImagesPullingTime="7.060352839s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:13:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:14:06.982555493 +0000 UTC m=+300.365392923" watchObservedRunningTime="2026-07-07 14:14:06.982589903 +0000 UTC m=+300.365427331" Jul 07 14:14:09.605147 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:09.605109 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7c98b12-be0e-4355-b645-7538f11358f2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nf787\" (UID: \"c7c98b12-be0e-4355-b645-7538f11358f2\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nf787" Jul 07 14:14:09.607647 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:09.607624 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c7c98b12-be0e-4355-b645-7538f11358f2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-nf787\" (UID: \"c7c98b12-be0e-4355-b645-7538f11358f2\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nf787" Jul 07 14:14:09.612331 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:09.612306 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-4qgfc"] Jul 07 14:14:09.614524 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:09.614491 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-4qgfc" Jul 07 14:14:09.617154 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:09.617132 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-829m2\"" Jul 07 14:14:09.617394 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:09.617380 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 14:14:09.617612 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:09.617597 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 14:14:09.646864 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:09.646837 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-4qgfc"] Jul 07 14:14:09.706454 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:09.706422 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dzbb\" (UniqueName: \"kubernetes.io/projected/10871123-aa0e-4e5e-ad48-7ed10f811dcf-kube-api-access-9dzbb\") pod \"downloads-685bfb5f64-4qgfc\" (UID: \"10871123-aa0e-4e5e-ad48-7ed10f811dcf\") " pod="openshift-console/downloads-685bfb5f64-4qgfc" Jul 07 14:14:09.795051 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:09.795017 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:09.807215 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:09.807182 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dzbb\" (UniqueName: \"kubernetes.io/projected/10871123-aa0e-4e5e-ad48-7ed10f811dcf-kube-api-access-9dzbb\") pod \"downloads-685bfb5f64-4qgfc\" (UID: \"10871123-aa0e-4e5e-ad48-7ed10f811dcf\") " pod="openshift-console/downloads-685bfb5f64-4qgfc" Jul 07 14:14:09.829670 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:09.829634 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dzbb\" (UniqueName: \"kubernetes.io/projected/10871123-aa0e-4e5e-ad48-7ed10f811dcf-kube-api-access-9dzbb\") pod \"downloads-685bfb5f64-4qgfc\" (UID: \"10871123-aa0e-4e5e-ad48-7ed10f811dcf\") " pod="openshift-console/downloads-685bfb5f64-4qgfc" Jul 07 14:14:09.846673 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:09.846639 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-fbts7\"" Jul 07 14:14:09.854397 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:09.854378 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nf787" Jul 07 14:14:09.923486 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:09.923455 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-4qgfc" Jul 07 14:14:10.001152 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:10.001118 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nf787"] Jul 07 14:14:10.004174 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:14:10.004144 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7c98b12_be0e_4355_b645_7538f11358f2.slice/crio-0aa5a16740d92731e8bd63f6b35f6dfaa03ee3bdce07ba2d723cc547c5c8cbb6 WatchSource:0}: Error finding container 0aa5a16740d92731e8bd63f6b35f6dfaa03ee3bdce07ba2d723cc547c5c8cbb6: Status 404 returned error can't find the container with id 0aa5a16740d92731e8bd63f6b35f6dfaa03ee3bdce07ba2d723cc547c5c8cbb6 Jul 07 14:14:10.006253 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:10.006225 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 14:14:10.065458 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:10.065429 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-4qgfc"] Jul 07 14:14:10.068780 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:14:10.068748 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10871123_aa0e_4e5e_ad48_7ed10f811dcf.slice/crio-f978c34981b3415754e8c41504a36ce552634a5938264097d09b7cfdffa5d184 WatchSource:0}: Error finding container f978c34981b3415754e8c41504a36ce552634a5938264097d09b7cfdffa5d184: Status 404 returned error can't find the container with id f978c34981b3415754e8c41504a36ce552634a5938264097d09b7cfdffa5d184 Jul 07 14:14:10.978727 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:10.978641 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-4qgfc" event={"ID":"10871123-aa0e-4e5e-ad48-7ed10f811dcf","Type":"ContainerStarted","Data":"f978c34981b3415754e8c41504a36ce552634a5938264097d09b7cfdffa5d184"} Jul 07 14:14:10.980640 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:10.980607 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nf787" event={"ID":"c7c98b12-be0e-4355-b645-7538f11358f2","Type":"ContainerStarted","Data":"0aa5a16740d92731e8bd63f6b35f6dfaa03ee3bdce07ba2d723cc547c5c8cbb6"} Jul 07 14:14:11.240379 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:11.240304 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:11.844326 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:11.844289 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:11.916820 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:11.916783 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:12.202917 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:12.202823 2557 patch_prober.go:28] interesting pod/image-registry-5d84d45866-prl9z container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 07 14:14:12.203341 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:12.202900 2557 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-5d84d45866-prl9z" podUID="6ebe9a1d-a632-4029-a154-663edb83c930" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 14:14:12.629755 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:12.629708 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:12.730548 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:12.730498 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:12.808542 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:12.808474 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:12.809305 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:12.809269 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-74kgl"] Jul 07 14:14:12.811678 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:12.811654 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-74kgl" Jul 07 14:14:12.813944 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:12.813884 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-cz4f7\"" Jul 07 14:14:12.814420 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:12.814257 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 07 14:14:12.825326 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:12.825301 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-74kgl"] Jul 07 14:14:12.933910 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:12.933821 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/841cca3a-a3f5-44c1-9908-061069bb22ce-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-74kgl\" (UID: \"841cca3a-a3f5-44c1-9908-061069bb22ce\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-74kgl" Jul 07 14:14:12.990648 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:12.990611 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nf787" event={"ID":"c7c98b12-be0e-4355-b645-7538f11358f2","Type":"ContainerStarted","Data":"21d0e98d676973b6649c5b0a66afe99d7ba8d1773bc2ca60da97fddb4fe190cf"} Jul 07 14:14:13.011674 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:13.011414 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-nf787" podStartSLOduration=33.733292137 podStartE2EDuration="36.01139093s" totalImagesPullingTime="2.278098793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:13:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:14:13.010682207 +0000 UTC m=+306.393519653" watchObservedRunningTime="2026-07-07 14:14:13.01139093 +0000 UTC m=+306.394228362" Jul 07 14:14:13.034559 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:13.034497 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/841cca3a-a3f5-44c1-9908-061069bb22ce-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-74kgl\" (UID: \"841cca3a-a3f5-44c1-9908-061069bb22ce\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-74kgl" Jul 07 14:14:13.034763 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:14:13.034667 2557 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 07 14:14:13.034763 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:14:13.034754 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/841cca3a-a3f5-44c1-9908-061069bb22ce-tls-certificates podName:841cca3a-a3f5-44c1-9908-061069bb22ce nodeName:}" failed. No retries permitted until 2026-07-07 14:14:13.534731444 +0000 UTC m=+306.917568853 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/841cca3a-a3f5-44c1-9908-061069bb22ce-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-74kgl" (UID: "841cca3a-a3f5-44c1-9908-061069bb22ce") : secret "prometheus-operator-admission-webhook-tls" not found Jul 07 14:14:13.129360 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:13.129294 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:13.538572 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:13.538537 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/841cca3a-a3f5-44c1-9908-061069bb22ce-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-74kgl\" (UID: \"841cca3a-a3f5-44c1-9908-061069bb22ce\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-74kgl" Jul 07 14:14:13.541613 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:13.541585 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/841cca3a-a3f5-44c1-9908-061069bb22ce-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-74kgl\" (UID: \"841cca3a-a3f5-44c1-9908-061069bb22ce\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-74kgl" Jul 07 14:14:13.723056 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:13.723014 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-74kgl" Jul 07 14:14:13.869629 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:13.869599 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-74kgl"] Jul 07 14:14:13.872660 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:14:13.872631 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod841cca3a_a3f5_44c1_9908_061069bb22ce.slice/crio-a6848aea62d359fea16f0a033c220e3155c3405d25d3cc5089a027f9fc2f8fd0 WatchSource:0}: Error finding container a6848aea62d359fea16f0a033c220e3155c3405d25d3cc5089a027f9fc2f8fd0: Status 404 returned error can't find the container with id a6848aea62d359fea16f0a033c220e3155c3405d25d3cc5089a027f9fc2f8fd0 Jul 07 14:14:13.908995 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:13.908958 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:14:13.996047 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:13.995996 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-74kgl" event={"ID":"841cca3a-a3f5-44c1-9908-061069bb22ce","Type":"ContainerStarted","Data":"a6848aea62d359fea16f0a033c220e3155c3405d25d3cc5089a027f9fc2f8fd0"} Jul 07 14:14:14.266397 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:14.266355 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:14.384844 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:14.384805 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:15.095119 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:15.095079 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:14:16.005415 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:16.005375 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-74kgl" event={"ID":"841cca3a-a3f5-44c1-9908-061069bb22ce","Type":"ContainerStarted","Data":"1af8c6918d31964bcee0c4a4b22fea399d6a02199f484af985c5c7bc8cc6fcac"} Jul 07 14:14:16.005602 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:16.005562 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-74kgl" Jul 07 14:14:16.010133 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:16.010108 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-74kgl" Jul 07 14:14:16.024028 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:16.023983 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-74kgl" podStartSLOduration=2.700799451 podStartE2EDuration="4.023969468s" totalImagesPullingTime="1.323170017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:14:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:14:16.023824757 +0000 UTC m=+309.406662187" watchObservedRunningTime="2026-07-07 14:14:16.023969468 +0000 UTC m=+309.406806897" Jul 07 14:14:16.839499 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:16.839462 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:16.878181 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:16.878143 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-4w89b"] Jul 07 14:14:16.880397 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:16.880374 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4w89b" Jul 07 14:14:16.882754 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:16.882731 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 07 14:14:16.883560 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:16.883544 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 14:14:16.883608 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:16.883567 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 07 14:14:16.883608 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:16.883589 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-728mp\"" Jul 07 14:14:16.892558 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:16.892537 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-4w89b"] Jul 07 14:14:16.911150 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:16.911126 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:16.968523 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:16.968475 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xswgz\" (UniqueName: \"kubernetes.io/projected/a7f86a3c-98a0-4a35-bdee-e9a5e6d2324d-kube-api-access-xswgz\") pod \"prometheus-operator-567f7b8b7c-4w89b\" (UID: \"a7f86a3c-98a0-4a35-bdee-e9a5e6d2324d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4w89b" Jul 07 14:14:16.968693 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:16.968576 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7f86a3c-98a0-4a35-bdee-e9a5e6d2324d-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-4w89b\" (UID: \"a7f86a3c-98a0-4a35-bdee-e9a5e6d2324d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4w89b" Jul 07 14:14:16.968693 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:16.968631 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7f86a3c-98a0-4a35-bdee-e9a5e6d2324d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-4w89b\" (UID: \"a7f86a3c-98a0-4a35-bdee-e9a5e6d2324d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4w89b" Jul 07 14:14:16.968693 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:16.968650 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7f86a3c-98a0-4a35-bdee-e9a5e6d2324d-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-4w89b\" (UID: \"a7f86a3c-98a0-4a35-bdee-e9a5e6d2324d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4w89b" Jul 07 14:14:16.974928 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:16.974860 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:17.069904 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:17.069852 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xswgz\" (UniqueName: \"kubernetes.io/projected/a7f86a3c-98a0-4a35-bdee-e9a5e6d2324d-kube-api-access-xswgz\") pod \"prometheus-operator-567f7b8b7c-4w89b\" (UID: \"a7f86a3c-98a0-4a35-bdee-e9a5e6d2324d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4w89b" Jul 07 14:14:17.069904 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:17.069908 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7f86a3c-98a0-4a35-bdee-e9a5e6d2324d-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-4w89b\" (UID: \"a7f86a3c-98a0-4a35-bdee-e9a5e6d2324d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4w89b" Jul 07 14:14:17.070145 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:17.069963 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7f86a3c-98a0-4a35-bdee-e9a5e6d2324d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-4w89b\" (UID: \"a7f86a3c-98a0-4a35-bdee-e9a5e6d2324d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4w89b" Jul 07 14:14:17.070145 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:17.069990 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7f86a3c-98a0-4a35-bdee-e9a5e6d2324d-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-4w89b\" (UID: \"a7f86a3c-98a0-4a35-bdee-e9a5e6d2324d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4w89b" Jul 07 14:14:17.070847 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:17.070786 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a7f86a3c-98a0-4a35-bdee-e9a5e6d2324d-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-4w89b\" (UID: \"a7f86a3c-98a0-4a35-bdee-e9a5e6d2324d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4w89b" Jul 07 14:14:17.072946 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:17.072920 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a7f86a3c-98a0-4a35-bdee-e9a5e6d2324d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-4w89b\" (UID: \"a7f86a3c-98a0-4a35-bdee-e9a5e6d2324d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4w89b" Jul 07 14:14:17.073077 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:17.073059 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a7f86a3c-98a0-4a35-bdee-e9a5e6d2324d-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-4w89b\" (UID: \"a7f86a3c-98a0-4a35-bdee-e9a5e6d2324d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4w89b" Jul 07 14:14:17.082120 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:17.082097 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xswgz\" (UniqueName: \"kubernetes.io/projected/a7f86a3c-98a0-4a35-bdee-e9a5e6d2324d-kube-api-access-xswgz\") pod \"prometheus-operator-567f7b8b7c-4w89b\" (UID: \"a7f86a3c-98a0-4a35-bdee-e9a5e6d2324d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4w89b" Jul 07 14:14:17.189080 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:17.188998 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4w89b" Jul 07 14:14:17.326531 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:17.326473 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-4w89b"] Jul 07 14:14:17.329630 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:14:17.329599 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7f86a3c_98a0_4a35_bdee_e9a5e6d2324d.slice/crio-af1602d86a510a95487e6d6916ad3b5bfa4de1ce1e154021b1a452e81de7fb04 WatchSource:0}: Error finding container af1602d86a510a95487e6d6916ad3b5bfa4de1ce1e154021b1a452e81de7fb04: Status 404 returned error can't find the container with id af1602d86a510a95487e6d6916ad3b5bfa4de1ce1e154021b1a452e81de7fb04 Jul 07 14:14:18.018376 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:18.018337 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4w89b" event={"ID":"a7f86a3c-98a0-4a35-bdee-e9a5e6d2324d","Type":"ContainerStarted","Data":"af1602d86a510a95487e6d6916ad3b5bfa4de1ce1e154021b1a452e81de7fb04"} Jul 07 14:14:18.792224 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:18.791328 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:19.024297 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:19.024261 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4w89b" event={"ID":"a7f86a3c-98a0-4a35-bdee-e9a5e6d2324d","Type":"ContainerStarted","Data":"67fc6edfb6c2c3d67842e38823d37c190c760ece4a518e163d2cff08fb69edcc"} Jul 07 14:14:19.024782 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:19.024327 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4w89b" event={"ID":"a7f86a3c-98a0-4a35-bdee-e9a5e6d2324d","Type":"ContainerStarted","Data":"22e486268525ef17b516e60159b9f48b4ecb67f4ae7382b3d645c17f183da8c8"} Jul 07 14:14:19.043415 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:19.043314 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4w89b" podStartSLOduration=1.540197628 podStartE2EDuration="3.043294401s" totalImagesPullingTime="1.503096773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:14:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:14:19.041429444 +0000 UTC m=+312.424266874" watchObservedRunningTime="2026-07-07 14:14:19.043294401 +0000 UTC m=+312.426131832" Jul 07 14:14:19.132902 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:19.132861 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:19.345848 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:19.345759 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:19.416484 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:19.416448 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:20.856821 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:20.856789 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77c65ffbb9-g7hng"] Jul 07 14:14:20.858895 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:20.858871 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77c65ffbb9-g7hng" Jul 07 14:14:20.862822 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:20.862798 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 14:14:20.862822 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:20.862811 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 14:14:20.864077 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:20.864053 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-8njng\"" Jul 07 14:14:20.864077 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:20.864072 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 14:14:20.864250 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:20.864059 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 14:14:20.864250 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:20.864130 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 14:14:20.868486 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:20.868459 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:20.869126 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:20.869109 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 14:14:20.875337 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:20.875278 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77c65ffbb9-g7hng"] Jul 07 14:14:20.954217 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:20.954178 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:21.003138 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.003098 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c3b96f44-0335-4da3-92cc-a62de698d7c1-service-ca\") pod \"console-77c65ffbb9-g7hng\" (UID: \"c3b96f44-0335-4da3-92cc-a62de698d7c1\") " pod="openshift-console/console-77c65ffbb9-g7hng" Jul 07 14:14:21.003138 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.003150 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3b96f44-0335-4da3-92cc-a62de698d7c1-trusted-ca-bundle\") pod \"console-77c65ffbb9-g7hng\" (UID: \"c3b96f44-0335-4da3-92cc-a62de698d7c1\") " pod="openshift-console/console-77c65ffbb9-g7hng" Jul 07 14:14:21.003431 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.003200 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c3b96f44-0335-4da3-92cc-a62de698d7c1-console-serving-cert\") pod \"console-77c65ffbb9-g7hng\" (UID: \"c3b96f44-0335-4da3-92cc-a62de698d7c1\") " pod="openshift-console/console-77c65ffbb9-g7hng" Jul 07 14:14:21.003431 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.003226 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s42rd\" (UniqueName: \"kubernetes.io/projected/c3b96f44-0335-4da3-92cc-a62de698d7c1-kube-api-access-s42rd\") pod \"console-77c65ffbb9-g7hng\" (UID: \"c3b96f44-0335-4da3-92cc-a62de698d7c1\") " pod="openshift-console/console-77c65ffbb9-g7hng" Jul 07 14:14:21.003431 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.003298 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c3b96f44-0335-4da3-92cc-a62de698d7c1-console-oauth-config\") pod \"console-77c65ffbb9-g7hng\" (UID: \"c3b96f44-0335-4da3-92cc-a62de698d7c1\") " pod="openshift-console/console-77c65ffbb9-g7hng" Jul 07 14:14:21.003627 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.003521 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c3b96f44-0335-4da3-92cc-a62de698d7c1-oauth-serving-cert\") pod \"console-77c65ffbb9-g7hng\" (UID: \"c3b96f44-0335-4da3-92cc-a62de698d7c1\") " pod="openshift-console/console-77c65ffbb9-g7hng" Jul 07 14:14:21.003627 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.003559 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c3b96f44-0335-4da3-92cc-a62de698d7c1-console-config\") pod \"console-77c65ffbb9-g7hng\" (UID: \"c3b96f44-0335-4da3-92cc-a62de698d7c1\") " pod="openshift-console/console-77c65ffbb9-g7hng" Jul 07 14:14:21.039485 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.039445 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:21.104868 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.104834 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c3b96f44-0335-4da3-92cc-a62de698d7c1-service-ca\") pod \"console-77c65ffbb9-g7hng\" (UID: \"c3b96f44-0335-4da3-92cc-a62de698d7c1\") " pod="openshift-console/console-77c65ffbb9-g7hng" Jul 07 14:14:21.104868 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.104864 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3b96f44-0335-4da3-92cc-a62de698d7c1-trusted-ca-bundle\") pod \"console-77c65ffbb9-g7hng\" (UID: \"c3b96f44-0335-4da3-92cc-a62de698d7c1\") " pod="openshift-console/console-77c65ffbb9-g7hng" Jul 07 14:14:21.105095 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.104899 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c3b96f44-0335-4da3-92cc-a62de698d7c1-console-serving-cert\") pod \"console-77c65ffbb9-g7hng\" (UID: \"c3b96f44-0335-4da3-92cc-a62de698d7c1\") " pod="openshift-console/console-77c65ffbb9-g7hng" Jul 07 14:14:21.105095 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.104921 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s42rd\" (UniqueName: \"kubernetes.io/projected/c3b96f44-0335-4da3-92cc-a62de698d7c1-kube-api-access-s42rd\") pod \"console-77c65ffbb9-g7hng\" (UID: \"c3b96f44-0335-4da3-92cc-a62de698d7c1\") " pod="openshift-console/console-77c65ffbb9-g7hng" Jul 07 14:14:21.105095 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.104953 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c3b96f44-0335-4da3-92cc-a62de698d7c1-console-oauth-config\") pod \"console-77c65ffbb9-g7hng\" (UID: \"c3b96f44-0335-4da3-92cc-a62de698d7c1\") " pod="openshift-console/console-77c65ffbb9-g7hng" Jul 07 14:14:21.105095 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.104997 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c3b96f44-0335-4da3-92cc-a62de698d7c1-oauth-serving-cert\") pod \"console-77c65ffbb9-g7hng\" (UID: \"c3b96f44-0335-4da3-92cc-a62de698d7c1\") " pod="openshift-console/console-77c65ffbb9-g7hng" Jul 07 14:14:21.105095 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.105021 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c3b96f44-0335-4da3-92cc-a62de698d7c1-console-config\") pod \"console-77c65ffbb9-g7hng\" (UID: \"c3b96f44-0335-4da3-92cc-a62de698d7c1\") " pod="openshift-console/console-77c65ffbb9-g7hng" Jul 07 14:14:21.105675 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.105641 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c3b96f44-0335-4da3-92cc-a62de698d7c1-service-ca\") pod \"console-77c65ffbb9-g7hng\" (UID: \"c3b96f44-0335-4da3-92cc-a62de698d7c1\") " pod="openshift-console/console-77c65ffbb9-g7hng" Jul 07 14:14:21.105799 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.105782 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c3b96f44-0335-4da3-92cc-a62de698d7c1-oauth-serving-cert\") pod \"console-77c65ffbb9-g7hng\" (UID: \"c3b96f44-0335-4da3-92cc-a62de698d7c1\") " pod="openshift-console/console-77c65ffbb9-g7hng" Jul 07 14:14:21.105978 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.105963 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3b96f44-0335-4da3-92cc-a62de698d7c1-trusted-ca-bundle\") pod \"console-77c65ffbb9-g7hng\" (UID: \"c3b96f44-0335-4da3-92cc-a62de698d7c1\") " pod="openshift-console/console-77c65ffbb9-g7hng" Jul 07 14:14:21.106025 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.106004 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c3b96f44-0335-4da3-92cc-a62de698d7c1-console-config\") pod \"console-77c65ffbb9-g7hng\" (UID: \"c3b96f44-0335-4da3-92cc-a62de698d7c1\") " pod="openshift-console/console-77c65ffbb9-g7hng" Jul 07 14:14:21.107598 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.107552 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c3b96f44-0335-4da3-92cc-a62de698d7c1-console-serving-cert\") pod \"console-77c65ffbb9-g7hng\" (UID: \"c3b96f44-0335-4da3-92cc-a62de698d7c1\") " pod="openshift-console/console-77c65ffbb9-g7hng" Jul 07 14:14:21.107755 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.107738 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c3b96f44-0335-4da3-92cc-a62de698d7c1-console-oauth-config\") pod \"console-77c65ffbb9-g7hng\" (UID: \"c3b96f44-0335-4da3-92cc-a62de698d7c1\") " pod="openshift-console/console-77c65ffbb9-g7hng" Jul 07 14:14:21.114647 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.114621 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s42rd\" (UniqueName: \"kubernetes.io/projected/c3b96f44-0335-4da3-92cc-a62de698d7c1-kube-api-access-s42rd\") pod \"console-77c65ffbb9-g7hng\" (UID: \"c3b96f44-0335-4da3-92cc-a62de698d7c1\") " pod="openshift-console/console-77c65ffbb9-g7hng" Jul 07 14:14:21.141000 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.140957 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:21.170405 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.170360 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77c65ffbb9-g7hng" Jul 07 14:14:21.246590 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.246448 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:21.342188 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.342153 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:21.355386 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.355355 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77c65ffbb9-g7hng"] Jul 07 14:14:21.356798 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.356763 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cjwvj"] Jul 07 14:14:21.359077 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:14:21.358993 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3b96f44_0335_4da3_92cc_a62de698d7c1.slice/crio-4945fa488e4932a776fa9ad44b13b1ba518c1fd83e5af2756b65ae0e41d5e15a WatchSource:0}: Error finding container 4945fa488e4932a776fa9ad44b13b1ba518c1fd83e5af2756b65ae0e41d5e15a: Status 404 returned error can't find the container with id 4945fa488e4932a776fa9ad44b13b1ba518c1fd83e5af2756b65ae0e41d5e15a Jul 07 14:14:21.359925 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.359830 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cjwvj" Jul 07 14:14:21.362050 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.362027 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 14:14:21.362166 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.362144 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 14:14:21.362288 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.362211 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 14:14:21.362470 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.362450 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-z45xp\"" Jul 07 14:14:21.418632 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.418582 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:21.487171 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.487131 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:21.511624 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.511592 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/03942954-a5e7-453f-9a32-00cded70d110-root\") pod \"node-exporter-cjwvj\" (UID: \"03942954-a5e7-453f-9a32-00cded70d110\") " pod="openshift-monitoring/node-exporter-cjwvj" Jul 07 14:14:21.511787 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.511635 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03942954-a5e7-453f-9a32-00cded70d110-node-exporter-tls\") pod \"node-exporter-cjwvj\" (UID: \"03942954-a5e7-453f-9a32-00cded70d110\") " pod="openshift-monitoring/node-exporter-cjwvj" Jul 07 14:14:21.511787 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.511691 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/03942954-a5e7-453f-9a32-00cded70d110-node-exporter-accelerators-collector-config\") pod \"node-exporter-cjwvj\" (UID: \"03942954-a5e7-453f-9a32-00cded70d110\") " pod="openshift-monitoring/node-exporter-cjwvj" Jul 07 14:14:21.511787 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.511738 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03942954-a5e7-453f-9a32-00cded70d110-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cjwvj\" (UID: \"03942954-a5e7-453f-9a32-00cded70d110\") " pod="openshift-monitoring/node-exporter-cjwvj" Jul 07 14:14:21.511787 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.511766 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/03942954-a5e7-453f-9a32-00cded70d110-node-exporter-wtmp\") pod \"node-exporter-cjwvj\" (UID: \"03942954-a5e7-453f-9a32-00cded70d110\") " pod="openshift-monitoring/node-exporter-cjwvj" Jul 07 14:14:21.512006 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.511802 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/03942954-a5e7-453f-9a32-00cded70d110-node-exporter-textfile\") pod \"node-exporter-cjwvj\" (UID: \"03942954-a5e7-453f-9a32-00cded70d110\") " pod="openshift-monitoring/node-exporter-cjwvj" Jul 07 14:14:21.512006 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.511856 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03942954-a5e7-453f-9a32-00cded70d110-sys\") pod \"node-exporter-cjwvj\" (UID: \"03942954-a5e7-453f-9a32-00cded70d110\") " pod="openshift-monitoring/node-exporter-cjwvj" Jul 07 14:14:21.512006 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.511879 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03942954-a5e7-453f-9a32-00cded70d110-metrics-client-ca\") pod \"node-exporter-cjwvj\" (UID: \"03942954-a5e7-453f-9a32-00cded70d110\") " pod="openshift-monitoring/node-exporter-cjwvj" Jul 07 14:14:21.512006 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.511894 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrxsg\" (UniqueName: \"kubernetes.io/projected/03942954-a5e7-453f-9a32-00cded70d110-kube-api-access-hrxsg\") pod \"node-exporter-cjwvj\" (UID: \"03942954-a5e7-453f-9a32-00cded70d110\") " pod="openshift-monitoring/node-exporter-cjwvj" Jul 07 14:14:21.592897 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.592856 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:21.612987 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.612903 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03942954-a5e7-453f-9a32-00cded70d110-sys\") pod \"node-exporter-cjwvj\" (UID: \"03942954-a5e7-453f-9a32-00cded70d110\") " pod="openshift-monitoring/node-exporter-cjwvj" Jul 07 14:14:21.612987 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.612957 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03942954-a5e7-453f-9a32-00cded70d110-metrics-client-ca\") pod \"node-exporter-cjwvj\" (UID: \"03942954-a5e7-453f-9a32-00cded70d110\") " pod="openshift-monitoring/node-exporter-cjwvj" Jul 07 14:14:21.613204 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.613034 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03942954-a5e7-453f-9a32-00cded70d110-sys\") pod \"node-exporter-cjwvj\" (UID: \"03942954-a5e7-453f-9a32-00cded70d110\") " pod="openshift-monitoring/node-exporter-cjwvj" Jul 07 14:14:21.613204 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.613077 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrxsg\" (UniqueName: \"kubernetes.io/projected/03942954-a5e7-453f-9a32-00cded70d110-kube-api-access-hrxsg\") pod \"node-exporter-cjwvj\" (UID: \"03942954-a5e7-453f-9a32-00cded70d110\") " pod="openshift-monitoring/node-exporter-cjwvj" Jul 07 14:14:21.613204 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.613138 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/03942954-a5e7-453f-9a32-00cded70d110-root\") pod \"node-exporter-cjwvj\" (UID: \"03942954-a5e7-453f-9a32-00cded70d110\") " pod="openshift-monitoring/node-exporter-cjwvj" Jul 07 14:14:21.613204 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.613172 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03942954-a5e7-453f-9a32-00cded70d110-node-exporter-tls\") pod \"node-exporter-cjwvj\" (UID: \"03942954-a5e7-453f-9a32-00cded70d110\") " pod="openshift-monitoring/node-exporter-cjwvj" Jul 07 14:14:21.613400 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.613225 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/03942954-a5e7-453f-9a32-00cded70d110-node-exporter-accelerators-collector-config\") pod \"node-exporter-cjwvj\" (UID: \"03942954-a5e7-453f-9a32-00cded70d110\") " pod="openshift-monitoring/node-exporter-cjwvj" Jul 07 14:14:21.613400 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.613252 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/03942954-a5e7-453f-9a32-00cded70d110-root\") pod \"node-exporter-cjwvj\" (UID: \"03942954-a5e7-453f-9a32-00cded70d110\") " pod="openshift-monitoring/node-exporter-cjwvj" Jul 07 14:14:21.613400 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.613274 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03942954-a5e7-453f-9a32-00cded70d110-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cjwvj\" (UID: \"03942954-a5e7-453f-9a32-00cded70d110\") " pod="openshift-monitoring/node-exporter-cjwvj" Jul 07 14:14:21.613400 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.613303 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/03942954-a5e7-453f-9a32-00cded70d110-node-exporter-wtmp\") pod \"node-exporter-cjwvj\" (UID: \"03942954-a5e7-453f-9a32-00cded70d110\") " pod="openshift-monitoring/node-exporter-cjwvj" Jul 07 14:14:21.613400 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.613336 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/03942954-a5e7-453f-9a32-00cded70d110-node-exporter-textfile\") pod \"node-exporter-cjwvj\" (UID: \"03942954-a5e7-453f-9a32-00cded70d110\") " pod="openshift-monitoring/node-exporter-cjwvj" Jul 07 14:14:21.613627 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.613578 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03942954-a5e7-453f-9a32-00cded70d110-metrics-client-ca\") pod \"node-exporter-cjwvj\" (UID: \"03942954-a5e7-453f-9a32-00cded70d110\") " pod="openshift-monitoring/node-exporter-cjwvj" Jul 07 14:14:21.613627 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.613585 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/03942954-a5e7-453f-9a32-00cded70d110-node-exporter-wtmp\") pod \"node-exporter-cjwvj\" (UID: \"03942954-a5e7-453f-9a32-00cded70d110\") " pod="openshift-monitoring/node-exporter-cjwvj" Jul 07 14:14:21.613942 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.613807 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/03942954-a5e7-453f-9a32-00cded70d110-node-exporter-textfile\") pod \"node-exporter-cjwvj\" (UID: \"03942954-a5e7-453f-9a32-00cded70d110\") " pod="openshift-monitoring/node-exporter-cjwvj" Jul 07 14:14:21.614015 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.613942 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/03942954-a5e7-453f-9a32-00cded70d110-node-exporter-accelerators-collector-config\") pod \"node-exporter-cjwvj\" (UID: \"03942954-a5e7-453f-9a32-00cded70d110\") " pod="openshift-monitoring/node-exporter-cjwvj" Jul 07 14:14:21.615969 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.615950 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03942954-a5e7-453f-9a32-00cded70d110-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cjwvj\" (UID: \"03942954-a5e7-453f-9a32-00cded70d110\") " pod="openshift-monitoring/node-exporter-cjwvj" Jul 07 14:14:21.616175 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.616157 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/03942954-a5e7-453f-9a32-00cded70d110-node-exporter-tls\") pod \"node-exporter-cjwvj\" (UID: \"03942954-a5e7-453f-9a32-00cded70d110\") " pod="openshift-monitoring/node-exporter-cjwvj" Jul 07 14:14:21.622841 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.622816 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrxsg\" (UniqueName: \"kubernetes.io/projected/03942954-a5e7-453f-9a32-00cded70d110-kube-api-access-hrxsg\") pod \"node-exporter-cjwvj\" (UID: \"03942954-a5e7-453f-9a32-00cded70d110\") " pod="openshift-monitoring/node-exporter-cjwvj" Jul 07 14:14:21.671544 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.671483 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cjwvj" Jul 07 14:14:21.681658 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:14:21.681634 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03942954_a5e7_453f_9a32_00cded70d110.slice/crio-f08fd198ee35e827f4104d060510eb01007b3e90b8a873622eaf9584f358eaac WatchSource:0}: Error finding container f08fd198ee35e827f4104d060510eb01007b3e90b8a873622eaf9584f358eaac: Status 404 returned error can't find the container with id f08fd198ee35e827f4104d060510eb01007b3e90b8a873622eaf9584f358eaac Jul 07 14:14:21.693046 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:21.693019 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:22.041732 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:22.041689 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cjwvj" event={"ID":"03942954-a5e7-453f-9a32-00cded70d110","Type":"ContainerStarted","Data":"f08fd198ee35e827f4104d060510eb01007b3e90b8a873622eaf9584f358eaac"} Jul 07 14:14:22.044649 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:22.044616 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77c65ffbb9-g7hng" event={"ID":"c3b96f44-0335-4da3-92cc-a62de698d7c1","Type":"ContainerStarted","Data":"4945fa488e4932a776fa9ad44b13b1ba518c1fd83e5af2756b65ae0e41d5e15a"} Jul 07 14:14:22.261338 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:22.261292 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:22.370190 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:22.370100 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:23.053731 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.053598 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cjwvj" event={"ID":"03942954-a5e7-453f-9a32-00cded70d110","Type":"ContainerStarted","Data":"4ea7010395b8c892d59ca4d3e36e05011f234842dc9fd5579acc711d4488c052"} Jul 07 14:14:23.083560 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.083528 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:23.391098 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.391060 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7645b4c468-gbh8w"] Jul 07 14:14:23.394449 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.394421 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" Jul 07 14:14:23.397695 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.397659 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 07 14:14:23.398011 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.397982 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7fihrduuh3tii\"" Jul 07 14:14:23.398079 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.398028 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-v9t74\"" Jul 07 14:14:23.398168 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.398151 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 07 14:14:23.398591 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.398570 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 07 14:14:23.398796 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.398776 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 07 14:14:23.398867 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.398809 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 07 14:14:23.409585 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.409551 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7645b4c468-gbh8w"] Jul 07 14:14:23.529997 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.529959 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxp8s\" (UniqueName: \"kubernetes.io/projected/9eb98939-d529-4d08-b1e0-bb7286271149-kube-api-access-lxp8s\") pod \"thanos-querier-7645b4c468-gbh8w\" (UID: \"9eb98939-d529-4d08-b1e0-bb7286271149\") " pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" Jul 07 14:14:23.530178 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.530109 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9eb98939-d529-4d08-b1e0-bb7286271149-secret-thanos-querier-tls\") pod \"thanos-querier-7645b4c468-gbh8w\" (UID: \"9eb98939-d529-4d08-b1e0-bb7286271149\") " pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" Jul 07 14:14:23.530178 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.530151 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9eb98939-d529-4d08-b1e0-bb7286271149-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7645b4c468-gbh8w\" (UID: \"9eb98939-d529-4d08-b1e0-bb7286271149\") " pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" Jul 07 14:14:23.530310 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.530199 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9eb98939-d529-4d08-b1e0-bb7286271149-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7645b4c468-gbh8w\" (UID: \"9eb98939-d529-4d08-b1e0-bb7286271149\") " pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" Jul 07 14:14:23.530310 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.530234 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9eb98939-d529-4d08-b1e0-bb7286271149-secret-grpc-tls\") pod \"thanos-querier-7645b4c468-gbh8w\" (UID: \"9eb98939-d529-4d08-b1e0-bb7286271149\") " pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" Jul 07 14:14:23.530310 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.530271 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9eb98939-d529-4d08-b1e0-bb7286271149-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7645b4c468-gbh8w\" (UID: \"9eb98939-d529-4d08-b1e0-bb7286271149\") " pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" Jul 07 14:14:23.530454 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.530346 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9eb98939-d529-4d08-b1e0-bb7286271149-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7645b4c468-gbh8w\" (UID: \"9eb98939-d529-4d08-b1e0-bb7286271149\") " pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" Jul 07 14:14:23.530454 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.530376 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9eb98939-d529-4d08-b1e0-bb7286271149-metrics-client-ca\") pod \"thanos-querier-7645b4c468-gbh8w\" (UID: \"9eb98939-d529-4d08-b1e0-bb7286271149\") " pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" Jul 07 14:14:23.631051 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.631013 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9eb98939-d529-4d08-b1e0-bb7286271149-secret-thanos-querier-tls\") pod \"thanos-querier-7645b4c468-gbh8w\" (UID: \"9eb98939-d529-4d08-b1e0-bb7286271149\") " pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" Jul 07 14:14:23.631219 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.631063 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9eb98939-d529-4d08-b1e0-bb7286271149-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7645b4c468-gbh8w\" (UID: \"9eb98939-d529-4d08-b1e0-bb7286271149\") " pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" Jul 07 14:14:23.631219 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.631093 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9eb98939-d529-4d08-b1e0-bb7286271149-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7645b4c468-gbh8w\" (UID: \"9eb98939-d529-4d08-b1e0-bb7286271149\") " pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" Jul 07 14:14:23.631329 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.631266 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9eb98939-d529-4d08-b1e0-bb7286271149-secret-grpc-tls\") pod \"thanos-querier-7645b4c468-gbh8w\" (UID: \"9eb98939-d529-4d08-b1e0-bb7286271149\") " pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" Jul 07 14:14:23.631388 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.631322 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9eb98939-d529-4d08-b1e0-bb7286271149-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7645b4c468-gbh8w\" (UID: \"9eb98939-d529-4d08-b1e0-bb7286271149\") " pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" Jul 07 14:14:23.631437 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.631395 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9eb98939-d529-4d08-b1e0-bb7286271149-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7645b4c468-gbh8w\" (UID: \"9eb98939-d529-4d08-b1e0-bb7286271149\") " pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" Jul 07 14:14:23.631437 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.631426 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9eb98939-d529-4d08-b1e0-bb7286271149-metrics-client-ca\") pod \"thanos-querier-7645b4c468-gbh8w\" (UID: \"9eb98939-d529-4d08-b1e0-bb7286271149\") " pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" Jul 07 14:14:23.631558 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.631497 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxp8s\" (UniqueName: \"kubernetes.io/projected/9eb98939-d529-4d08-b1e0-bb7286271149-kube-api-access-lxp8s\") pod \"thanos-querier-7645b4c468-gbh8w\" (UID: \"9eb98939-d529-4d08-b1e0-bb7286271149\") " pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" Jul 07 14:14:23.632602 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.632490 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9eb98939-d529-4d08-b1e0-bb7286271149-metrics-client-ca\") pod \"thanos-querier-7645b4c468-gbh8w\" (UID: \"9eb98939-d529-4d08-b1e0-bb7286271149\") " pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" Jul 07 14:14:23.634878 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.634831 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9eb98939-d529-4d08-b1e0-bb7286271149-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7645b4c468-gbh8w\" (UID: \"9eb98939-d529-4d08-b1e0-bb7286271149\") " pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" Jul 07 14:14:23.635619 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.635597 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9eb98939-d529-4d08-b1e0-bb7286271149-secret-thanos-querier-tls\") pod \"thanos-querier-7645b4c468-gbh8w\" (UID: \"9eb98939-d529-4d08-b1e0-bb7286271149\") " pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" Jul 07 14:14:23.635716 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.635624 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9eb98939-d529-4d08-b1e0-bb7286271149-secret-grpc-tls\") pod \"thanos-querier-7645b4c468-gbh8w\" (UID: \"9eb98939-d529-4d08-b1e0-bb7286271149\") " pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" Jul 07 14:14:23.635923 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.635900 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9eb98939-d529-4d08-b1e0-bb7286271149-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7645b4c468-gbh8w\" (UID: \"9eb98939-d529-4d08-b1e0-bb7286271149\") " pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" Jul 07 14:14:23.636009 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.635963 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9eb98939-d529-4d08-b1e0-bb7286271149-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7645b4c468-gbh8w\" (UID: \"9eb98939-d529-4d08-b1e0-bb7286271149\") " pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" Jul 07 14:14:23.636665 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.636642 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9eb98939-d529-4d08-b1e0-bb7286271149-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7645b4c468-gbh8w\" (UID: \"9eb98939-d529-4d08-b1e0-bb7286271149\") " pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" Jul 07 14:14:23.643440 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.643373 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxp8s\" (UniqueName: \"kubernetes.io/projected/9eb98939-d529-4d08-b1e0-bb7286271149-kube-api-access-lxp8s\") pod \"thanos-querier-7645b4c468-gbh8w\" (UID: \"9eb98939-d529-4d08-b1e0-bb7286271149\") " pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" Jul 07 14:14:23.709719 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:23.709604 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" Jul 07 14:14:24.059475 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:24.059435 2557 generic.go:356] "Generic (PLEG): container finished" podID="03942954-a5e7-453f-9a32-00cded70d110" containerID="4ea7010395b8c892d59ca4d3e36e05011f234842dc9fd5579acc711d4488c052" exitCode=0 Jul 07 14:14:24.059962 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:24.059483 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cjwvj" event={"ID":"03942954-a5e7-453f-9a32-00cded70d110","Type":"ContainerDied","Data":"4ea7010395b8c892d59ca4d3e36e05011f234842dc9fd5579acc711d4488c052"} Jul 07 14:14:24.415940 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:24.415849 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:24.522847 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:24.522800 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:24.712212 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:24.712177 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:24.939300 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:24.939272 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:24.955926 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:24.955899 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7645b4c468-gbh8w"] Jul 07 14:14:24.959079 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:14:24.959004 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eb98939_d529_4d08_b1e0_bb7286271149.slice/crio-028aaa14d2ea4ee183eca1f92372f264a1cb1b00b5def26c8320d5c64d436af3 WatchSource:0}: Error finding container 028aaa14d2ea4ee183eca1f92372f264a1cb1b00b5def26c8320d5c64d436af3: Status 404 returned error can't find the container with id 028aaa14d2ea4ee183eca1f92372f264a1cb1b00b5def26c8320d5c64d436af3 Jul 07 14:14:25.065225 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:25.065192 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77c65ffbb9-g7hng" event={"ID":"c3b96f44-0335-4da3-92cc-a62de698d7c1","Type":"ContainerStarted","Data":"a39e6c499dba53bc0de05e9ee4dd9e596360613bd922a1c34eea5bdd96121afe"} Jul 07 14:14:25.067578 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:25.067550 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cjwvj" event={"ID":"03942954-a5e7-453f-9a32-00cded70d110","Type":"ContainerStarted","Data":"5fd3aab770418723347b2235b044d6f15eaddd35378efaeb29852c4ac5172348"} Jul 07 14:14:25.067724 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:25.067606 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cjwvj" event={"ID":"03942954-a5e7-453f-9a32-00cded70d110","Type":"ContainerStarted","Data":"4f1722e75be92fd4f55f15742b92cf0fb2ed8459b9918d9ad7ca64c54432d7b9"} Jul 07 14:14:25.069129 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:25.069110 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" event={"ID":"9eb98939-d529-4d08-b1e0-bb7286271149","Type":"ContainerStarted","Data":"028aaa14d2ea4ee183eca1f92372f264a1cb1b00b5def26c8320d5c64d436af3"} Jul 07 14:14:25.085797 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:25.085737 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77c65ffbb9-g7hng" podStartSLOduration=1.618568578 podStartE2EDuration="5.085715341s" totalImagesPullingTime="3.467146763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:14:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:14:25.084587991 +0000 UTC m=+318.467425421" watchObservedRunningTime="2026-07-07 14:14:25.085715341 +0000 UTC m=+318.468552772" Jul 07 14:14:25.106018 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:25.105967 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cjwvj" podStartSLOduration=2.7743860700000003 podStartE2EDuration="4.105950656s" totalImagesPullingTime="1.240261447s" totalInitContainerRuntime="91.303139ms" isStatefulPod=true podCreationTimestamp="2026-07-07 14:14:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:14:25.104999511 +0000 UTC m=+318.487836943" watchObservedRunningTime="2026-07-07 14:14:25.105950656 +0000 UTC m=+318.488788086" Jul 07 14:14:25.306473 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:25.306388 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:26.052760 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:26.052706 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:26.158075 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:26.158033 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:26.366490 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:26.366395 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:27.729094 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.729055 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 14:14:27.732313 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.732285 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.735885 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.735857 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 07 14:14:27.736163 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.736108 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 07 14:14:27.736335 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.736318 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 07 14:14:27.736553 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.736497 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 07 14:14:27.736736 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.736720 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 07 14:14:27.737328 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.737307 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2svsj\"" Jul 07 14:14:27.738864 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.737598 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 07 14:14:27.738864 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.737813 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 07 14:14:27.738864 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.738013 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 07 14:14:27.739076 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.738876 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:27.739076 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.738885 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 07 14:14:27.739076 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.738966 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 07 14:14:27.739076 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.739023 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 07 14:14:27.739076 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.739048 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 07 14:14:27.739076 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.738928 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 07 14:14:27.739343 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.739153 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 07 14:14:27.739343 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.739213 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-f4dupl8gkigkp\"" Jul 07 14:14:27.741103 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.740940 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 07 14:14:27.748495 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.748470 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 14:14:27.874937 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.874897 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/452f29ea-3939-445d-a829-81263509c1b3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.875118 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.874944 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/452f29ea-3939-445d-a829-81263509c1b3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.875118 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.874965 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s59bx\" (UniqueName: \"kubernetes.io/projected/452f29ea-3939-445d-a829-81263509c1b3-kube-api-access-s59bx\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.875118 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.874990 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/452f29ea-3939-445d-a829-81263509c1b3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.875118 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.875059 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/452f29ea-3939-445d-a829-81263509c1b3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.875118 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.875089 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/452f29ea-3939-445d-a829-81263509c1b3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.875359 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.875123 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/452f29ea-3939-445d-a829-81263509c1b3-config-out\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.875359 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.875155 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/452f29ea-3939-445d-a829-81263509c1b3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.875359 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.875193 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/452f29ea-3939-445d-a829-81263509c1b3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.875359 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.875226 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/452f29ea-3939-445d-a829-81263509c1b3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.875359 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.875244 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/452f29ea-3939-445d-a829-81263509c1b3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.875359 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.875302 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/452f29ea-3939-445d-a829-81263509c1b3-config\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.875359 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.875353 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/452f29ea-3939-445d-a829-81263509c1b3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.875687 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.875448 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/452f29ea-3939-445d-a829-81263509c1b3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.875687 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.875483 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/452f29ea-3939-445d-a829-81263509c1b3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.875687 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.875534 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/452f29ea-3939-445d-a829-81263509c1b3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.875687 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.875564 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/452f29ea-3939-445d-a829-81263509c1b3-web-config\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.875687 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.875617 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/452f29ea-3939-445d-a829-81263509c1b3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.875687 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.875663 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/452f29ea-3939-445d-a829-81263509c1b3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.875938 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.875734 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/452f29ea-3939-445d-a829-81263509c1b3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.976401 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.976359 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/452f29ea-3939-445d-a829-81263509c1b3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.976401 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.976403 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s59bx\" (UniqueName: \"kubernetes.io/projected/452f29ea-3939-445d-a829-81263509c1b3-kube-api-access-s59bx\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.976662 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.976437 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/452f29ea-3939-445d-a829-81263509c1b3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.976662 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.976478 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/452f29ea-3939-445d-a829-81263509c1b3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.976662 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.976529 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/452f29ea-3939-445d-a829-81263509c1b3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.976662 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.976557 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/452f29ea-3939-445d-a829-81263509c1b3-config-out\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.976662 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.976582 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/452f29ea-3939-445d-a829-81263509c1b3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.976662 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.976605 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/452f29ea-3939-445d-a829-81263509c1b3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.976662 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.976633 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/452f29ea-3939-445d-a829-81263509c1b3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.976662 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.976656 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/452f29ea-3939-445d-a829-81263509c1b3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.977113 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.976686 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/452f29ea-3939-445d-a829-81263509c1b3-config\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.977593 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.977260 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/452f29ea-3939-445d-a829-81263509c1b3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.977593 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.977423 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/452f29ea-3939-445d-a829-81263509c1b3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.980673 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.980587 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/452f29ea-3939-445d-a829-81263509c1b3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.980673 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.980640 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/452f29ea-3939-445d-a829-81263509c1b3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.980874 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.980674 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/452f29ea-3939-445d-a829-81263509c1b3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.980874 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.980747 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/452f29ea-3939-445d-a829-81263509c1b3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.980874 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.980779 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/452f29ea-3939-445d-a829-81263509c1b3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.980874 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.980804 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/452f29ea-3939-445d-a829-81263509c1b3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.980874 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.980834 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/452f29ea-3939-445d-a829-81263509c1b3-web-config\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.981194 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.980875 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/452f29ea-3939-445d-a829-81263509c1b3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.981194 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.980900 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/452f29ea-3939-445d-a829-81263509c1b3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.981194 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.980929 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/452f29ea-3939-445d-a829-81263509c1b3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.981194 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.980985 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/452f29ea-3939-445d-a829-81263509c1b3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.981594 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.981573 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/452f29ea-3939-445d-a829-81263509c1b3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.981664 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.981647 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/452f29ea-3939-445d-a829-81263509c1b3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.983648 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.983605 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/452f29ea-3939-445d-a829-81263509c1b3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.984064 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.984035 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/452f29ea-3939-445d-a829-81263509c1b3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.984157 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.984095 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/452f29ea-3939-445d-a829-81263509c1b3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.984294 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.984268 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/452f29ea-3939-445d-a829-81263509c1b3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.984363 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.984294 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/452f29ea-3939-445d-a829-81263509c1b3-config-out\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.984976 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.984874 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/452f29ea-3939-445d-a829-81263509c1b3-config\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.985068 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.984960 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/452f29ea-3939-445d-a829-81263509c1b3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.985655 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.985630 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/452f29ea-3939-445d-a829-81263509c1b3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.992332 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.992303 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/452f29ea-3939-445d-a829-81263509c1b3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.992575 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.992557 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/452f29ea-3939-445d-a829-81263509c1b3-web-config\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.993795 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.993769 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/452f29ea-3939-445d-a829-81263509c1b3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.993981 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.993884 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/452f29ea-3939-445d-a829-81263509c1b3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:27.997333 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:27.997287 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/452f29ea-3939-445d-a829-81263509c1b3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:28.000397 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:28.000351 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s59bx\" (UniqueName: \"kubernetes.io/projected/452f29ea-3939-445d-a829-81263509c1b3-kube-api-access-s59bx\") pod \"prometheus-k8s-0\" (UID: \"452f29ea-3939-445d-a829-81263509c1b3\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:28.045334 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:28.045290 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:28.472299 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:28.472256 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:28.606865 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:28.606832 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:28.679484 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:28.679446 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77c65ffbb9-g7hng"] Jul 07 14:14:31.171055 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:31.171015 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77c65ffbb9-g7hng" Jul 07 14:14:31.507574 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:31.507541 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d84d45866-prl9z"] Jul 07 14:14:31.614034 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:31.613992 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:31.720661 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:31.720623 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:32.511563 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:32.511521 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 07 14:14:32.561160 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:14:32.561126 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod452f29ea_3939_445d_a829_81263509c1b3.slice/crio-f61c1cd8992269d48ae110f0c4b73788abe952afb69978157bb0aa0ac14a7d7f WatchSource:0}: Error finding container f61c1cd8992269d48ae110f0c4b73788abe952afb69978157bb0aa0ac14a7d7f: Status 404 returned error can't find the container with id f61c1cd8992269d48ae110f0c4b73788abe952afb69978157bb0aa0ac14a7d7f Jul 07 14:14:32.694066 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:32.694017 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:32.977272 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:32.977237 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:33.052529 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:33.052475 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:33.109687 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:33.109650 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"452f29ea-3939-445d-a829-81263509c1b3","Type":"ContainerStarted","Data":"f61c1cd8992269d48ae110f0c4b73788abe952afb69978157bb0aa0ac14a7d7f"} Jul 07 14:14:33.111351 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:33.111316 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-4qgfc" event={"ID":"10871123-aa0e-4e5e-ad48-7ed10f811dcf","Type":"ContainerStarted","Data":"2855c618dec917a5fe57bcfd078db5fd2cdd722eec4c04c4c7673a80933c2f2b"} Jul 07 14:14:33.111616 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:33.111566 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-4qgfc" Jul 07 14:14:33.123796 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:33.123767 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-4qgfc" Jul 07 14:14:33.130854 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:33.130783 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-4qgfc" podStartSLOduration=1.5693346419999998 podStartE2EDuration="24.130764989s" totalImagesPullingTime="22.561430347s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:14:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:14:33.130702505 +0000 UTC m=+326.513539935" watchObservedRunningTime="2026-07-07 14:14:33.130764989 +0000 UTC m=+326.513602420" Jul 07 14:14:36.128781 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:36.128739 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" event={"ID":"9eb98939-d529-4d08-b1e0-bb7286271149","Type":"ContainerStarted","Data":"fb45e04378f86e4702b55ba5840a35455f8a1a4d8173fbcec9ad750e9ee2b5f4"} Jul 07 14:14:36.129276 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:36.128968 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" event={"ID":"9eb98939-d529-4d08-b1e0-bb7286271149","Type":"ContainerStarted","Data":"869cc33330178a63e66da0a1b1bf6e13c84552e51a0a79326399f034e0d5749b"} Jul 07 14:14:36.129276 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:36.129021 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" event={"ID":"9eb98939-d529-4d08-b1e0-bb7286271149","Type":"ContainerStarted","Data":"c4d3085b1920cc5f4727bc03d183b0649d56989623947940b7ef52b0817352d8"} Jul 07 14:14:36.131300 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:36.131261 2557 generic.go:356] "Generic (PLEG): container finished" podID="452f29ea-3939-445d-a829-81263509c1b3" containerID="a48f5e04914b8a93c5690caeaeb3d28f28ac8604d03a55134dc6d16d34556aea" exitCode=0 Jul 07 14:14:36.131465 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:36.131371 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"452f29ea-3939-445d-a829-81263509c1b3","Type":"ContainerDied","Data":"a48f5e04914b8a93c5690caeaeb3d28f28ac8604d03a55134dc6d16d34556aea"} Jul 07 14:14:37.146325 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:37.146285 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" event={"ID":"9eb98939-d529-4d08-b1e0-bb7286271149","Type":"ContainerStarted","Data":"0f420ad32a0847b10f80b290b34f2072ba59df439cd654417cf3acaa4eb96889"} Jul 07 14:14:37.146781 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:37.146371 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" event={"ID":"9eb98939-d529-4d08-b1e0-bb7286271149","Type":"ContainerStarted","Data":"30d2c90dbba3af52a01b13ece4f952cee251d6bdcdd690e9d2013a75b0eaf0ed"} Jul 07 14:14:38.156755 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:38.156714 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" event={"ID":"9eb98939-d529-4d08-b1e0-bb7286271149","Type":"ContainerStarted","Data":"9f7833eff5ac4024c548d11914c3d6dd7d58f61471a74a5d21275f347b23bce9"} Jul 07 14:14:38.157196 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:38.156958 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" Jul 07 14:14:38.204200 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:38.204128 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" podStartSLOduration=3.691222211 podStartE2EDuration="15.204105488s" totalImagesPullingTime="11.512883277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:14:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:14:38.19187305 +0000 UTC m=+331.574710479" watchObservedRunningTime="2026-07-07 14:14:38.204105488 +0000 UTC m=+331.586942919" Jul 07 14:14:39.420220 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:39.420176 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:39.520842 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:39.520757 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:39.626148 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:39.626109 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:41.184433 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:41.184231 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"452f29ea-3939-445d-a829-81263509c1b3","Type":"ContainerStarted","Data":"d49bb7cc78b64cd76cd33631998ca65a14473b18b9170a4e9153f4c6861891c6"} Jul 07 14:14:42.126650 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:42.126588 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:42.192473 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:42.192434 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"452f29ea-3939-445d-a829-81263509c1b3","Type":"ContainerStarted","Data":"89642d9c7270fefb40334b9eb1a0d00cc61aae4035645ce7441d03ae9b4cb164"} Jul 07 14:14:42.192974 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:42.192572 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"452f29ea-3939-445d-a829-81263509c1b3","Type":"ContainerStarted","Data":"a7ff2207266318e7fd47031f805dcd857336f7b742c0240055d25350ddea4103"} Jul 07 14:14:42.192974 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:42.192604 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"452f29ea-3939-445d-a829-81263509c1b3","Type":"ContainerStarted","Data":"6c7c992cc53457600fe975ac7bcfe7cf00edafd46b06bdb13c995a84e949a93a"} Jul 07 14:14:42.192974 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:42.192637 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"452f29ea-3939-445d-a829-81263509c1b3","Type":"ContainerStarted","Data":"fefe9a2da1d1a04af126b41cfceda514d702625fea9b9389b159e4a6e54aa17d"} Jul 07 14:14:42.192974 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:42.192677 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"452f29ea-3939-445d-a829-81263509c1b3","Type":"ContainerStarted","Data":"3977e75f772ab6a826c90e592be6784358fd3ead9890839fac612f488c48f0e5"} Jul 07 14:14:42.196440 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:42.196413 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:42.233070 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:42.233014 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=7.763579941 podStartE2EDuration="15.23298847s" totalImagesPullingTime="7.437911231s" totalInitContainerRuntime="31.497298ms" isStatefulPod=false podCreationTimestamp="2026-07-07 14:14:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:14:42.23094818 +0000 UTC m=+335.613785612" watchObservedRunningTime="2026-07-07 14:14:42.23298847 +0000 UTC m=+335.615825900" Jul 07 14:14:43.045832 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:43.045800 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:14:44.169485 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:44.169455 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7645b4c468-gbh8w" Jul 07 14:14:47.976659 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:47.976623 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:48.077007 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:48.076925 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:53.703383 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:53.703334 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-77c65ffbb9-g7hng" podUID="c3b96f44-0335-4da3-92cc-a62de698d7c1" containerName="console" containerID="cri-o://a39e6c499dba53bc0de05e9ee4dd9e596360613bd922a1c34eea5bdd96121afe" gracePeriod=15 Jul 07 14:14:53.986781 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:53.986748 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77c65ffbb9-g7hng" Jul 07 14:14:54.150118 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:54.150084 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c3b96f44-0335-4da3-92cc-a62de698d7c1-console-oauth-config\") pod \"c3b96f44-0335-4da3-92cc-a62de698d7c1\" (UID: \"c3b96f44-0335-4da3-92cc-a62de698d7c1\") " Jul 07 14:14:54.150315 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:54.150144 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c3b96f44-0335-4da3-92cc-a62de698d7c1-service-ca\") pod \"c3b96f44-0335-4da3-92cc-a62de698d7c1\" (UID: \"c3b96f44-0335-4da3-92cc-a62de698d7c1\") " Jul 07 14:14:54.150315 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:54.150165 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c3b96f44-0335-4da3-92cc-a62de698d7c1-console-config\") pod \"c3b96f44-0335-4da3-92cc-a62de698d7c1\" (UID: \"c3b96f44-0335-4da3-92cc-a62de698d7c1\") " Jul 07 14:14:54.150315 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:54.150207 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c3b96f44-0335-4da3-92cc-a62de698d7c1-console-serving-cert\") pod \"c3b96f44-0335-4da3-92cc-a62de698d7c1\" (UID: \"c3b96f44-0335-4da3-92cc-a62de698d7c1\") " Jul 07 14:14:54.150315 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:54.150247 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c3b96f44-0335-4da3-92cc-a62de698d7c1-oauth-serving-cert\") pod \"c3b96f44-0335-4da3-92cc-a62de698d7c1\" (UID: \"c3b96f44-0335-4da3-92cc-a62de698d7c1\") " Jul 07 14:14:54.150315 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:54.150304 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3b96f44-0335-4da3-92cc-a62de698d7c1-trusted-ca-bundle\") pod \"c3b96f44-0335-4da3-92cc-a62de698d7c1\" (UID: \"c3b96f44-0335-4da3-92cc-a62de698d7c1\") " Jul 07 14:14:54.150596 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:54.150340 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s42rd\" (UniqueName: \"kubernetes.io/projected/c3b96f44-0335-4da3-92cc-a62de698d7c1-kube-api-access-s42rd\") pod \"c3b96f44-0335-4da3-92cc-a62de698d7c1\" (UID: \"c3b96f44-0335-4da3-92cc-a62de698d7c1\") " Jul 07 14:14:54.151049 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:54.150814 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3b96f44-0335-4da3-92cc-a62de698d7c1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c3b96f44-0335-4da3-92cc-a62de698d7c1" (UID: "c3b96f44-0335-4da3-92cc-a62de698d7c1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:14:54.151049 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:54.150898 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3b96f44-0335-4da3-92cc-a62de698d7c1-service-ca" (OuterVolumeSpecName: "service-ca") pod "c3b96f44-0335-4da3-92cc-a62de698d7c1" (UID: "c3b96f44-0335-4da3-92cc-a62de698d7c1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:14:54.151232 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:54.151144 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3b96f44-0335-4da3-92cc-a62de698d7c1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c3b96f44-0335-4da3-92cc-a62de698d7c1" (UID: "c3b96f44-0335-4da3-92cc-a62de698d7c1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:14:54.151293 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:54.151247 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3b96f44-0335-4da3-92cc-a62de698d7c1-console-config" (OuterVolumeSpecName: "console-config") pod "c3b96f44-0335-4da3-92cc-a62de698d7c1" (UID: "c3b96f44-0335-4da3-92cc-a62de698d7c1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:14:54.153382 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:54.153353 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3b96f44-0335-4da3-92cc-a62de698d7c1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c3b96f44-0335-4da3-92cc-a62de698d7c1" (UID: "c3b96f44-0335-4da3-92cc-a62de698d7c1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:14:54.153382 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:54.153355 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3b96f44-0335-4da3-92cc-a62de698d7c1-kube-api-access-s42rd" (OuterVolumeSpecName: "kube-api-access-s42rd") pod "c3b96f44-0335-4da3-92cc-a62de698d7c1" (UID: "c3b96f44-0335-4da3-92cc-a62de698d7c1"). InnerVolumeSpecName "kube-api-access-s42rd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:14:54.153549 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:54.153530 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3b96f44-0335-4da3-92cc-a62de698d7c1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c3b96f44-0335-4da3-92cc-a62de698d7c1" (UID: "c3b96f44-0335-4da3-92cc-a62de698d7c1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:14:54.248499 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:54.248410 2557 generic.go:356] "Generic (PLEG): container finished" podID="c3b96f44-0335-4da3-92cc-a62de698d7c1" containerID="a39e6c499dba53bc0de05e9ee4dd9e596360613bd922a1c34eea5bdd96121afe" exitCode=0 Jul 07 14:14:54.248499 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:54.248458 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77c65ffbb9-g7hng" Jul 07 14:14:54.248499 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:54.248517 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77c65ffbb9-g7hng" event={"ID":"c3b96f44-0335-4da3-92cc-a62de698d7c1","Type":"ContainerDied","Data":"a39e6c499dba53bc0de05e9ee4dd9e596360613bd922a1c34eea5bdd96121afe"} Jul 07 14:14:54.248818 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:54.248574 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77c65ffbb9-g7hng" event={"ID":"c3b96f44-0335-4da3-92cc-a62de698d7c1","Type":"ContainerDied","Data":"4945fa488e4932a776fa9ad44b13b1ba518c1fd83e5af2756b65ae0e41d5e15a"} Jul 07 14:14:54.248818 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:54.248599 2557 scope.go:117] "RemoveContainer" containerID="a39e6c499dba53bc0de05e9ee4dd9e596360613bd922a1c34eea5bdd96121afe" Jul 07 14:14:54.251817 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:54.251793 2557 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c3b96f44-0335-4da3-92cc-a62de698d7c1-console-serving-cert\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 07 14:14:54.251906 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:54.251823 2557 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c3b96f44-0335-4da3-92cc-a62de698d7c1-oauth-serving-cert\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 07 14:14:54.251906 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:54.251837 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3b96f44-0335-4da3-92cc-a62de698d7c1-trusted-ca-bundle\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 07 14:14:54.251906 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:54.251851 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s42rd\" (UniqueName: \"kubernetes.io/projected/c3b96f44-0335-4da3-92cc-a62de698d7c1-kube-api-access-s42rd\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 07 14:14:54.251906 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:54.251865 2557 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c3b96f44-0335-4da3-92cc-a62de698d7c1-console-oauth-config\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 07 14:14:54.251906 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:54.251879 2557 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c3b96f44-0335-4da3-92cc-a62de698d7c1-service-ca\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 07 14:14:54.251906 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:54.251893 2557 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c3b96f44-0335-4da3-92cc-a62de698d7c1-console-config\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 07 14:14:54.258698 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:54.258681 2557 scope.go:117] "RemoveContainer" containerID="a39e6c499dba53bc0de05e9ee4dd9e596360613bd922a1c34eea5bdd96121afe" Jul 07 14:14:54.259059 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:14:54.259037 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a39e6c499dba53bc0de05e9ee4dd9e596360613bd922a1c34eea5bdd96121afe\": container with ID starting with a39e6c499dba53bc0de05e9ee4dd9e596360613bd922a1c34eea5bdd96121afe not found: ID does not exist" containerID="a39e6c499dba53bc0de05e9ee4dd9e596360613bd922a1c34eea5bdd96121afe" Jul 07 14:14:54.259135 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:54.259066 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a39e6c499dba53bc0de05e9ee4dd9e596360613bd922a1c34eea5bdd96121afe"} err="failed to get container status \"a39e6c499dba53bc0de05e9ee4dd9e596360613bd922a1c34eea5bdd96121afe\": rpc error: code = NotFound desc = could not find container \"a39e6c499dba53bc0de05e9ee4dd9e596360613bd922a1c34eea5bdd96121afe\": container with ID starting with a39e6c499dba53bc0de05e9ee4dd9e596360613bd922a1c34eea5bdd96121afe not found: ID does not exist" Jul 07 14:14:54.272304 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:54.272267 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77c65ffbb9-g7hng"] Jul 07 14:14:54.276320 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:54.276295 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77c65ffbb9-g7hng"] Jul 07 14:14:55.100949 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:55.100915 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3b96f44-0335-4da3-92cc-a62de698d7c1" path="/var/lib/kubelet/pods/c3b96f44-0335-4da3-92cc-a62de698d7c1/volumes" Jul 07 14:14:56.530934 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:56.530885 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5d84d45866-prl9z" podUID="6ebe9a1d-a632-4029-a154-663edb83c930" containerName="registry" containerID="cri-o://40a67d1e26210b6af00ec6b6879ca818aa660f180d15d882c709d71ebbb12dc6" gracePeriod=30 Jul 07 14:14:56.823041 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:56.823006 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:14:56.974967 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:56.974935 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6ebe9a1d-a632-4029-a154-663edb83c930-trusted-ca\") pod \"6ebe9a1d-a632-4029-a154-663edb83c930\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " Jul 07 14:14:56.975179 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:56.974993 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6ebe9a1d-a632-4029-a154-663edb83c930-ca-trust-extracted\") pod \"6ebe9a1d-a632-4029-a154-663edb83c930\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " Jul 07 14:14:56.975179 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:56.975010 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-registry-tls\") pod \"6ebe9a1d-a632-4029-a154-663edb83c930\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " Jul 07 14:14:56.975179 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:56.975045 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-bound-sa-token\") pod \"6ebe9a1d-a632-4029-a154-663edb83c930\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " Jul 07 14:14:56.975179 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:56.975070 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6ebe9a1d-a632-4029-a154-663edb83c930-registry-certificates\") pod \"6ebe9a1d-a632-4029-a154-663edb83c930\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " Jul 07 14:14:56.975179 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:56.975086 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6ebe9a1d-a632-4029-a154-663edb83c930-installation-pull-secrets\") pod \"6ebe9a1d-a632-4029-a154-663edb83c930\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " Jul 07 14:14:56.975179 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:56.975123 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6ebe9a1d-a632-4029-a154-663edb83c930-image-registry-private-configuration\") pod \"6ebe9a1d-a632-4029-a154-663edb83c930\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " Jul 07 14:14:56.975179 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:56.975156 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pr7g2\" (UniqueName: \"kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-kube-api-access-pr7g2\") pod \"6ebe9a1d-a632-4029-a154-663edb83c930\" (UID: \"6ebe9a1d-a632-4029-a154-663edb83c930\") " Jul 07 14:14:56.975573 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:56.975358 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ebe9a1d-a632-4029-a154-663edb83c930-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "6ebe9a1d-a632-4029-a154-663edb83c930" (UID: "6ebe9a1d-a632-4029-a154-663edb83c930"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:14:56.975573 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:56.975450 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6ebe9a1d-a632-4029-a154-663edb83c930-trusted-ca\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 07 14:14:56.975792 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:56.975770 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ebe9a1d-a632-4029-a154-663edb83c930-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "6ebe9a1d-a632-4029-a154-663edb83c930" (UID: "6ebe9a1d-a632-4029-a154-663edb83c930"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:14:56.978090 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:56.978058 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ebe9a1d-a632-4029-a154-663edb83c930-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "6ebe9a1d-a632-4029-a154-663edb83c930" (UID: "6ebe9a1d-a632-4029-a154-663edb83c930"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:14:56.978206 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:56.978110 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-kube-api-access-pr7g2" (OuterVolumeSpecName: "kube-api-access-pr7g2") pod "6ebe9a1d-a632-4029-a154-663edb83c930" (UID: "6ebe9a1d-a632-4029-a154-663edb83c930"). InnerVolumeSpecName "kube-api-access-pr7g2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:14:56.978206 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:56.978155 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "6ebe9a1d-a632-4029-a154-663edb83c930" (UID: "6ebe9a1d-a632-4029-a154-663edb83c930"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:14:56.978206 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:56.978171 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "6ebe9a1d-a632-4029-a154-663edb83c930" (UID: "6ebe9a1d-a632-4029-a154-663edb83c930"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:14:56.978382 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:56.978298 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ebe9a1d-a632-4029-a154-663edb83c930-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "6ebe9a1d-a632-4029-a154-663edb83c930" (UID: "6ebe9a1d-a632-4029-a154-663edb83c930"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:14:56.983672 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:56.983648 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ebe9a1d-a632-4029-a154-663edb83c930-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "6ebe9a1d-a632-4029-a154-663edb83c930" (UID: "6ebe9a1d-a632-4029-a154-663edb83c930"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:14:57.076795 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:57.076707 2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6ebe9a1d-a632-4029-a154-663edb83c930-ca-trust-extracted\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 07 14:14:57.076795 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:57.076736 2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-registry-tls\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 07 14:14:57.076795 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:57.076746 2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-bound-sa-token\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 07 14:14:57.076795 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:57.076755 2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6ebe9a1d-a632-4029-a154-663edb83c930-registry-certificates\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 07 14:14:57.076795 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:57.076763 2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6ebe9a1d-a632-4029-a154-663edb83c930-installation-pull-secrets\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 07 14:14:57.076795 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:57.076772 2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6ebe9a1d-a632-4029-a154-663edb83c930-image-registry-private-configuration\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 07 14:14:57.076795 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:57.076781 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pr7g2\" (UniqueName: \"kubernetes.io/projected/6ebe9a1d-a632-4029-a154-663edb83c930-kube-api-access-pr7g2\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 07 14:14:57.262592 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:57.262548 2557 generic.go:356] "Generic (PLEG): container finished" podID="6ebe9a1d-a632-4029-a154-663edb83c930" containerID="40a67d1e26210b6af00ec6b6879ca818aa660f180d15d882c709d71ebbb12dc6" exitCode=0 Jul 07 14:14:57.262771 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:57.262616 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d84d45866-prl9z" Jul 07 14:14:57.262771 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:57.262630 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d84d45866-prl9z" event={"ID":"6ebe9a1d-a632-4029-a154-663edb83c930","Type":"ContainerDied","Data":"40a67d1e26210b6af00ec6b6879ca818aa660f180d15d882c709d71ebbb12dc6"} Jul 07 14:14:57.262771 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:57.262710 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d84d45866-prl9z" event={"ID":"6ebe9a1d-a632-4029-a154-663edb83c930","Type":"ContainerDied","Data":"b2ffc6d62cdd345b301dd4912dda5534dcfaa150c58fcb1c2089b093735d1197"} Jul 07 14:14:57.262771 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:57.262731 2557 scope.go:117] "RemoveContainer" containerID="40a67d1e26210b6af00ec6b6879ca818aa660f180d15d882c709d71ebbb12dc6" Jul 07 14:14:57.270985 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:57.270966 2557 scope.go:117] "RemoveContainer" containerID="40a67d1e26210b6af00ec6b6879ca818aa660f180d15d882c709d71ebbb12dc6" Jul 07 14:14:57.271259 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:14:57.271241 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40a67d1e26210b6af00ec6b6879ca818aa660f180d15d882c709d71ebbb12dc6\": container with ID starting with 40a67d1e26210b6af00ec6b6879ca818aa660f180d15d882c709d71ebbb12dc6 not found: ID does not exist" containerID="40a67d1e26210b6af00ec6b6879ca818aa660f180d15d882c709d71ebbb12dc6" Jul 07 14:14:57.271336 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:57.271266 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40a67d1e26210b6af00ec6b6879ca818aa660f180d15d882c709d71ebbb12dc6"} err="failed to get container status \"40a67d1e26210b6af00ec6b6879ca818aa660f180d15d882c709d71ebbb12dc6\": rpc error: code = NotFound desc = could not find container \"40a67d1e26210b6af00ec6b6879ca818aa660f180d15d882c709d71ebbb12dc6\": container with ID starting with 40a67d1e26210b6af00ec6b6879ca818aa660f180d15d882c709d71ebbb12dc6 not found: ID does not exist" Jul 07 14:14:57.281234 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:57.281207 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d84d45866-prl9z"] Jul 07 14:14:57.287664 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:57.287641 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5d84d45866-prl9z"] Jul 07 14:14:59.100868 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:59.100835 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ebe9a1d-a632-4029-a154-663edb83c930" path="/var/lib/kubelet/pods/6ebe9a1d-a632-4029-a154-663edb83c930/volumes" Jul 07 14:14:59.447039 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:59.446969 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:14:59.511130 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:14:59.511100 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:15:07.306017 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:07.305915 2557 generic.go:356] "Generic (PLEG): container finished" podID="1eefdda1-18e3-429d-ad78-2f0b93e00b2e" containerID="d93eb9456d2d4fbbbe3205b453ba927330ff4150e7854b4faa9a519915bca46d" exitCode=0 Jul 07 14:15:07.306017 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:07.305981 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-ntqmk" event={"ID":"1eefdda1-18e3-429d-ad78-2f0b93e00b2e","Type":"ContainerDied","Data":"d93eb9456d2d4fbbbe3205b453ba927330ff4150e7854b4faa9a519915bca46d"} Jul 07 14:15:07.306535 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:07.306312 2557 scope.go:117] "RemoveContainer" containerID="d93eb9456d2d4fbbbe3205b453ba927330ff4150e7854b4faa9a519915bca46d" Jul 07 14:15:08.312304 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:08.312268 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-ntqmk" event={"ID":"1eefdda1-18e3-429d-ad78-2f0b93e00b2e","Type":"ContainerStarted","Data":"6d76fbde32a5cd59eafd3e18e46de7fe3ab2817fbb51ae90325bf1ff440aca4a"} Jul 07 14:15:08.313368 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:08.313345 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xvg2g_63809651-c64b-4da4-bbee-b46f25e99eef/serve-healthcheck-canary/0.log" Jul 07 14:15:13.704625 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:13.704588 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:15:13.808852 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:13.808822 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:15:13.907557 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:13.907527 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:15:21.088460 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:21.088422 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1125d082-9200-4b6f-b03b-1edd11069009-metrics-certs\") pod \"network-metrics-daemon-rfmz4\" (UID: \"1125d082-9200-4b6f-b03b-1edd11069009\") " pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:15:21.090951 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:21.090917 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1125d082-9200-4b6f-b03b-1edd11069009-metrics-certs\") pod \"network-metrics-daemon-rfmz4\" (UID: \"1125d082-9200-4b6f-b03b-1edd11069009\") " pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:15:21.098841 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:21.098809 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x2hv7\"" Jul 07 14:15:21.106564 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:21.106287 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rfmz4" Jul 07 14:15:21.341412 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:21.341328 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rfmz4"] Jul 07 14:15:21.347711 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:15:21.347597 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1125d082_9200_4b6f_b03b_1edd11069009.slice/crio-d6dd38e1a9778447410f2a5f2d6f50733759e84c33f5a04be37e9e6028d5322b WatchSource:0}: Error finding container d6dd38e1a9778447410f2a5f2d6f50733759e84c33f5a04be37e9e6028d5322b: Status 404 returned error can't find the container with id d6dd38e1a9778447410f2a5f2d6f50733759e84c33f5a04be37e9e6028d5322b Jul 07 14:15:21.369852 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:21.369816 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rfmz4" event={"ID":"1125d082-9200-4b6f-b03b-1edd11069009","Type":"ContainerStarted","Data":"d6dd38e1a9778447410f2a5f2d6f50733759e84c33f5a04be37e9e6028d5322b"} Jul 07 14:15:21.606766 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:21.606651 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:15:21.691699 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:21.691667 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:15:23.378963 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:23.378917 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rfmz4" event={"ID":"1125d082-9200-4b6f-b03b-1edd11069009","Type":"ContainerStarted","Data":"749354d05d8693afbc7c5d8d361a11d3b045c15600cf964efa660082fed1aa27"} Jul 07 14:15:23.379372 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:23.378977 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rfmz4" event={"ID":"1125d082-9200-4b6f-b03b-1edd11069009","Type":"ContainerStarted","Data":"38e57d6f5681954224bd94881079a2f1578149853bbaddd2105369b066981b24"} Jul 07 14:15:23.398274 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:23.398223 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rfmz4" podStartSLOduration=375.221300125 podStartE2EDuration="6m16.398207632s" totalImagesPullingTime="1.176907507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:15:23.396070052 +0000 UTC m=+376.778907484" watchObservedRunningTime="2026-07-07 14:15:23.398207632 +0000 UTC m=+376.781045061" Jul 07 14:15:23.509737 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:23.509696 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:15:23.578516 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:23.578468 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:15:24.854987 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:24.854956 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:15:24.958668 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:24.958635 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:15:28.046487 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:28.046449 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:15:28.066695 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:28.066670 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:15:28.416323 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:28.416239 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 07 14:15:41.608347 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:41.608311 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:15:41.706648 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:41.706617 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:15:50.348047 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:50.348011 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:15:50.444493 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:50.444450 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:15:51.886282 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:15:51.886231 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rxpf2" podUID="61c55aec-8d5a-486f-8e6d-2ed748969b6e" Jul 07 14:15:52.494622 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:52.494591 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rxpf2" Jul 07 14:15:54.094083 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:54.094044 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61c55aec-8d5a-486f-8e6d-2ed748969b6e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rxpf2\" (UID: \"61c55aec-8d5a-486f-8e6d-2ed748969b6e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rxpf2" Jul 07 14:15:54.096588 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:54.096559 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/61c55aec-8d5a-486f-8e6d-2ed748969b6e-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-rxpf2\" (UID: \"61c55aec-8d5a-486f-8e6d-2ed748969b6e\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-rxpf2" Jul 07 14:15:54.297677 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:54.297645 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-xjplb\"" Jul 07 14:15:54.305749 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:54.305725 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rxpf2" Jul 07 14:15:54.439700 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:54.439661 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-rxpf2"] Jul 07 14:15:54.443939 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:15:54.443910 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61c55aec_8d5a_486f_8e6d_2ed748969b6e.slice/crio-ed7f7b18669087cbd44bbf8937ea8a04274b20354634ace01b5b01b65531937e WatchSource:0}: Error finding container ed7f7b18669087cbd44bbf8937ea8a04274b20354634ace01b5b01b65531937e: Status 404 returned error can't find the container with id ed7f7b18669087cbd44bbf8937ea8a04274b20354634ace01b5b01b65531937e Jul 07 14:15:54.503121 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:54.503090 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rxpf2" event={"ID":"61c55aec-8d5a-486f-8e6d-2ed748969b6e","Type":"ContainerStarted","Data":"ed7f7b18669087cbd44bbf8937ea8a04274b20354634ace01b5b01b65531937e"} Jul 07 14:15:56.153949 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:56.153861 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:15:56.250976 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:56.250944 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:15:56.513297 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:56.513264 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rxpf2" event={"ID":"61c55aec-8d5a-486f-8e6d-2ed748969b6e","Type":"ContainerStarted","Data":"54745d165cf7bc4698fca2a7aa63faf8b77b00a4cb3f70bb291517803421d2f5"} Jul 07 14:15:56.539310 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:56.539239 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-rxpf2" podStartSLOduration=404.182627566 podStartE2EDuration="6m45.53921723s" totalImagesPullingTime="1.356589664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:09:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:15:56.53822213 +0000 UTC m=+409.921059562" watchObservedRunningTime="2026-07-07 14:15:56.53921723 +0000 UTC m=+409.922054661" Jul 07 14:15:56.789535 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:56.789432 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:15:56.866972 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:15:56.866936 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:16:00.763905 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:16:00.763868 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:16:01.804290 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:16:01.804242 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:16:01.881981 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:16:01.881947 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:16:02.103422 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:16:02.103346 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:16:02.171067 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:16:02.171039 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:16:08.091078 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:16:08.091041 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:16:08.212203 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:16:08.212165 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:16:12.897498 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:16:12.897463 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:16:12.992337 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:16:12.992299 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:16:13.064005 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:16:13.063976 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:16:17.991002 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:16:17.990960 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:16:18.092679 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:16:18.092637 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:16:18.168842 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:16:18.168793 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:16:24.434064 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:16:24.434035 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:16:24.536136 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:16:24.536102 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:16:35.034633 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:16:35.034541 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:16:38.453926 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:16:38.453889 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:16:53.732227 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:16:53.732191 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:17:01.775841 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:17:01.775806 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:17:29.268956 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:17:29.268922 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:17:29.344373 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:17:29.344338 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:18:16.291499 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:18:16.291385 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:18:16.389876 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:18:16.389844 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:18:16.646424 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:18:16.646314 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:18:16.748746 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:18:16.748715 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:18:16.878326 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:18:16.878296 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:18:44.979422 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:18:44.979382 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:18:45.117272 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:18:45.117225 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:18:50.797558 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:18:50.797495 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:18:51.261651 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:18:51.261618 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:18:51.495887 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:18:51.495854 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:18:52.134699 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:18:52.134645 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:18:52.421811 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:18:52.421226 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:18:52.509996 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:18:52.509959 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:18:52.855924 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:18:52.855894 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:18:53.659152 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:18:53.659113 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:18:53.734656 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:18:53.734607 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:19:06.994651 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:19:06.994620 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b66mb_82df755c-beec-4653-96a6-691507fee3e7/console-operator/1.log" Jul 07 14:19:06.995103 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:19:06.994620 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b66mb_82df755c-beec-4653-96a6-691507fee3e7/console-operator/1.log" Jul 07 14:20:00.128264 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:20:00.128224 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:20:01.792125 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:20:01.792091 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:20:21.849443 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:20:21.849406 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:20:21.940709 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:20:21.940668 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:21:13.360755 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:13.360672 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:21:13.564260 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:13.564215 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:21:13.735739 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:13.735707 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:21:14.000283 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:14.000195 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:21:15.139400 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:15.139365 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:21:15.251253 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:15.251221 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:21:28.884437 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:28.884394 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/s3-init-x9wgw"] Jul 07 14:21:28.885029 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:28.884913 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3b96f44-0335-4da3-92cc-a62de698d7c1" containerName="console" Jul 07 14:21:28.885029 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:28.884934 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3b96f44-0335-4da3-92cc-a62de698d7c1" containerName="console" Jul 07 14:21:28.885029 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:28.884971 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ebe9a1d-a632-4029-a154-663edb83c930" containerName="registry" Jul 07 14:21:28.885029 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:28.884979 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ebe9a1d-a632-4029-a154-663edb83c930" containerName="registry" Jul 07 14:21:28.885236 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:28.885052 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ebe9a1d-a632-4029-a154-663edb83c930" containerName="registry" Jul 07 14:21:28.885236 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:28.885066 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3b96f44-0335-4da3-92cc-a62de698d7c1" containerName="console" Jul 07 14:21:28.890593 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:28.889102 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-x9wgw" Jul 07 14:21:28.892287 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:28.892265 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-4s9m8\"" Jul 07 14:21:28.892435 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:28.892267 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 07 14:21:28.892435 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:28.892267 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 07 14:21:28.892950 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:28.892910 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 07 14:21:28.948850 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:28.948818 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-x9wgw"] Jul 07 14:21:28.988819 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:28.988780 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23c04fb3-def6-44a6-9bb4-874275c7219e-model-cache\") pod \"s3-init-x9wgw\" (UID: \"23c04fb3-def6-44a6-9bb4-874275c7219e\") " pod="kserve/s3-init-x9wgw" Jul 07 14:21:28.989017 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:28.988911 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2w6c\" (UniqueName: \"kubernetes.io/projected/23c04fb3-def6-44a6-9bb4-874275c7219e-kube-api-access-t2w6c\") pod \"s3-init-x9wgw\" (UID: \"23c04fb3-def6-44a6-9bb4-874275c7219e\") " pod="kserve/s3-init-x9wgw" Jul 07 14:21:29.089445 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:29.089408 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23c04fb3-def6-44a6-9bb4-874275c7219e-model-cache\") pod \"s3-init-x9wgw\" (UID: \"23c04fb3-def6-44a6-9bb4-874275c7219e\") " pod="kserve/s3-init-x9wgw" Jul 07 14:21:29.089654 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:29.089499 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2w6c\" (UniqueName: \"kubernetes.io/projected/23c04fb3-def6-44a6-9bb4-874275c7219e-kube-api-access-t2w6c\") pod \"s3-init-x9wgw\" (UID: \"23c04fb3-def6-44a6-9bb4-874275c7219e\") " pod="kserve/s3-init-x9wgw" Jul 07 14:21:29.089852 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:29.089830 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23c04fb3-def6-44a6-9bb4-874275c7219e-model-cache\") pod \"s3-init-x9wgw\" (UID: \"23c04fb3-def6-44a6-9bb4-874275c7219e\") " pod="kserve/s3-init-x9wgw" Jul 07 14:21:29.100091 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:29.100062 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2w6c\" (UniqueName: \"kubernetes.io/projected/23c04fb3-def6-44a6-9bb4-874275c7219e-kube-api-access-t2w6c\") pod \"s3-init-x9wgw\" (UID: \"23c04fb3-def6-44a6-9bb4-874275c7219e\") " pod="kserve/s3-init-x9wgw" Jul 07 14:21:29.214355 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:29.214327 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-x9wgw" Jul 07 14:21:29.362189 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:29.362156 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/s3-init-x9wgw"] Jul 07 14:21:29.365970 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:21:29.365943 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23c04fb3_def6_44a6_9bb4_874275c7219e.slice/crio-3b6c736518d76077d494dacfe00d9014d516efeb0fdabd77f77058a8ed931418 WatchSource:0}: Error finding container 3b6c736518d76077d494dacfe00d9014d516efeb0fdabd77f77058a8ed931418: Status 404 returned error can't find the container with id 3b6c736518d76077d494dacfe00d9014d516efeb0fdabd77f77058a8ed931418 Jul 07 14:21:29.368412 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:29.368393 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 14:21:29.839250 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:29.839211 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-x9wgw" event={"ID":"23c04fb3-def6-44a6-9bb4-874275c7219e","Type":"ContainerStarted","Data":"3b6c736518d76077d494dacfe00d9014d516efeb0fdabd77f77058a8ed931418"} Jul 07 14:21:33.862795 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:33.862762 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-x9wgw" event={"ID":"23c04fb3-def6-44a6-9bb4-874275c7219e","Type":"ContainerStarted","Data":"c7c88940b9a9cbea0ec45651454ef45f66714e5e473cb37d577ff077740a232d"} Jul 07 14:21:35.306137 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:35.306099 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:21:35.872703 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:35.872673 2557 generic.go:356] "Generic (PLEG): container finished" podID="23c04fb3-def6-44a6-9bb4-874275c7219e" containerID="c7c88940b9a9cbea0ec45651454ef45f66714e5e473cb37d577ff077740a232d" exitCode=0 Jul 07 14:21:35.872914 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:35.872723 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-x9wgw" event={"ID":"23c04fb3-def6-44a6-9bb4-874275c7219e","Type":"ContainerDied","Data":"c7c88940b9a9cbea0ec45651454ef45f66714e5e473cb37d577ff077740a232d"} Jul 07 14:21:40.900463 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:40.900426 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-x9wgw" event={"ID":"23c04fb3-def6-44a6-9bb4-874275c7219e","Type":"ContainerStarted","Data":"6dea80a757dbc3cddfe0243c4a534beb2898cf2e03b9ee429f3d39c7597972e5"} Jul 07 14:21:40.924233 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:21:40.924185 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/s3-init-x9wgw" podStartSLOduration=2.136805401 podStartE2EDuration="12.924170382s" totalImagesPullingTime="8.942792276s" totalInitContainerRuntime="1.844572705s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:21:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:21:40.92403786 +0000 UTC m=+754.306875290" watchObservedRunningTime="2026-07-07 14:21:40.924170382 +0000 UTC m=+754.307007811" Jul 07 14:22:46.173390 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:22:46.173357 2557 generic.go:356] "Generic (PLEG): container finished" podID="23c04fb3-def6-44a6-9bb4-874275c7219e" containerID="6dea80a757dbc3cddfe0243c4a534beb2898cf2e03b9ee429f3d39c7597972e5" exitCode=0 Jul 07 14:22:46.173804 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:22:46.173409 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-x9wgw" event={"ID":"23c04fb3-def6-44a6-9bb4-874275c7219e","Type":"ContainerDied","Data":"6dea80a757dbc3cddfe0243c4a534beb2898cf2e03b9ee429f3d39c7597972e5"} Jul 07 14:22:47.313196 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:22:47.313170 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-x9wgw" Jul 07 14:22:47.372832 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:22:47.372804 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23c04fb3-def6-44a6-9bb4-874275c7219e-model-cache\") pod \"23c04fb3-def6-44a6-9bb4-874275c7219e\" (UID: \"23c04fb3-def6-44a6-9bb4-874275c7219e\") " Jul 07 14:22:47.373020 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:22:47.372856 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2w6c\" (UniqueName: \"kubernetes.io/projected/23c04fb3-def6-44a6-9bb4-874275c7219e-kube-api-access-t2w6c\") pod \"23c04fb3-def6-44a6-9bb4-874275c7219e\" (UID: \"23c04fb3-def6-44a6-9bb4-874275c7219e\") " Jul 07 14:22:47.375594 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:22:47.375561 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23c04fb3-def6-44a6-9bb4-874275c7219e-kube-api-access-t2w6c" (OuterVolumeSpecName: "kube-api-access-t2w6c") pod "23c04fb3-def6-44a6-9bb4-874275c7219e" (UID: "23c04fb3-def6-44a6-9bb4-874275c7219e"). InnerVolumeSpecName "kube-api-access-t2w6c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:22:47.391490 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:22:47.391458 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23c04fb3-def6-44a6-9bb4-874275c7219e-model-cache" (OuterVolumeSpecName: "model-cache") pod "23c04fb3-def6-44a6-9bb4-874275c7219e" (UID: "23c04fb3-def6-44a6-9bb4-874275c7219e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:22:47.473949 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:22:47.473910 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2w6c\" (UniqueName: \"kubernetes.io/projected/23c04fb3-def6-44a6-9bb4-874275c7219e-kube-api-access-t2w6c\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 07 14:22:47.473949 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:22:47.473950 2557 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23c04fb3-def6-44a6-9bb4-874275c7219e-model-cache\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 07 14:22:48.183399 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:22:48.183312 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/s3-init-x9wgw" event={"ID":"23c04fb3-def6-44a6-9bb4-874275c7219e","Type":"ContainerDied","Data":"3b6c736518d76077d494dacfe00d9014d516efeb0fdabd77f77058a8ed931418"} Jul 07 14:22:48.183399 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:22:48.183337 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/s3-init-x9wgw" Jul 07 14:22:48.183399 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:22:48.183362 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b6c736518d76077d494dacfe00d9014d516efeb0fdabd77f77058a8ed931418" Jul 07 14:22:48.639924 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:22:48.639888 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:22:48.748033 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:22:48.747996 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:23:00.574805 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:00.574767 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:23:00.856417 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:00.856337 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:23:00.916061 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:00.916030 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t"] Jul 07 14:23:00.916347 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:00.916335 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23c04fb3-def6-44a6-9bb4-874275c7219e" containerName="s3-init" Jul 07 14:23:00.916402 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:00.916348 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="23c04fb3-def6-44a6-9bb4-874275c7219e" containerName="s3-init" Jul 07 14:23:00.916402 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:00.916376 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23c04fb3-def6-44a6-9bb4-874275c7219e" containerName="download-hf-model" Jul 07 14:23:00.916402 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:00.916381 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="23c04fb3-def6-44a6-9bb4-874275c7219e" containerName="download-hf-model" Jul 07 14:23:00.916523 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:00.916427 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="23c04fb3-def6-44a6-9bb4-874275c7219e" containerName="s3-init" Jul 07 14:23:00.919325 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:00.919309 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" Jul 07 14:23:00.922214 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:00.922192 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"kube-root-ca.crt\"" Jul 07 14:23:00.922441 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:00.922226 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"default-dockercfg-j545g\"" Jul 07 14:23:00.922441 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:00.922256 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-predictor-serving-cert\"" Jul 07 14:23:00.922616 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:00.922544 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"openshift-service-ca.crt\"" Jul 07 14:23:00.922616 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:00.922546 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"odh-kserve-custom-ca-bundle\"" Jul 07 14:23:00.922971 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:00.922952 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-1-kube-rbac-proxy-sar-config\"" Jul 07 14:23:00.923020 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:00.922980 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"seaweedfs-s3-creds\"" Jul 07 14:23:00.937685 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:00.937657 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t"] Jul 07 14:23:00.947818 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:00.947784 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:23:01.073605 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.073570 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:23:01.093724 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.093690 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e22a677a-65e5-4ab3-8647-6c0bdf612c1a-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-2cg9t\" (UID: \"e22a677a-65e5-4ab3-8647-6c0bdf612c1a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" Jul 07 14:23:01.093867 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.093747 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e22a677a-65e5-4ab3-8647-6c0bdf612c1a-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-2cg9t\" (UID: \"e22a677a-65e5-4ab3-8647-6c0bdf612c1a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" Jul 07 14:23:01.093867 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.093777 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e22a677a-65e5-4ab3-8647-6c0bdf612c1a-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-2cg9t\" (UID: \"e22a677a-65e5-4ab3-8647-6c0bdf612c1a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" Jul 07 14:23:01.093867 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.093798 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e22a677a-65e5-4ab3-8647-6c0bdf612c1a-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-2cg9t\" (UID: \"e22a677a-65e5-4ab3-8647-6c0bdf612c1a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" Jul 07 14:23:01.093867 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.093815 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gshc2\" (UniqueName: \"kubernetes.io/projected/e22a677a-65e5-4ab3-8647-6c0bdf612c1a-kube-api-access-gshc2\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-2cg9t\" (UID: \"e22a677a-65e5-4ab3-8647-6c0bdf612c1a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" Jul 07 14:23:01.148908 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.148831 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g"] Jul 07 14:23:01.152288 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.152271 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" Jul 07 14:23:01.155242 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.155217 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-predictor-serving-cert\"" Jul 07 14:23:01.155242 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.155236 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-xgboost-graph-kube-rbac-proxy-sar-config\"" Jul 07 14:23:01.168389 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.168365 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g"] Jul 07 14:23:01.188586 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.188551 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:23:01.195128 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.195101 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gshc2\" (UniqueName: \"kubernetes.io/projected/e22a677a-65e5-4ab3-8647-6c0bdf612c1a-kube-api-access-gshc2\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-2cg9t\" (UID: \"e22a677a-65e5-4ab3-8647-6c0bdf612c1a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" Jul 07 14:23:01.195231 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.195199 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e22a677a-65e5-4ab3-8647-6c0bdf612c1a-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-2cg9t\" (UID: \"e22a677a-65e5-4ab3-8647-6c0bdf612c1a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" Jul 07 14:23:01.195285 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.195248 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e22a677a-65e5-4ab3-8647-6c0bdf612c1a-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-2cg9t\" (UID: \"e22a677a-65e5-4ab3-8647-6c0bdf612c1a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" Jul 07 14:23:01.195285 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.195271 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e22a677a-65e5-4ab3-8647-6c0bdf612c1a-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-2cg9t\" (UID: \"e22a677a-65e5-4ab3-8647-6c0bdf612c1a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" Jul 07 14:23:01.195388 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.195289 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e22a677a-65e5-4ab3-8647-6c0bdf612c1a-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-2cg9t\" (UID: \"e22a677a-65e5-4ab3-8647-6c0bdf612c1a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" Jul 07 14:23:01.195499 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:23:01.195414 2557 secret.go:189] Couldn't get secret kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-serving-cert: secret "isvc-sklearn-graph-1-predictor-serving-cert" not found Jul 07 14:23:01.195499 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:23:01.195517 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e22a677a-65e5-4ab3-8647-6c0bdf612c1a-proxy-tls podName:e22a677a-65e5-4ab3-8647-6c0bdf612c1a nodeName:}" failed. No retries permitted until 2026-07-07 14:23:01.695465631 +0000 UTC m=+835.078303044 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "proxy-tls" (UniqueName: "kubernetes.io/secret/e22a677a-65e5-4ab3-8647-6c0bdf612c1a-proxy-tls") pod "isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" (UID: "e22a677a-65e5-4ab3-8647-6c0bdf612c1a") : secret "isvc-sklearn-graph-1-predictor-serving-cert" not found Jul 07 14:23:01.195815 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.195789 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e22a677a-65e5-4ab3-8647-6c0bdf612c1a-kserve-provision-location\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-2cg9t\" (UID: \"e22a677a-65e5-4ab3-8647-6c0bdf612c1a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" Jul 07 14:23:01.195955 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.195935 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e22a677a-65e5-4ab3-8647-6c0bdf612c1a-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-2cg9t\" (UID: \"e22a677a-65e5-4ab3-8647-6c0bdf612c1a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" Jul 07 14:23:01.196016 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.196004 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e22a677a-65e5-4ab3-8647-6c0bdf612c1a-cabundle-cert\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-2cg9t\" (UID: \"e22a677a-65e5-4ab3-8647-6c0bdf612c1a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" Jul 07 14:23:01.210315 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.210286 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gshc2\" (UniqueName: \"kubernetes.io/projected/e22a677a-65e5-4ab3-8647-6c0bdf612c1a-kube-api-access-gshc2\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-2cg9t\" (UID: \"e22a677a-65e5-4ab3-8647-6c0bdf612c1a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" Jul 07 14:23:01.285138 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.285107 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:23:01.296285 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.296258 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/743150c8-c506-4882-a72e-4a222b225ddf-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-d2s8g\" (UID: \"743150c8-c506-4882-a72e-4a222b225ddf\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" Jul 07 14:23:01.296408 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.296309 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q942m\" (UniqueName: \"kubernetes.io/projected/743150c8-c506-4882-a72e-4a222b225ddf-kube-api-access-q942m\") pod \"isvc-xgboost-graph-predictor-555fc69d56-d2s8g\" (UID: \"743150c8-c506-4882-a72e-4a222b225ddf\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" Jul 07 14:23:01.296408 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.296383 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/743150c8-c506-4882-a72e-4a222b225ddf-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-d2s8g\" (UID: \"743150c8-c506-4882-a72e-4a222b225ddf\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" Jul 07 14:23:01.296492 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.296428 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/743150c8-c506-4882-a72e-4a222b225ddf-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-d2s8g\" (UID: \"743150c8-c506-4882-a72e-4a222b225ddf\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" Jul 07 14:23:01.296492 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.296466 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/743150c8-c506-4882-a72e-4a222b225ddf-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-d2s8g\" (UID: \"743150c8-c506-4882-a72e-4a222b225ddf\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" Jul 07 14:23:01.307054 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.307025 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7"] Jul 07 14:23:01.310572 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.310557 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" Jul 07 14:23:01.312874 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.312849 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-predictor-serving-cert\"" Jul 07 14:23:01.313108 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.313090 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve-ci-e2e-test\"/\"isvc-sklearn-graph-2-kube-rbac-proxy-sar-config\"" Jul 07 14:23:01.323254 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.323227 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7"] Jul 07 14:23:01.397359 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.397323 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q942m\" (UniqueName: \"kubernetes.io/projected/743150c8-c506-4882-a72e-4a222b225ddf-kube-api-access-q942m\") pod \"isvc-xgboost-graph-predictor-555fc69d56-d2s8g\" (UID: \"743150c8-c506-4882-a72e-4a222b225ddf\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" Jul 07 14:23:01.397595 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.397378 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/743150c8-c506-4882-a72e-4a222b225ddf-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-d2s8g\" (UID: \"743150c8-c506-4882-a72e-4a222b225ddf\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" Jul 07 14:23:01.397595 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.397408 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4d1eb367-5c69-4cab-8034-50ac36dc77ee-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7\" (UID: \"4d1eb367-5c69-4cab-8034-50ac36dc77ee\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" Jul 07 14:23:01.397595 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.397431 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/743150c8-c506-4882-a72e-4a222b225ddf-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-d2s8g\" (UID: \"743150c8-c506-4882-a72e-4a222b225ddf\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" Jul 07 14:23:01.397595 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.397458 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4d1eb367-5c69-4cab-8034-50ac36dc77ee-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7\" (UID: \"4d1eb367-5c69-4cab-8034-50ac36dc77ee\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" Jul 07 14:23:01.397595 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.397482 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/743150c8-c506-4882-a72e-4a222b225ddf-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-d2s8g\" (UID: \"743150c8-c506-4882-a72e-4a222b225ddf\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" Jul 07 14:23:01.397595 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.397561 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4d1eb367-5c69-4cab-8034-50ac36dc77ee-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7\" (UID: \"4d1eb367-5c69-4cab-8034-50ac36dc77ee\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" Jul 07 14:23:01.397876 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.397605 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jp6z\" (UniqueName: \"kubernetes.io/projected/4d1eb367-5c69-4cab-8034-50ac36dc77ee-kube-api-access-5jp6z\") pod \"isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7\" (UID: \"4d1eb367-5c69-4cab-8034-50ac36dc77ee\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" Jul 07 14:23:01.397876 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.397633 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/743150c8-c506-4882-a72e-4a222b225ddf-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-d2s8g\" (UID: \"743150c8-c506-4882-a72e-4a222b225ddf\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" Jul 07 14:23:01.397876 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.397653 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4d1eb367-5c69-4cab-8034-50ac36dc77ee-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7\" (UID: \"4d1eb367-5c69-4cab-8034-50ac36dc77ee\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" Jul 07 14:23:01.398040 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.398011 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/743150c8-c506-4882-a72e-4a222b225ddf-kserve-provision-location\") pod \"isvc-xgboost-graph-predictor-555fc69d56-d2s8g\" (UID: \"743150c8-c506-4882-a72e-4a222b225ddf\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" Jul 07 14:23:01.398298 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.398279 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/743150c8-c506-4882-a72e-4a222b225ddf-kube-rbac-proxy-sar-config\") pod \"isvc-xgboost-graph-predictor-555fc69d56-d2s8g\" (UID: \"743150c8-c506-4882-a72e-4a222b225ddf\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" Jul 07 14:23:01.398351 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.398278 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/743150c8-c506-4882-a72e-4a222b225ddf-cabundle-cert\") pod \"isvc-xgboost-graph-predictor-555fc69d56-d2s8g\" (UID: \"743150c8-c506-4882-a72e-4a222b225ddf\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" Jul 07 14:23:01.400259 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.400208 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/743150c8-c506-4882-a72e-4a222b225ddf-proxy-tls\") pod \"isvc-xgboost-graph-predictor-555fc69d56-d2s8g\" (UID: \"743150c8-c506-4882-a72e-4a222b225ddf\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" Jul 07 14:23:01.411069 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.411040 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q942m\" (UniqueName: \"kubernetes.io/projected/743150c8-c506-4882-a72e-4a222b225ddf-kube-api-access-q942m\") pod \"isvc-xgboost-graph-predictor-555fc69d56-d2s8g\" (UID: \"743150c8-c506-4882-a72e-4a222b225ddf\") " pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" Jul 07 14:23:01.433924 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.433894 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:23:01.461954 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.461927 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" Jul 07 14:23:01.498402 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.498368 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4d1eb367-5c69-4cab-8034-50ac36dc77ee-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7\" (UID: \"4d1eb367-5c69-4cab-8034-50ac36dc77ee\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" Jul 07 14:23:01.498584 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.498411 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jp6z\" (UniqueName: \"kubernetes.io/projected/4d1eb367-5c69-4cab-8034-50ac36dc77ee-kube-api-access-5jp6z\") pod \"isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7\" (UID: \"4d1eb367-5c69-4cab-8034-50ac36dc77ee\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" Jul 07 14:23:01.498661 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.498631 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4d1eb367-5c69-4cab-8034-50ac36dc77ee-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7\" (UID: \"4d1eb367-5c69-4cab-8034-50ac36dc77ee\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" Jul 07 14:23:01.498775 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.498760 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4d1eb367-5c69-4cab-8034-50ac36dc77ee-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7\" (UID: \"4d1eb367-5c69-4cab-8034-50ac36dc77ee\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" Jul 07 14:23:01.498837 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.498775 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4d1eb367-5c69-4cab-8034-50ac36dc77ee-kserve-provision-location\") pod \"isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7\" (UID: \"4d1eb367-5c69-4cab-8034-50ac36dc77ee\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" Jul 07 14:23:01.498837 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.498832 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4d1eb367-5c69-4cab-8034-50ac36dc77ee-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7\" (UID: \"4d1eb367-5c69-4cab-8034-50ac36dc77ee\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" Jul 07 14:23:01.499377 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.499356 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4d1eb367-5c69-4cab-8034-50ac36dc77ee-cabundle-cert\") pod \"isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7\" (UID: \"4d1eb367-5c69-4cab-8034-50ac36dc77ee\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" Jul 07 14:23:01.499486 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.499389 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4d1eb367-5c69-4cab-8034-50ac36dc77ee-kube-rbac-proxy-sar-config\") pod \"isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7\" (UID: \"4d1eb367-5c69-4cab-8034-50ac36dc77ee\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" Jul 07 14:23:01.501363 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.501341 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4d1eb367-5c69-4cab-8034-50ac36dc77ee-proxy-tls\") pod \"isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7\" (UID: \"4d1eb367-5c69-4cab-8034-50ac36dc77ee\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" Jul 07 14:23:01.508403 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.508376 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jp6z\" (UniqueName: \"kubernetes.io/projected/4d1eb367-5c69-4cab-8034-50ac36dc77ee-kube-api-access-5jp6z\") pod \"isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7\" (UID: \"4d1eb367-5c69-4cab-8034-50ac36dc77ee\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" Jul 07 14:23:01.591663 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.591627 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:23:01.602984 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.602951 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g"] Jul 07 14:23:01.608354 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:23:01.608328 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod743150c8_c506_4882_a72e_4a222b225ddf.slice/crio-119da15efe444353c75ae404551e2878feea6cce53d7003a6528ae4a68e46ba4 WatchSource:0}: Error finding container 119da15efe444353c75ae404551e2878feea6cce53d7003a6528ae4a68e46ba4: Status 404 returned error can't find the container with id 119da15efe444353c75ae404551e2878feea6cce53d7003a6528ae4a68e46ba4 Jul 07 14:23:01.620911 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.620866 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" Jul 07 14:23:01.700244 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.700211 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e22a677a-65e5-4ab3-8647-6c0bdf612c1a-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-2cg9t\" (UID: \"e22a677a-65e5-4ab3-8647-6c0bdf612c1a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" Jul 07 14:23:01.703153 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.703127 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e22a677a-65e5-4ab3-8647-6c0bdf612c1a-proxy-tls\") pod \"isvc-sklearn-graph-1-predictor-875bcd459-2cg9t\" (UID: \"e22a677a-65e5-4ab3-8647-6c0bdf612c1a\") " pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" Jul 07 14:23:01.770709 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.770679 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7"] Jul 07 14:23:01.772437 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:23:01.772411 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d1eb367_5c69_4cab_8034_50ac36dc77ee.slice/crio-4c673411eec699f3ddc180c0bc9489e0ae8f81d5fbf0d4579d3aa837fa7a4f36 WatchSource:0}: Error finding container 4c673411eec699f3ddc180c0bc9489e0ae8f81d5fbf0d4579d3aa837fa7a4f36: Status 404 returned error can't find the container with id 4c673411eec699f3ddc180c0bc9489e0ae8f81d5fbf0d4579d3aa837fa7a4f36 Jul 07 14:23:01.834736 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.834712 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" Jul 07 14:23:01.986373 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:01.986328 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t"] Jul 07 14:23:01.992806 ip-10-0-130-152 kubenswrapper[2557]: W0707 14:23:01.992781 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode22a677a_65e5_4ab3_8647_6c0bdf612c1a.slice/crio-7224ad96f9ab909dccf1503082c8397420126e082c282a7b1cbd46a8da787e25 WatchSource:0}: Error finding container 7224ad96f9ab909dccf1503082c8397420126e082c282a7b1cbd46a8da787e25: Status 404 returned error can't find the container with id 7224ad96f9ab909dccf1503082c8397420126e082c282a7b1cbd46a8da787e25 Jul 07 14:23:02.243986 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:02.243944 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" event={"ID":"4d1eb367-5c69-4cab-8034-50ac36dc77ee","Type":"ContainerStarted","Data":"413dc7fe4fc671fd319c71d0ed6fa45a2e2f510acd813ddd5579f9014072a43c"} Jul 07 14:23:02.244360 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:02.244018 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" event={"ID":"4d1eb367-5c69-4cab-8034-50ac36dc77ee","Type":"ContainerStarted","Data":"4c673411eec699f3ddc180c0bc9489e0ae8f81d5fbf0d4579d3aa837fa7a4f36"} Jul 07 14:23:02.245792 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:02.245753 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" event={"ID":"743150c8-c506-4882-a72e-4a222b225ddf","Type":"ContainerStarted","Data":"88a1916519acfffd7e826b76edd9045ad3779b5fd2d255b8be4023be2e95f5c4"} Jul 07 14:23:02.245942 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:02.245829 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" event={"ID":"743150c8-c506-4882-a72e-4a222b225ddf","Type":"ContainerStarted","Data":"119da15efe444353c75ae404551e2878feea6cce53d7003a6528ae4a68e46ba4"} Jul 07 14:23:02.247774 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:02.247746 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" event={"ID":"e22a677a-65e5-4ab3-8647-6c0bdf612c1a","Type":"ContainerStarted","Data":"96d4734f7d1abee2f477c6ff4e02028e110e3dbfbbb86dc12b25f4b25c9b95a0"} Jul 07 14:23:02.247909 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:02.247806 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" event={"ID":"e22a677a-65e5-4ab3-8647-6c0bdf612c1a","Type":"ContainerStarted","Data":"7224ad96f9ab909dccf1503082c8397420126e082c282a7b1cbd46a8da787e25"} Jul 07 14:23:06.268847 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:06.268810 2557 generic.go:356] "Generic (PLEG): container finished" podID="4d1eb367-5c69-4cab-8034-50ac36dc77ee" containerID="413dc7fe4fc671fd319c71d0ed6fa45a2e2f510acd813ddd5579f9014072a43c" exitCode=0 Jul 07 14:23:06.269300 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:06.268887 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" event={"ID":"4d1eb367-5c69-4cab-8034-50ac36dc77ee","Type":"ContainerDied","Data":"413dc7fe4fc671fd319c71d0ed6fa45a2e2f510acd813ddd5579f9014072a43c"} Jul 07 14:23:06.270608 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:06.270525 2557 generic.go:356] "Generic (PLEG): container finished" podID="743150c8-c506-4882-a72e-4a222b225ddf" containerID="88a1916519acfffd7e826b76edd9045ad3779b5fd2d255b8be4023be2e95f5c4" exitCode=0 Jul 07 14:23:06.270608 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:06.270551 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" event={"ID":"743150c8-c506-4882-a72e-4a222b225ddf","Type":"ContainerDied","Data":"88a1916519acfffd7e826b76edd9045ad3779b5fd2d255b8be4023be2e95f5c4"} Jul 07 14:23:06.272284 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:06.272258 2557 generic.go:356] "Generic (PLEG): container finished" podID="e22a677a-65e5-4ab3-8647-6c0bdf612c1a" containerID="96d4734f7d1abee2f477c6ff4e02028e110e3dbfbbb86dc12b25f4b25c9b95a0" exitCode=0 Jul 07 14:23:06.272374 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:06.272280 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" event={"ID":"e22a677a-65e5-4ab3-8647-6c0bdf612c1a","Type":"ContainerDied","Data":"96d4734f7d1abee2f477c6ff4e02028e110e3dbfbbb86dc12b25f4b25c9b95a0"} Jul 07 14:23:23.524888 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:23.524827 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:23:34.464616 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:34.464577 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" event={"ID":"e22a677a-65e5-4ab3-8647-6c0bdf612c1a","Type":"ContainerStarted","Data":"64ea39bc987a5fa37d344063bb48068a252ac6bce2185ee9960b754a060b7830"} Jul 07 14:23:34.466393 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:34.466367 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" event={"ID":"4d1eb367-5c69-4cab-8034-50ac36dc77ee","Type":"ContainerStarted","Data":"c3e86eea2168054f94e77b583c6f06d186cc5df81e405d036f71731dfd507b9f"} Jul 07 14:23:35.476049 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:35.476004 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" event={"ID":"743150c8-c506-4882-a72e-4a222b225ddf","Type":"ContainerStarted","Data":"7384abf349f855a76223cf99fb855ada293dc6d595ea609036b445d76794ca57"} Jul 07 14:23:37.490084 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:37.490027 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" event={"ID":"4d1eb367-5c69-4cab-8034-50ac36dc77ee","Type":"ContainerStarted","Data":"b17e90e4c114ae7a764c3f3d7da67344203017b3eb1d6949a1b32fc52bf6a0bf"} Jul 07 14:23:37.490559 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:37.490275 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" Jul 07 14:23:37.492498 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:37.492472 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" event={"ID":"743150c8-c506-4882-a72e-4a222b225ddf","Type":"ContainerStarted","Data":"d7b1b59768dc3e4a42c67241c6965f6414b6f021cc6267446c092f1b985a3c28"} Jul 07 14:23:37.494603 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:37.494575 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" event={"ID":"e22a677a-65e5-4ab3-8647-6c0bdf612c1a","Type":"ContainerStarted","Data":"11c2ba148cb664539a557014d1c2fa294894f5d7299ded4c82a3e13af7928e58"} Jul 07 14:23:37.494829 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:37.494807 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" Jul 07 14:23:37.494928 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:37.494861 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" Jul 07 14:23:37.496393 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:37.496368 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" podUID="e22a677a-65e5-4ab3-8647-6c0bdf612c1a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Jul 07 14:23:37.525406 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:37.525357 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" podStartSLOduration=1.85390657 podStartE2EDuration="36.525339852s" totalImagesPullingTime="30.808251055s" totalInitContainerRuntime="3.863182227s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:23:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:23:37.522962475 +0000 UTC m=+870.905799887" watchObservedRunningTime="2026-07-07 14:23:37.525339852 +0000 UTC m=+870.908177281" Jul 07 14:23:37.549935 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:37.549874 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" podStartSLOduration=2.979754673 podStartE2EDuration="37.549854272s" totalImagesPullingTime="30.811037864s" totalInitContainerRuntime="3.759061735s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:23:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:23:37.548236524 +0000 UTC m=+870.931073954" watchObservedRunningTime="2026-07-07 14:23:37.549854272 +0000 UTC m=+870.932691702" Jul 07 14:23:37.573306 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:37.573249 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" podStartSLOduration=1.822454448 podStartE2EDuration="36.573227508s" totalImagesPullingTime="30.801377712s" totalInitContainerRuntime="3.949395348s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:23:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:23:37.571958236 +0000 UTC m=+870.954795671" watchObservedRunningTime="2026-07-07 14:23:37.573227508 +0000 UTC m=+870.956064940" Jul 07 14:23:38.499827 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:38.499774 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" podUID="e22a677a-65e5-4ab3-8647-6c0bdf612c1a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Jul 07 14:23:38.500271 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:38.499987 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" Jul 07 14:23:38.500271 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:38.500040 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" Jul 07 14:23:38.500271 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:38.500080 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" Jul 07 14:23:38.501230 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:38.501192 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" podUID="4d1eb367-5c69-4cab-8034-50ac36dc77ee" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Jul 07 14:23:38.501230 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:38.501220 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" podUID="743150c8-c506-4882-a72e-4a222b225ddf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Jul 07 14:23:39.504188 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:39.504141 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" podUID="743150c8-c506-4882-a72e-4a222b225ddf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Jul 07 14:23:39.504680 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:39.504222 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" podUID="4d1eb367-5c69-4cab-8034-50ac36dc77ee" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Jul 07 14:23:43.504206 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:43.504173 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" Jul 07 14:23:43.504727 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:43.504695 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" podUID="e22a677a-65e5-4ab3-8647-6c0bdf612c1a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Jul 07 14:23:44.509402 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:44.509373 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" Jul 07 14:23:44.509839 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:44.509798 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" Jul 07 14:23:44.509839 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:44.509808 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" podUID="743150c8-c506-4882-a72e-4a222b225ddf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Jul 07 14:23:44.510248 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:44.510226 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" podUID="4d1eb367-5c69-4cab-8034-50ac36dc77ee" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Jul 07 14:23:53.504693 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:53.504650 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" podUID="e22a677a-65e5-4ab3-8647-6c0bdf612c1a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Jul 07 14:23:54.510536 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:54.510480 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" podUID="743150c8-c506-4882-a72e-4a222b225ddf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Jul 07 14:23:54.510934 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:23:54.510479 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" podUID="4d1eb367-5c69-4cab-8034-50ac36dc77ee" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Jul 07 14:24:03.505163 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:24:03.505079 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" podUID="e22a677a-65e5-4ab3-8647-6c0bdf612c1a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Jul 07 14:24:04.510609 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:24:04.510567 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" podUID="743150c8-c506-4882-a72e-4a222b225ddf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Jul 07 14:24:04.511040 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:24:04.510568 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" podUID="4d1eb367-5c69-4cab-8034-50ac36dc77ee" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Jul 07 14:24:07.025392 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:24:07.025359 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b66mb_82df755c-beec-4653-96a6-691507fee3e7/console-operator/1.log" Jul 07 14:24:07.025906 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:24:07.025359 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b66mb_82df755c-beec-4653-96a6-691507fee3e7/console-operator/1.log" Jul 07 14:24:12.678550 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:24:12.678485 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:24:13.504722 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:24:13.504683 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" podUID="e22a677a-65e5-4ab3-8647-6c0bdf612c1a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Jul 07 14:24:14.510545 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:24:14.510490 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" podUID="743150c8-c506-4882-a72e-4a222b225ddf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Jul 07 14:24:14.511022 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:24:14.510490 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" podUID="4d1eb367-5c69-4cab-8034-50ac36dc77ee" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Jul 07 14:24:20.659580 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:24:20.659549 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:24:20.764708 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:24:20.764673 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:24:23.504700 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:24:23.504659 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" podUID="e22a677a-65e5-4ab3-8647-6c0bdf612c1a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Jul 07 14:24:23.818140 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:24:23.818059 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:24:24.509860 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:24:24.509822 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" podUID="743150c8-c506-4882-a72e-4a222b225ddf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Jul 07 14:24:24.510269 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:24:24.510244 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" podUID="4d1eb367-5c69-4cab-8034-50ac36dc77ee" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Jul 07 14:24:30.848739 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:24:30.848680 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:24:30.950893 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:24:30.950855 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:24:31.048735 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:24:31.048707 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:24:31.147003 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:24:31.146905 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:24:31.232711 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:24:31.232676 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:24:33.505495 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:24:33.505457 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" podUID="e22a677a-65e5-4ab3-8647-6c0bdf612c1a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Jul 07 14:24:34.510645 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:24:34.510604 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" podUID="743150c8-c506-4882-a72e-4a222b225ddf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Jul 07 14:24:34.510645 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:24:34.510621 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" podUID="4d1eb367-5c69-4cab-8034-50ac36dc77ee" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Jul 07 14:24:43.504928 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:24:43.504890 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" podUID="e22a677a-65e5-4ab3-8647-6c0bdf612c1a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Jul 07 14:24:44.510709 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:24:44.510670 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" podUID="4d1eb367-5c69-4cab-8034-50ac36dc77ee" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Jul 07 14:24:44.511266 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:24:44.511244 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" Jul 07 14:24:50.096089 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:24:50.096048 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" podUID="e22a677a-65e5-4ab3-8647-6c0bdf612c1a" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.24:8080: connect: connection refused" Jul 07 14:24:54.511382 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:24:54.511352 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" Jul 07 14:25:00.096542 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:00.096493 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" Jul 07 14:25:20.734200 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:20.734152 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:25:22.059631 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:22.059587 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:25:30.840499 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:30.840398 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:25:31.104400 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:31.104309 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:25:31.105745 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:31.105724 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t"] Jul 07 14:25:31.105953 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:31.105932 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" podUID="e22a677a-65e5-4ab3-8647-6c0bdf612c1a" containerName="kserve-container" containerID="cri-o://64ea39bc987a5fa37d344063bb48068a252ac6bce2185ee9960b754a060b7830" gracePeriod=30 Jul 07 14:25:31.106019 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:31.105961 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" podUID="e22a677a-65e5-4ab3-8647-6c0bdf612c1a" containerName="kube-rbac-proxy" containerID="cri-o://11c2ba148cb664539a557014d1c2fa294894f5d7299ded4c82a3e13af7928e58" gracePeriod=30 Jul 07 14:25:31.202847 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:31.202810 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:25:31.240781 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:31.240746 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g"] Jul 07 14:25:31.241082 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:31.241058 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" podUID="743150c8-c506-4882-a72e-4a222b225ddf" containerName="kserve-container" containerID="cri-o://7384abf349f855a76223cf99fb855ada293dc6d595ea609036b445d76794ca57" gracePeriod=30 Jul 07 14:25:31.241156 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:31.241131 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" podUID="743150c8-c506-4882-a72e-4a222b225ddf" containerName="kube-rbac-proxy" containerID="cri-o://d7b1b59768dc3e4a42c67241c6965f6414b6f021cc6267446c092f1b985a3c28" gracePeriod=30 Jul 07 14:25:31.322687 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:31.322635 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:25:31.427771 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:31.427671 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:25:31.432654 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:31.432626 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7"] Jul 07 14:25:31.432890 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:31.432859 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" podUID="4d1eb367-5c69-4cab-8034-50ac36dc77ee" containerName="kserve-container" containerID="cri-o://c3e86eea2168054f94e77b583c6f06d186cc5df81e405d036f71731dfd507b9f" gracePeriod=30 Jul 07 14:25:31.432956 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:31.432896 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" podUID="4d1eb367-5c69-4cab-8034-50ac36dc77ee" containerName="kube-rbac-proxy" containerID="cri-o://b17e90e4c114ae7a764c3f3d7da67344203017b3eb1d6949a1b32fc52bf6a0bf" gracePeriod=30 Jul 07 14:25:31.524439 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:31.524410 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:25:31.991231 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:31.991192 2557 generic.go:356] "Generic (PLEG): container finished" podID="e22a677a-65e5-4ab3-8647-6c0bdf612c1a" containerID="11c2ba148cb664539a557014d1c2fa294894f5d7299ded4c82a3e13af7928e58" exitCode=2 Jul 07 14:25:31.991636 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:31.991270 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" event={"ID":"e22a677a-65e5-4ab3-8647-6c0bdf612c1a","Type":"ContainerDied","Data":"11c2ba148cb664539a557014d1c2fa294894f5d7299ded4c82a3e13af7928e58"} Jul 07 14:25:31.993268 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:31.993249 2557 generic.go:356] "Generic (PLEG): container finished" podID="4d1eb367-5c69-4cab-8034-50ac36dc77ee" containerID="b17e90e4c114ae7a764c3f3d7da67344203017b3eb1d6949a1b32fc52bf6a0bf" exitCode=2 Jul 07 14:25:31.993325 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:31.993313 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" event={"ID":"4d1eb367-5c69-4cab-8034-50ac36dc77ee","Type":"ContainerDied","Data":"b17e90e4c114ae7a764c3f3d7da67344203017b3eb1d6949a1b32fc52bf6a0bf"} Jul 07 14:25:31.995394 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:31.995372 2557 generic.go:356] "Generic (PLEG): container finished" podID="743150c8-c506-4882-a72e-4a222b225ddf" containerID="d7b1b59768dc3e4a42c67241c6965f6414b6f021cc6267446c092f1b985a3c28" exitCode=2 Jul 07 14:25:31.995556 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:31.995404 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" event={"ID":"743150c8-c506-4882-a72e-4a222b225ddf","Type":"ContainerDied","Data":"d7b1b59768dc3e4a42c67241c6965f6414b6f021cc6267446c092f1b985a3c28"} Jul 07 14:25:33.500666 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:33.500621 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" podUID="e22a677a-65e5-4ab3-8647-6c0bdf612c1a" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.24:8643/healthz\": dial tcp 10.133.0.24:8643: connect: connection refused" Jul 07 14:25:34.505207 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:34.505170 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" podUID="743150c8-c506-4882-a72e-4a222b225ddf" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.25:8643/healthz\": dial tcp 10.133.0.25:8643: connect: connection refused" Jul 07 14:25:34.505691 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:34.505161 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" podUID="4d1eb367-5c69-4cab-8034-50ac36dc77ee" containerName="kube-rbac-proxy" probeResult="failure" output="Get \"https://10.133.0.26:8643/healthz\": dial tcp 10.133.0.26:8643: connect: connection refused" Jul 07 14:25:34.510809 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:34.510779 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" podUID="743150c8-c506-4882-a72e-4a222b225ddf" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.25:8080: connect: connection refused" Jul 07 14:25:34.510929 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:34.510790 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" podUID="4d1eb367-5c69-4cab-8034-50ac36dc77ee" containerName="kserve-container" probeResult="failure" output="dial tcp 10.133.0.26:8080: connect: connection refused" Jul 07 14:25:35.195390 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:35.195364 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" Jul 07 14:25:35.285024 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:35.284937 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/743150c8-c506-4882-a72e-4a222b225ddf-kserve-provision-location\") pod \"743150c8-c506-4882-a72e-4a222b225ddf\" (UID: \"743150c8-c506-4882-a72e-4a222b225ddf\") " Jul 07 14:25:35.285024 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:35.284988 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/743150c8-c506-4882-a72e-4a222b225ddf-proxy-tls\") pod \"743150c8-c506-4882-a72e-4a222b225ddf\" (UID: \"743150c8-c506-4882-a72e-4a222b225ddf\") " Jul 07 14:25:35.285024 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:35.285019 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/743150c8-c506-4882-a72e-4a222b225ddf-kube-rbac-proxy-sar-config\") pod \"743150c8-c506-4882-a72e-4a222b225ddf\" (UID: \"743150c8-c506-4882-a72e-4a222b225ddf\") " Jul 07 14:25:35.285319 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:35.285063 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q942m\" (UniqueName: \"kubernetes.io/projected/743150c8-c506-4882-a72e-4a222b225ddf-kube-api-access-q942m\") pod \"743150c8-c506-4882-a72e-4a222b225ddf\" (UID: \"743150c8-c506-4882-a72e-4a222b225ddf\") " Jul 07 14:25:35.285319 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:35.285085 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/743150c8-c506-4882-a72e-4a222b225ddf-cabundle-cert\") pod \"743150c8-c506-4882-a72e-4a222b225ddf\" (UID: \"743150c8-c506-4882-a72e-4a222b225ddf\") " Jul 07 14:25:35.285319 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:35.285273 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/743150c8-c506-4882-a72e-4a222b225ddf-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "743150c8-c506-4882-a72e-4a222b225ddf" (UID: "743150c8-c506-4882-a72e-4a222b225ddf"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:25:35.285476 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:35.285420 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/743150c8-c506-4882-a72e-4a222b225ddf-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "743150c8-c506-4882-a72e-4a222b225ddf" (UID: "743150c8-c506-4882-a72e-4a222b225ddf"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:25:35.285544 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:35.285487 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/743150c8-c506-4882-a72e-4a222b225ddf-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "743150c8-c506-4882-a72e-4a222b225ddf" (UID: "743150c8-c506-4882-a72e-4a222b225ddf"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:25:35.287445 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:35.287418 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/743150c8-c506-4882-a72e-4a222b225ddf-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "743150c8-c506-4882-a72e-4a222b225ddf" (UID: "743150c8-c506-4882-a72e-4a222b225ddf"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:25:35.287445 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:35.287428 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/743150c8-c506-4882-a72e-4a222b225ddf-kube-api-access-q942m" (OuterVolumeSpecName: "kube-api-access-q942m") pod "743150c8-c506-4882-a72e-4a222b225ddf" (UID: "743150c8-c506-4882-a72e-4a222b225ddf"). InnerVolumeSpecName "kube-api-access-q942m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:25:35.386217 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:35.386176 2557 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/743150c8-c506-4882-a72e-4a222b225ddf-proxy-tls\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 07 14:25:35.386217 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:35.386211 2557 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/743150c8-c506-4882-a72e-4a222b225ddf-kube-rbac-proxy-sar-config\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 07 14:25:35.386217 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:35.386225 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q942m\" (UniqueName: \"kubernetes.io/projected/743150c8-c506-4882-a72e-4a222b225ddf-kube-api-access-q942m\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 07 14:25:35.386461 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:35.386237 2557 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/743150c8-c506-4882-a72e-4a222b225ddf-cabundle-cert\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 07 14:25:35.386461 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:35.386250 2557 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/743150c8-c506-4882-a72e-4a222b225ddf-kserve-provision-location\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 07 14:25:36.014325 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.014291 2557 generic.go:356] "Generic (PLEG): container finished" podID="743150c8-c506-4882-a72e-4a222b225ddf" containerID="7384abf349f855a76223cf99fb855ada293dc6d595ea609036b445d76794ca57" exitCode=0 Jul 07 14:25:36.014734 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.014354 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" Jul 07 14:25:36.014734 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.014367 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" event={"ID":"743150c8-c506-4882-a72e-4a222b225ddf","Type":"ContainerDied","Data":"7384abf349f855a76223cf99fb855ada293dc6d595ea609036b445d76794ca57"} Jul 07 14:25:36.014734 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.014437 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g" event={"ID":"743150c8-c506-4882-a72e-4a222b225ddf","Type":"ContainerDied","Data":"119da15efe444353c75ae404551e2878feea6cce53d7003a6528ae4a68e46ba4"} Jul 07 14:25:36.014734 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.014474 2557 scope.go:117] "RemoveContainer" containerID="d7b1b59768dc3e4a42c67241c6965f6414b6f021cc6267446c092f1b985a3c28" Jul 07 14:25:36.023398 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.023379 2557 scope.go:117] "RemoveContainer" containerID="7384abf349f855a76223cf99fb855ada293dc6d595ea609036b445d76794ca57" Jul 07 14:25:36.031180 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.031163 2557 scope.go:117] "RemoveContainer" containerID="88a1916519acfffd7e826b76edd9045ad3779b5fd2d255b8be4023be2e95f5c4" Jul 07 14:25:36.038797 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.038777 2557 scope.go:117] "RemoveContainer" containerID="d7b1b59768dc3e4a42c67241c6965f6414b6f021cc6267446c092f1b985a3c28" Jul 07 14:25:36.039117 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:25:36.039092 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7b1b59768dc3e4a42c67241c6965f6414b6f021cc6267446c092f1b985a3c28\": container with ID starting with d7b1b59768dc3e4a42c67241c6965f6414b6f021cc6267446c092f1b985a3c28 not found: ID does not exist" containerID="d7b1b59768dc3e4a42c67241c6965f6414b6f021cc6267446c092f1b985a3c28" Jul 07 14:25:36.039215 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.039126 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7b1b59768dc3e4a42c67241c6965f6414b6f021cc6267446c092f1b985a3c28"} err="failed to get container status \"d7b1b59768dc3e4a42c67241c6965f6414b6f021cc6267446c092f1b985a3c28\": rpc error: code = NotFound desc = could not find container \"d7b1b59768dc3e4a42c67241c6965f6414b6f021cc6267446c092f1b985a3c28\": container with ID starting with d7b1b59768dc3e4a42c67241c6965f6414b6f021cc6267446c092f1b985a3c28 not found: ID does not exist" Jul 07 14:25:36.039215 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.039145 2557 scope.go:117] "RemoveContainer" containerID="7384abf349f855a76223cf99fb855ada293dc6d595ea609036b445d76794ca57" Jul 07 14:25:36.039392 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:25:36.039373 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7384abf349f855a76223cf99fb855ada293dc6d595ea609036b445d76794ca57\": container with ID starting with 7384abf349f855a76223cf99fb855ada293dc6d595ea609036b445d76794ca57 not found: ID does not exist" containerID="7384abf349f855a76223cf99fb855ada293dc6d595ea609036b445d76794ca57" Jul 07 14:25:36.039432 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.039402 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7384abf349f855a76223cf99fb855ada293dc6d595ea609036b445d76794ca57"} err="failed to get container status \"7384abf349f855a76223cf99fb855ada293dc6d595ea609036b445d76794ca57\": rpc error: code = NotFound desc = could not find container \"7384abf349f855a76223cf99fb855ada293dc6d595ea609036b445d76794ca57\": container with ID starting with 7384abf349f855a76223cf99fb855ada293dc6d595ea609036b445d76794ca57 not found: ID does not exist" Jul 07 14:25:36.039432 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.039424 2557 scope.go:117] "RemoveContainer" containerID="88a1916519acfffd7e826b76edd9045ad3779b5fd2d255b8be4023be2e95f5c4" Jul 07 14:25:36.039699 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:25:36.039681 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88a1916519acfffd7e826b76edd9045ad3779b5fd2d255b8be4023be2e95f5c4\": container with ID starting with 88a1916519acfffd7e826b76edd9045ad3779b5fd2d255b8be4023be2e95f5c4 not found: ID does not exist" containerID="88a1916519acfffd7e826b76edd9045ad3779b5fd2d255b8be4023be2e95f5c4" Jul 07 14:25:36.039749 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.039703 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88a1916519acfffd7e826b76edd9045ad3779b5fd2d255b8be4023be2e95f5c4"} err="failed to get container status \"88a1916519acfffd7e826b76edd9045ad3779b5fd2d255b8be4023be2e95f5c4\": rpc error: code = NotFound desc = could not find container \"88a1916519acfffd7e826b76edd9045ad3779b5fd2d255b8be4023be2e95f5c4\": container with ID starting with 88a1916519acfffd7e826b76edd9045ad3779b5fd2d255b8be4023be2e95f5c4 not found: ID does not exist" Jul 07 14:25:36.043547 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.043525 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g"] Jul 07 14:25:36.049439 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.049412 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-xgboost-graph-predictor-555fc69d56-d2s8g"] Jul 07 14:25:36.256893 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.256869 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" Jul 07 14:25:36.295489 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.295421 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e22a677a-65e5-4ab3-8647-6c0bdf612c1a-cabundle-cert\") pod \"e22a677a-65e5-4ab3-8647-6c0bdf612c1a\" (UID: \"e22a677a-65e5-4ab3-8647-6c0bdf612c1a\") " Jul 07 14:25:36.295489 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.295477 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e22a677a-65e5-4ab3-8647-6c0bdf612c1a-proxy-tls\") pod \"e22a677a-65e5-4ab3-8647-6c0bdf612c1a\" (UID: \"e22a677a-65e5-4ab3-8647-6c0bdf612c1a\") " Jul 07 14:25:36.295720 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.295522 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e22a677a-65e5-4ab3-8647-6c0bdf612c1a-kserve-provision-location\") pod \"e22a677a-65e5-4ab3-8647-6c0bdf612c1a\" (UID: \"e22a677a-65e5-4ab3-8647-6c0bdf612c1a\") " Jul 07 14:25:36.295720 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.295552 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gshc2\" (UniqueName: \"kubernetes.io/projected/e22a677a-65e5-4ab3-8647-6c0bdf612c1a-kube-api-access-gshc2\") pod \"e22a677a-65e5-4ab3-8647-6c0bdf612c1a\" (UID: \"e22a677a-65e5-4ab3-8647-6c0bdf612c1a\") " Jul 07 14:25:36.295720 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.295588 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e22a677a-65e5-4ab3-8647-6c0bdf612c1a-kube-rbac-proxy-sar-config\") pod \"e22a677a-65e5-4ab3-8647-6c0bdf612c1a\" (UID: \"e22a677a-65e5-4ab3-8647-6c0bdf612c1a\") " Jul 07 14:25:36.295940 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.295898 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e22a677a-65e5-4ab3-8647-6c0bdf612c1a-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "e22a677a-65e5-4ab3-8647-6c0bdf612c1a" (UID: "e22a677a-65e5-4ab3-8647-6c0bdf612c1a"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:25:36.295997 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.295982 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e22a677a-65e5-4ab3-8647-6c0bdf612c1a-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "e22a677a-65e5-4ab3-8647-6c0bdf612c1a" (UID: "e22a677a-65e5-4ab3-8647-6c0bdf612c1a"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:25:36.296048 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.296027 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e22a677a-65e5-4ab3-8647-6c0bdf612c1a-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "e22a677a-65e5-4ab3-8647-6c0bdf612c1a" (UID: "e22a677a-65e5-4ab3-8647-6c0bdf612c1a"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:25:36.297946 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.297913 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e22a677a-65e5-4ab3-8647-6c0bdf612c1a-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "e22a677a-65e5-4ab3-8647-6c0bdf612c1a" (UID: "e22a677a-65e5-4ab3-8647-6c0bdf612c1a"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:25:36.298057 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.297959 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e22a677a-65e5-4ab3-8647-6c0bdf612c1a-kube-api-access-gshc2" (OuterVolumeSpecName: "kube-api-access-gshc2") pod "e22a677a-65e5-4ab3-8647-6c0bdf612c1a" (UID: "e22a677a-65e5-4ab3-8647-6c0bdf612c1a"). InnerVolumeSpecName "kube-api-access-gshc2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:25:36.397139 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.397102 2557 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/e22a677a-65e5-4ab3-8647-6c0bdf612c1a-cabundle-cert\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 07 14:25:36.397139 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.397133 2557 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/e22a677a-65e5-4ab3-8647-6c0bdf612c1a-proxy-tls\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 07 14:25:36.397139 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.397143 2557 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e22a677a-65e5-4ab3-8647-6c0bdf612c1a-kserve-provision-location\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 07 14:25:36.397371 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.397154 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gshc2\" (UniqueName: \"kubernetes.io/projected/e22a677a-65e5-4ab3-8647-6c0bdf612c1a-kube-api-access-gshc2\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 07 14:25:36.397371 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.397164 2557 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/e22a677a-65e5-4ab3-8647-6c0bdf612c1a-kube-rbac-proxy-sar-config\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 07 14:25:36.870716 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.870690 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" Jul 07 14:25:36.899819 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.899790 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jp6z\" (UniqueName: \"kubernetes.io/projected/4d1eb367-5c69-4cab-8034-50ac36dc77ee-kube-api-access-5jp6z\") pod \"4d1eb367-5c69-4cab-8034-50ac36dc77ee\" (UID: \"4d1eb367-5c69-4cab-8034-50ac36dc77ee\") " Jul 07 14:25:36.899981 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.899847 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4d1eb367-5c69-4cab-8034-50ac36dc77ee-cabundle-cert\") pod \"4d1eb367-5c69-4cab-8034-50ac36dc77ee\" (UID: \"4d1eb367-5c69-4cab-8034-50ac36dc77ee\") " Jul 07 14:25:36.899981 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.899891 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4d1eb367-5c69-4cab-8034-50ac36dc77ee-proxy-tls\") pod \"4d1eb367-5c69-4cab-8034-50ac36dc77ee\" (UID: \"4d1eb367-5c69-4cab-8034-50ac36dc77ee\") " Jul 07 14:25:36.899981 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.899954 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4d1eb367-5c69-4cab-8034-50ac36dc77ee-kube-rbac-proxy-sar-config\") pod \"4d1eb367-5c69-4cab-8034-50ac36dc77ee\" (UID: \"4d1eb367-5c69-4cab-8034-50ac36dc77ee\") " Jul 07 14:25:36.900145 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.899996 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4d1eb367-5c69-4cab-8034-50ac36dc77ee-kserve-provision-location\") pod \"4d1eb367-5c69-4cab-8034-50ac36dc77ee\" (UID: \"4d1eb367-5c69-4cab-8034-50ac36dc77ee\") " Jul 07 14:25:36.900321 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.900289 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d1eb367-5c69-4cab-8034-50ac36dc77ee-cabundle-cert" (OuterVolumeSpecName: "cabundle-cert") pod "4d1eb367-5c69-4cab-8034-50ac36dc77ee" (UID: "4d1eb367-5c69-4cab-8034-50ac36dc77ee"). InnerVolumeSpecName "cabundle-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:25:36.900321 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.900297 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d1eb367-5c69-4cab-8034-50ac36dc77ee-kube-rbac-proxy-sar-config" (OuterVolumeSpecName: "kube-rbac-proxy-sar-config") pod "4d1eb367-5c69-4cab-8034-50ac36dc77ee" (UID: "4d1eb367-5c69-4cab-8034-50ac36dc77ee"). InnerVolumeSpecName "kube-rbac-proxy-sar-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:25:36.900524 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.900466 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d1eb367-5c69-4cab-8034-50ac36dc77ee-kserve-provision-location" (OuterVolumeSpecName: "kserve-provision-location") pod "4d1eb367-5c69-4cab-8034-50ac36dc77ee" (UID: "4d1eb367-5c69-4cab-8034-50ac36dc77ee"). InnerVolumeSpecName "kserve-provision-location". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:25:36.902755 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.902725 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d1eb367-5c69-4cab-8034-50ac36dc77ee-kube-api-access-5jp6z" (OuterVolumeSpecName: "kube-api-access-5jp6z") pod "4d1eb367-5c69-4cab-8034-50ac36dc77ee" (UID: "4d1eb367-5c69-4cab-8034-50ac36dc77ee"). InnerVolumeSpecName "kube-api-access-5jp6z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:25:36.902755 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:36.902739 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d1eb367-5c69-4cab-8034-50ac36dc77ee-proxy-tls" (OuterVolumeSpecName: "proxy-tls") pod "4d1eb367-5c69-4cab-8034-50ac36dc77ee" (UID: "4d1eb367-5c69-4cab-8034-50ac36dc77ee"). InnerVolumeSpecName "proxy-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:25:37.001529 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.001418 2557 reconciler_common.go:299] "Volume detached for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4d1eb367-5c69-4cab-8034-50ac36dc77ee-kserve-provision-location\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 07 14:25:37.001529 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.001451 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jp6z\" (UniqueName: \"kubernetes.io/projected/4d1eb367-5c69-4cab-8034-50ac36dc77ee-kube-api-access-5jp6z\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 07 14:25:37.001529 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.001461 2557 reconciler_common.go:299] "Volume detached for volume \"cabundle-cert\" (UniqueName: \"kubernetes.io/configmap/4d1eb367-5c69-4cab-8034-50ac36dc77ee-cabundle-cert\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 07 14:25:37.001529 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.001493 2557 reconciler_common.go:299] "Volume detached for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/4d1eb367-5c69-4cab-8034-50ac36dc77ee-proxy-tls\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 07 14:25:37.001529 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.001523 2557 reconciler_common.go:299] "Volume detached for volume \"kube-rbac-proxy-sar-config\" (UniqueName: \"kubernetes.io/configmap/4d1eb367-5c69-4cab-8034-50ac36dc77ee-kube-rbac-proxy-sar-config\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 07 14:25:37.021347 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.021306 2557 generic.go:356] "Generic (PLEG): container finished" podID="4d1eb367-5c69-4cab-8034-50ac36dc77ee" containerID="c3e86eea2168054f94e77b583c6f06d186cc5df81e405d036f71731dfd507b9f" exitCode=0 Jul 07 14:25:37.021793 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.021372 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" Jul 07 14:25:37.021793 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.021388 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" event={"ID":"4d1eb367-5c69-4cab-8034-50ac36dc77ee","Type":"ContainerDied","Data":"c3e86eea2168054f94e77b583c6f06d186cc5df81e405d036f71731dfd507b9f"} Jul 07 14:25:37.021793 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.021458 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7" event={"ID":"4d1eb367-5c69-4cab-8034-50ac36dc77ee","Type":"ContainerDied","Data":"4c673411eec699f3ddc180c0bc9489e0ae8f81d5fbf0d4579d3aa837fa7a4f36"} Jul 07 14:25:37.021793 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.021496 2557 scope.go:117] "RemoveContainer" containerID="b17e90e4c114ae7a764c3f3d7da67344203017b3eb1d6949a1b32fc52bf6a0bf" Jul 07 14:25:37.024609 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.024586 2557 generic.go:356] "Generic (PLEG): container finished" podID="e22a677a-65e5-4ab3-8647-6c0bdf612c1a" containerID="64ea39bc987a5fa37d344063bb48068a252ac6bce2185ee9960b754a060b7830" exitCode=0 Jul 07 14:25:37.024744 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.024620 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" event={"ID":"e22a677a-65e5-4ab3-8647-6c0bdf612c1a","Type":"ContainerDied","Data":"64ea39bc987a5fa37d344063bb48068a252ac6bce2185ee9960b754a060b7830"} Jul 07 14:25:37.024744 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.024662 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" Jul 07 14:25:37.024744 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.024686 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t" event={"ID":"e22a677a-65e5-4ab3-8647-6c0bdf612c1a","Type":"ContainerDied","Data":"7224ad96f9ab909dccf1503082c8397420126e082c282a7b1cbd46a8da787e25"} Jul 07 14:25:37.030841 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.030403 2557 scope.go:117] "RemoveContainer" containerID="c3e86eea2168054f94e77b583c6f06d186cc5df81e405d036f71731dfd507b9f" Jul 07 14:25:37.038650 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.038632 2557 scope.go:117] "RemoveContainer" containerID="413dc7fe4fc671fd319c71d0ed6fa45a2e2f510acd813ddd5579f9014072a43c" Jul 07 14:25:37.046630 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.046609 2557 scope.go:117] "RemoveContainer" containerID="b17e90e4c114ae7a764c3f3d7da67344203017b3eb1d6949a1b32fc52bf6a0bf" Jul 07 14:25:37.046894 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:25:37.046873 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b17e90e4c114ae7a764c3f3d7da67344203017b3eb1d6949a1b32fc52bf6a0bf\": container with ID starting with b17e90e4c114ae7a764c3f3d7da67344203017b3eb1d6949a1b32fc52bf6a0bf not found: ID does not exist" containerID="b17e90e4c114ae7a764c3f3d7da67344203017b3eb1d6949a1b32fc52bf6a0bf" Jul 07 14:25:37.046973 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.046905 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b17e90e4c114ae7a764c3f3d7da67344203017b3eb1d6949a1b32fc52bf6a0bf"} err="failed to get container status \"b17e90e4c114ae7a764c3f3d7da67344203017b3eb1d6949a1b32fc52bf6a0bf\": rpc error: code = NotFound desc = could not find container \"b17e90e4c114ae7a764c3f3d7da67344203017b3eb1d6949a1b32fc52bf6a0bf\": container with ID starting with b17e90e4c114ae7a764c3f3d7da67344203017b3eb1d6949a1b32fc52bf6a0bf not found: ID does not exist" Jul 07 14:25:37.046973 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.046929 2557 scope.go:117] "RemoveContainer" containerID="c3e86eea2168054f94e77b583c6f06d186cc5df81e405d036f71731dfd507b9f" Jul 07 14:25:37.047073 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.047019 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7"] Jul 07 14:25:37.047210 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:25:37.047195 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3e86eea2168054f94e77b583c6f06d186cc5df81e405d036f71731dfd507b9f\": container with ID starting with c3e86eea2168054f94e77b583c6f06d186cc5df81e405d036f71731dfd507b9f not found: ID does not exist" containerID="c3e86eea2168054f94e77b583c6f06d186cc5df81e405d036f71731dfd507b9f" Jul 07 14:25:37.047246 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.047217 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3e86eea2168054f94e77b583c6f06d186cc5df81e405d036f71731dfd507b9f"} err="failed to get container status \"c3e86eea2168054f94e77b583c6f06d186cc5df81e405d036f71731dfd507b9f\": rpc error: code = NotFound desc = could not find container \"c3e86eea2168054f94e77b583c6f06d186cc5df81e405d036f71731dfd507b9f\": container with ID starting with c3e86eea2168054f94e77b583c6f06d186cc5df81e405d036f71731dfd507b9f not found: ID does not exist" Jul 07 14:25:37.047246 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.047237 2557 scope.go:117] "RemoveContainer" containerID="413dc7fe4fc671fd319c71d0ed6fa45a2e2f510acd813ddd5579f9014072a43c" Jul 07 14:25:37.047469 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:25:37.047453 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"413dc7fe4fc671fd319c71d0ed6fa45a2e2f510acd813ddd5579f9014072a43c\": container with ID starting with 413dc7fe4fc671fd319c71d0ed6fa45a2e2f510acd813ddd5579f9014072a43c not found: ID does not exist" containerID="413dc7fe4fc671fd319c71d0ed6fa45a2e2f510acd813ddd5579f9014072a43c" Jul 07 14:25:37.047557 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.047476 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"413dc7fe4fc671fd319c71d0ed6fa45a2e2f510acd813ddd5579f9014072a43c"} err="failed to get container status \"413dc7fe4fc671fd319c71d0ed6fa45a2e2f510acd813ddd5579f9014072a43c\": rpc error: code = NotFound desc = could not find container \"413dc7fe4fc671fd319c71d0ed6fa45a2e2f510acd813ddd5579f9014072a43c\": container with ID starting with 413dc7fe4fc671fd319c71d0ed6fa45a2e2f510acd813ddd5579f9014072a43c not found: ID does not exist" Jul 07 14:25:37.047557 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.047494 2557 scope.go:117] "RemoveContainer" containerID="11c2ba148cb664539a557014d1c2fa294894f5d7299ded4c82a3e13af7928e58" Jul 07 14:25:37.052812 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.052794 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-2-predictor-6c8478f9b5-rffx7"] Jul 07 14:25:37.055868 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.055851 2557 scope.go:117] "RemoveContainer" containerID="64ea39bc987a5fa37d344063bb48068a252ac6bce2185ee9960b754a060b7830" Jul 07 14:25:37.064015 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.063996 2557 scope.go:117] "RemoveContainer" containerID="96d4734f7d1abee2f477c6ff4e02028e110e3dbfbbb86dc12b25f4b25c9b95a0" Jul 07 14:25:37.065029 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.065011 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t"] Jul 07 14:25:37.069065 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.069043 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve-ci-e2e-test/isvc-sklearn-graph-1-predictor-875bcd459-2cg9t"] Jul 07 14:25:37.071986 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.071966 2557 scope.go:117] "RemoveContainer" containerID="11c2ba148cb664539a557014d1c2fa294894f5d7299ded4c82a3e13af7928e58" Jul 07 14:25:37.072239 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:25:37.072221 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11c2ba148cb664539a557014d1c2fa294894f5d7299ded4c82a3e13af7928e58\": container with ID starting with 11c2ba148cb664539a557014d1c2fa294894f5d7299ded4c82a3e13af7928e58 not found: ID does not exist" containerID="11c2ba148cb664539a557014d1c2fa294894f5d7299ded4c82a3e13af7928e58" Jul 07 14:25:37.072288 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.072246 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11c2ba148cb664539a557014d1c2fa294894f5d7299ded4c82a3e13af7928e58"} err="failed to get container status \"11c2ba148cb664539a557014d1c2fa294894f5d7299ded4c82a3e13af7928e58\": rpc error: code = NotFound desc = could not find container \"11c2ba148cb664539a557014d1c2fa294894f5d7299ded4c82a3e13af7928e58\": container with ID starting with 11c2ba148cb664539a557014d1c2fa294894f5d7299ded4c82a3e13af7928e58 not found: ID does not exist" Jul 07 14:25:37.072288 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.072264 2557 scope.go:117] "RemoveContainer" containerID="64ea39bc987a5fa37d344063bb48068a252ac6bce2185ee9960b754a060b7830" Jul 07 14:25:37.072494 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:25:37.072473 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64ea39bc987a5fa37d344063bb48068a252ac6bce2185ee9960b754a060b7830\": container with ID starting with 64ea39bc987a5fa37d344063bb48068a252ac6bce2185ee9960b754a060b7830 not found: ID does not exist" containerID="64ea39bc987a5fa37d344063bb48068a252ac6bce2185ee9960b754a060b7830" Jul 07 14:25:37.072560 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.072527 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64ea39bc987a5fa37d344063bb48068a252ac6bce2185ee9960b754a060b7830"} err="failed to get container status \"64ea39bc987a5fa37d344063bb48068a252ac6bce2185ee9960b754a060b7830\": rpc error: code = NotFound desc = could not find container \"64ea39bc987a5fa37d344063bb48068a252ac6bce2185ee9960b754a060b7830\": container with ID starting with 64ea39bc987a5fa37d344063bb48068a252ac6bce2185ee9960b754a060b7830 not found: ID does not exist" Jul 07 14:25:37.072560 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.072543 2557 scope.go:117] "RemoveContainer" containerID="96d4734f7d1abee2f477c6ff4e02028e110e3dbfbbb86dc12b25f4b25c9b95a0" Jul 07 14:25:37.072803 ip-10-0-130-152 kubenswrapper[2557]: E0707 14:25:37.072787 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96d4734f7d1abee2f477c6ff4e02028e110e3dbfbbb86dc12b25f4b25c9b95a0\": container with ID starting with 96d4734f7d1abee2f477c6ff4e02028e110e3dbfbbb86dc12b25f4b25c9b95a0 not found: ID does not exist" containerID="96d4734f7d1abee2f477c6ff4e02028e110e3dbfbbb86dc12b25f4b25c9b95a0" Jul 07 14:25:37.072849 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.072808 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96d4734f7d1abee2f477c6ff4e02028e110e3dbfbbb86dc12b25f4b25c9b95a0"} err="failed to get container status \"96d4734f7d1abee2f477c6ff4e02028e110e3dbfbbb86dc12b25f4b25c9b95a0\": rpc error: code = NotFound desc = could not find container \"96d4734f7d1abee2f477c6ff4e02028e110e3dbfbbb86dc12b25f4b25c9b95a0\": container with ID starting with 96d4734f7d1abee2f477c6ff4e02028e110e3dbfbbb86dc12b25f4b25c9b95a0 not found: ID does not exist" Jul 07 14:25:37.100588 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.100560 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d1eb367-5c69-4cab-8034-50ac36dc77ee" path="/var/lib/kubelet/pods/4d1eb367-5c69-4cab-8034-50ac36dc77ee/volumes" Jul 07 14:25:37.101056 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.101042 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="743150c8-c506-4882-a72e-4a222b225ddf" path="/var/lib/kubelet/pods/743150c8-c506-4882-a72e-4a222b225ddf/volumes" Jul 07 14:25:37.101627 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:37.101604 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e22a677a-65e5-4ab3-8647-6c0bdf612c1a" path="/var/lib/kubelet/pods/e22a677a-65e5-4ab3-8647-6c0bdf612c1a/volumes" Jul 07 14:25:41.130642 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:41.130595 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:25:41.254381 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:25:41.254342 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:26:31.081161 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:26:31.081117 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:26:31.315545 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:26:31.315491 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:29:07.049714 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:29:07.049679 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b66mb_82df755c-beec-4653-96a6-691507fee3e7/console-operator/1.log" Jul 07 14:29:07.050342 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:29:07.050318 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b66mb_82df755c-beec-4653-96a6-691507fee3e7/console-operator/1.log" Jul 07 14:30:33.402046 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:30:33.401956 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:30:35.470108 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:30:35.470076 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:31:52.779955 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:31:52.779919 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:32:29.989514 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:32:29.989431 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:33:57.322862 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:33:57.322822 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:33:57.408876 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:33:57.408845 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:34:07.074304 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:34:07.074266 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b66mb_82df755c-beec-4653-96a6-691507fee3e7/console-operator/1.log" Jul 07 14:34:07.077105 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:34:07.077083 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b66mb_82df755c-beec-4653-96a6-691507fee3e7/console-operator/1.log" Jul 07 14:34:45.631518 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:34:45.631460 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:34:45.757385 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:34:45.757350 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:34:45.858606 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:34:45.858573 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:34:45.967665 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:34:45.967638 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:34:46.310966 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:34:46.310867 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:34:56.126061 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:34:56.126024 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:34:56.351945 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:34:56.351907 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:35:06.214393 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:35:06.214334 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:35:06.322481 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:35:06.322448 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:35:06.453650 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:35:06.453601 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:35:06.594337 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:35:06.594251 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:35:06.696470 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:35:06.696441 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:35:06.862589 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:35:06.862469 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:35:45.802125 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:35:45.802087 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:35:47.288448 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:35:47.288414 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:35:55.972090 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:35:55.972045 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:35:56.065035 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:35:56.064993 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:35:56.162830 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:35:56.162792 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:35:56.268975 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:35:56.268890 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:35:56.367613 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:35:56.367568 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:36:06.419706 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:36:06.419667 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:36:06.687267 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:36:06.687174 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:36:56.135724 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:36:56.135692 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:36:56.793492 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:36:56.793459 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:37:26.874550 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:37:26.874488 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:37:45.513587 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:37:45.513544 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:37:53.657462 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:37:53.657411 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:39:07.103153 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:39:07.103122 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b66mb_82df755c-beec-4653-96a6-691507fee3e7/console-operator/1.log" Jul 07 14:39:07.108346 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:39:07.108317 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b66mb_82df755c-beec-4653-96a6-691507fee3e7/console-operator/1.log" Jul 07 14:43:46.464069 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:43:46.464038 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:44:07.131289 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:44:07.131259 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b66mb_82df755c-beec-4653-96a6-691507fee3e7/console-operator/1.log" Jul 07 14:44:07.138069 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:44:07.138029 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b66mb_82df755c-beec-4653-96a6-691507fee3e7/console-operator/1.log" Jul 07 14:44:21.121048 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:44:21.121000 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:44:21.238117 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:44:21.238083 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:44:21.334365 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:44:21.334325 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:44:21.408810 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:44:21.408729 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:44:21.472531 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:44:21.472488 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:44:21.572826 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:44:21.572791 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:44:21.709082 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:44:21.709030 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:45:10.866192 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:45:10.866110 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:45:10.968108 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:45:10.968078 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:45:11.061900 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:45:11.061864 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:45:11.121631 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:45:11.121546 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:45:11.222096 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:45:11.222062 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:45:11.443805 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:45:11.443717 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:45:11.543934 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:45:11.543897 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:45:21.329592 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:45:21.329557 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:45:21.598473 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:45:21.598380 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:45:31.424605 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:45:31.424523 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:45:31.534686 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:45:31.534648 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:45:31.627749 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:45:31.627719 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:45:31.699311 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:45:31.699227 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:45:31.964649 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:45:31.964617 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:45:32.065235 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:45:32.065195 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:45:55.049003 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:45:55.048970 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:46:11.047492 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:46:11.047459 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:46:11.487860 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:46:11.487826 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:46:17.138209 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:46:17.138177 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:46:31.619607 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:46:31.619568 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:46:31.845005 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:46:31.844971 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:49:07.160173 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:49:07.160147 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b66mb_82df755c-beec-4653-96a6-691507fee3e7/console-operator/1.log" Jul 07 14:49:07.166797 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:49:07.166769 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b66mb_82df755c-beec-4653-96a6-691507fee3e7/console-operator/1.log" Jul 07 14:52:13.645969 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:52:13.645917 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:53:07.464686 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:53:07.464646 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:54:07.188231 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:54:07.188112 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b66mb_82df755c-beec-4653-96a6-691507fee3e7/console-operator/1.log" Jul 07 14:54:07.194303 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:54:07.194280 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b66mb_82df755c-beec-4653-96a6-691507fee3e7/console-operator/1.log" Jul 07 14:54:46.363200 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:54:46.363150 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:54:46.512787 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:54:46.512744 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:54:46.599215 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:54:46.599182 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:58:21.210305 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:58:21.210261 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 14:59:07.214108 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:59:07.214077 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b66mb_82df755c-beec-4653-96a6-691507fee3e7/console-operator/1.log" Jul 07 14:59:07.220253 ip-10-0-130-152 kubenswrapper[2557]: I0707 14:59:07.220228 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b66mb_82df755c-beec-4653-96a6-691507fee3e7/console-operator/1.log" Jul 07 15:02:01.942484 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:01.942447 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:30.170755 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:30.170721 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:30.379335 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:30.379304 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:30.478489 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:30.478462 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:31.819373 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:31.819323 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9dp88/must-gather-l8jfw"] Jul 07 15:02:31.819820 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:31.819661 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="743150c8-c506-4882-a72e-4a222b225ddf" containerName="kube-rbac-proxy" Jul 07 15:02:31.819820 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:31.819673 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="743150c8-c506-4882-a72e-4a222b225ddf" containerName="kube-rbac-proxy" Jul 07 15:02:31.819820 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:31.819680 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e22a677a-65e5-4ab3-8647-6c0bdf612c1a" containerName="kserve-container" Jul 07 15:02:31.819820 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:31.819687 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e22a677a-65e5-4ab3-8647-6c0bdf612c1a" containerName="kserve-container" Jul 07 15:02:31.819820 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:31.819696 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="743150c8-c506-4882-a72e-4a222b225ddf" containerName="kserve-container" Jul 07 15:02:31.819820 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:31.819706 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="743150c8-c506-4882-a72e-4a222b225ddf" containerName="kserve-container" Jul 07 15:02:31.819820 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:31.819721 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d1eb367-5c69-4cab-8034-50ac36dc77ee" containerName="kserve-container" Jul 07 15:02:31.819820 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:31.819730 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d1eb367-5c69-4cab-8034-50ac36dc77ee" containerName="kserve-container" Jul 07 15:02:31.819820 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:31.819746 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d1eb367-5c69-4cab-8034-50ac36dc77ee" containerName="kube-rbac-proxy" Jul 07 15:02:31.819820 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:31.819754 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d1eb367-5c69-4cab-8034-50ac36dc77ee" containerName="kube-rbac-proxy" Jul 07 15:02:31.819820 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:31.819764 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e22a677a-65e5-4ab3-8647-6c0bdf612c1a" containerName="kube-rbac-proxy" Jul 07 15:02:31.819820 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:31.819772 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e22a677a-65e5-4ab3-8647-6c0bdf612c1a" containerName="kube-rbac-proxy" Jul 07 15:02:31.819820 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:31.819784 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="743150c8-c506-4882-a72e-4a222b225ddf" containerName="storage-initializer" Jul 07 15:02:31.819820 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:31.819793 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="743150c8-c506-4882-a72e-4a222b225ddf" containerName="storage-initializer" Jul 07 15:02:31.819820 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:31.819803 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e22a677a-65e5-4ab3-8647-6c0bdf612c1a" containerName="storage-initializer" Jul 07 15:02:31.819820 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:31.819809 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e22a677a-65e5-4ab3-8647-6c0bdf612c1a" containerName="storage-initializer" Jul 07 15:02:31.819820 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:31.819817 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d1eb367-5c69-4cab-8034-50ac36dc77ee" containerName="storage-initializer" Jul 07 15:02:31.819820 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:31.819822 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d1eb367-5c69-4cab-8034-50ac36dc77ee" containerName="storage-initializer" Jul 07 15:02:31.820398 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:31.819903 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="743150c8-c506-4882-a72e-4a222b225ddf" containerName="kube-rbac-proxy" Jul 07 15:02:31.820398 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:31.819913 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e22a677a-65e5-4ab3-8647-6c0bdf612c1a" containerName="kube-rbac-proxy" Jul 07 15:02:31.820398 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:31.819919 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="743150c8-c506-4882-a72e-4a222b225ddf" containerName="kserve-container" Jul 07 15:02:31.820398 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:31.819926 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e22a677a-65e5-4ab3-8647-6c0bdf612c1a" containerName="kserve-container" Jul 07 15:02:31.820398 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:31.819931 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d1eb367-5c69-4cab-8034-50ac36dc77ee" containerName="kserve-container" Jul 07 15:02:31.820398 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:31.819937 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d1eb367-5c69-4cab-8034-50ac36dc77ee" containerName="kube-rbac-proxy" Jul 07 15:02:31.822539 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:31.822497 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9dp88/must-gather-l8jfw" Jul 07 15:02:31.825079 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:31.825059 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9dp88\"/\"default-dockercfg-8j58z\"" Jul 07 15:02:31.826393 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:31.826367 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9dp88\"/\"openshift-service-ca.crt\"" Jul 07 15:02:31.826542 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:31.826407 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9dp88\"/\"kube-root-ca.crt\"" Jul 07 15:02:31.835738 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:31.835713 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9dp88/must-gather-l8jfw"] Jul 07 15:02:31.844560 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:31.844534 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:31.938194 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:31.938158 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 15:02:31.958857 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:31.958828 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/53d9ba40-9322-4da9-b093-6717ce9ecc36-must-gather-output\") pod \"must-gather-l8jfw\" (UID: \"53d9ba40-9322-4da9-b093-6717ce9ecc36\") " pod="openshift-must-gather-9dp88/must-gather-l8jfw" Jul 07 15:02:31.959008 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:31.958878 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw5cb\" (UniqueName: \"kubernetes.io/projected/53d9ba40-9322-4da9-b093-6717ce9ecc36-kube-api-access-pw5cb\") pod \"must-gather-l8jfw\" (UID: \"53d9ba40-9322-4da9-b093-6717ce9ecc36\") " pod="openshift-must-gather-9dp88/must-gather-l8jfw" Jul 07 15:02:32.059782 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:32.059745 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/53d9ba40-9322-4da9-b093-6717ce9ecc36-must-gather-output\") pod \"must-gather-l8jfw\" (UID: \"53d9ba40-9322-4da9-b093-6717ce9ecc36\") " pod="openshift-must-gather-9dp88/must-gather-l8jfw" Jul 07 15:02:32.059934 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:32.059796 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw5cb\" (UniqueName: \"kubernetes.io/projected/53d9ba40-9322-4da9-b093-6717ce9ecc36-kube-api-access-pw5cb\") pod \"must-gather-l8jfw\" (UID: \"53d9ba40-9322-4da9-b093-6717ce9ecc36\") " pod="openshift-must-gather-9dp88/must-gather-l8jfw" Jul 07 15:02:32.060093 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:32.060071 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/53d9ba40-9322-4da9-b093-6717ce9ecc36-must-gather-output\") pod \"must-gather-l8jfw\" (UID: \"53d9ba40-9322-4da9-b093-6717ce9ecc36\") " pod="openshift-must-gather-9dp88/must-gather-l8jfw" Jul 07 15:02:32.068422 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:32.068398 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw5cb\" (UniqueName: \"kubernetes.io/projected/53d9ba40-9322-4da9-b093-6717ce9ecc36-kube-api-access-pw5cb\") pod \"must-gather-l8jfw\" (UID: \"53d9ba40-9322-4da9-b093-6717ce9ecc36\") " pod="openshift-must-gather-9dp88/must-gather-l8jfw" Jul 07 15:02:32.143956 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:32.143871 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9dp88/must-gather-l8jfw" Jul 07 15:02:32.289312 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:32.284867 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9dp88/must-gather-l8jfw"] Jul 07 15:02:32.291471 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:32.291451 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 15:02:32.932594 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:32.932549 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9dp88/must-gather-l8jfw" event={"ID":"53d9ba40-9322-4da9-b093-6717ce9ecc36","Type":"ContainerStarted","Data":"4bb46fc20703c3a2d0edf89dde8bacd0168aa4c7751c5e7e56fa052c075a631b"} Jul 07 15:02:39.968746 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:39.968707 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9dp88/must-gather-l8jfw" event={"ID":"53d9ba40-9322-4da9-b093-6717ce9ecc36","Type":"ContainerStarted","Data":"7c5a9d04ca758a9919e882ab72cacbfeea1433bc683bbc773733a08ca54a9745"} Jul 07 15:02:39.969143 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:39.968757 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9dp88/must-gather-l8jfw" event={"ID":"53d9ba40-9322-4da9-b093-6717ce9ecc36","Type":"ContainerStarted","Data":"76266ab4cb1e0d8b4a6547a3d0939b30e152a90f54c6639b65253f7c12ac8347"} Jul 07 15:02:40.014608 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:02:40.014542 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9dp88/must-gather-l8jfw" podStartSLOduration=2.034448241 podStartE2EDuration="9.014520411s" totalImagesPullingTime="6.98007217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:02:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:02:40.014302541 +0000 UTC m=+3213.397139974" watchObservedRunningTime="2026-07-07 15:02:40.014520411 +0000 UTC m=+3213.397357839" Jul 07 15:03:02.072489 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:02.072401 2557 generic.go:356] "Generic (PLEG): container finished" podID="53d9ba40-9322-4da9-b093-6717ce9ecc36" containerID="76266ab4cb1e0d8b4a6547a3d0939b30e152a90f54c6639b65253f7c12ac8347" exitCode=0 Jul 07 15:03:02.072489 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:02.072470 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9dp88/must-gather-l8jfw" event={"ID":"53d9ba40-9322-4da9-b093-6717ce9ecc36","Type":"ContainerDied","Data":"76266ab4cb1e0d8b4a6547a3d0939b30e152a90f54c6639b65253f7c12ac8347"} Jul 07 15:03:02.072956 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:02.072862 2557 scope.go:117] "RemoveContainer" containerID="76266ab4cb1e0d8b4a6547a3d0939b30e152a90f54c6639b65253f7c12ac8347" Jul 07 15:03:02.814400 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:02.814369 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-9dp88_must-gather-l8jfw_53d9ba40-9322-4da9-b093-6717ce9ecc36/gather/0.log" Jul 07 15:03:03.298913 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:03.298879 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 15:03:03.446136 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:03.446097 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nrhtp/must-gather-mdd4f"] Jul 07 15:03:03.448497 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:03.448479 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nrhtp/must-gather-mdd4f" Jul 07 15:03:03.451159 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:03.451128 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nrhtp\"/\"openshift-service-ca.crt\"" Jul 07 15:03:03.451298 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:03.451233 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nrhtp\"/\"default-dockercfg-w6fgr\"" Jul 07 15:03:03.452063 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:03.452039 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nrhtp\"/\"kube-root-ca.crt\"" Jul 07 15:03:03.457665 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:03.457641 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nrhtp/must-gather-mdd4f"] Jul 07 15:03:03.457802 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:03.457686 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 15:03:03.521193 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:03.521147 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 15:03:03.546473 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:03.546429 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/085d7a1e-a07a-428b-910a-c6741b6a5d0e-must-gather-output\") pod \"must-gather-mdd4f\" (UID: \"085d7a1e-a07a-428b-910a-c6741b6a5d0e\") " pod="openshift-must-gather-nrhtp/must-gather-mdd4f" Jul 07 15:03:03.546650 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:03.546490 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvgms\" (UniqueName: \"kubernetes.io/projected/085d7a1e-a07a-428b-910a-c6741b6a5d0e-kube-api-access-lvgms\") pod \"must-gather-mdd4f\" (UID: \"085d7a1e-a07a-428b-910a-c6741b6a5d0e\") " pod="openshift-must-gather-nrhtp/must-gather-mdd4f" Jul 07 15:03:03.647488 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:03.647406 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvgms\" (UniqueName: \"kubernetes.io/projected/085d7a1e-a07a-428b-910a-c6741b6a5d0e-kube-api-access-lvgms\") pod \"must-gather-mdd4f\" (UID: \"085d7a1e-a07a-428b-910a-c6741b6a5d0e\") " pod="openshift-must-gather-nrhtp/must-gather-mdd4f" Jul 07 15:03:03.647659 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:03.647529 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/085d7a1e-a07a-428b-910a-c6741b6a5d0e-must-gather-output\") pod \"must-gather-mdd4f\" (UID: \"085d7a1e-a07a-428b-910a-c6741b6a5d0e\") " pod="openshift-must-gather-nrhtp/must-gather-mdd4f" Jul 07 15:03:03.647856 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:03.647835 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/085d7a1e-a07a-428b-910a-c6741b6a5d0e-must-gather-output\") pod \"must-gather-mdd4f\" (UID: \"085d7a1e-a07a-428b-910a-c6741b6a5d0e\") " pod="openshift-must-gather-nrhtp/must-gather-mdd4f" Jul 07 15:03:03.656383 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:03.656355 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvgms\" (UniqueName: \"kubernetes.io/projected/085d7a1e-a07a-428b-910a-c6741b6a5d0e-kube-api-access-lvgms\") pod \"must-gather-mdd4f\" (UID: \"085d7a1e-a07a-428b-910a-c6741b6a5d0e\") " pod="openshift-must-gather-nrhtp/must-gather-mdd4f" Jul 07 15:03:03.759049 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:03.759015 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nrhtp/must-gather-mdd4f" Jul 07 15:03:03.895976 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:03.895948 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nrhtp/must-gather-mdd4f"] Jul 07 15:03:03.896793 ip-10-0-130-152 kubenswrapper[2557]: W0707 15:03:03.896771 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod085d7a1e_a07a_428b_910a_c6741b6a5d0e.slice/crio-856c8e1df80493e82a2d7f743cdb54083f19534c92d5c4c672885f83cdf334b9 WatchSource:0}: Error finding container 856c8e1df80493e82a2d7f743cdb54083f19534c92d5c4c672885f83cdf334b9: Status 404 returned error can't find the container with id 856c8e1df80493e82a2d7f743cdb54083f19534c92d5c4c672885f83cdf334b9 Jul 07 15:03:04.081250 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:04.081208 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nrhtp/must-gather-mdd4f" event={"ID":"085d7a1e-a07a-428b-910a-c6741b6a5d0e","Type":"ContainerStarted","Data":"856c8e1df80493e82a2d7f743cdb54083f19534c92d5c4c672885f83cdf334b9"} Jul 07 15:03:05.090591 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:05.090538 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nrhtp/must-gather-mdd4f" event={"ID":"085d7a1e-a07a-428b-910a-c6741b6a5d0e","Type":"ContainerStarted","Data":"ddafc5a835300ae38128682e77a7da2793243f269c88ab13f7b0baa9ec0c6720"} Jul 07 15:03:06.096946 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:06.096911 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nrhtp/must-gather-mdd4f" event={"ID":"085d7a1e-a07a-428b-910a-c6741b6a5d0e","Type":"ContainerStarted","Data":"422fd07f873e094a9447df2e339c9550be551a7c246f7e5e6241fadbfd3a59ab"} Jul 07 15:03:06.120058 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:06.119996 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nrhtp/must-gather-mdd4f" podStartSLOduration=2.1284268060000002 podStartE2EDuration="3.119975176s" totalImagesPullingTime="991.54837ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 15:03:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:03:06.117618109 +0000 UTC m=+3239.500455541" watchObservedRunningTime="2026-07-07 15:03:06.119975176 +0000 UTC m=+3239.502812607" Jul 07 15:03:06.540742 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:06.540708 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-s5cfz_8358392b-ad0d-457c-844a-85a1b754a49e/global-pull-secret-syncer/0.log" Jul 07 15:03:06.600742 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:06.600700 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" Jul 07 15:03:06.731719 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:06.731678 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-152.ec2.internal_7c53c5de8c1731c73afeca96f56511a2/haproxy/0.log" Jul 07 15:03:08.283099 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:08.283051 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-9dp88/must-gather-l8jfw"] Jul 07 15:03:08.283722 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:08.283302 2557 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-9dp88/must-gather-l8jfw" podUID="53d9ba40-9322-4da9-b093-6717ce9ecc36" containerName="copy" containerID="cri-o://7c5a9d04ca758a9919e882ab72cacbfeea1433bc683bbc773733a08ca54a9745" gracePeriod=2 Jul 07 15:03:08.286256 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:08.286222 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-9dp88/must-gather-l8jfw"] Jul 07 15:03:08.289076 ip-10-0-130-152 kubenswrapper[2557]: E0707 15:03:08.289021 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-l8jfw\" is forbidden: User \"system:node:ip-10-0-130-152.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-9dp88\": no relationship found between node 'ip-10-0-130-152.ec2.internal' and this object" podUID="53d9ba40-9322-4da9-b093-6717ce9ecc36" pod="openshift-must-gather-9dp88/must-gather-l8jfw" Jul 07 15:03:08.704579 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:08.704467 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-9dp88_must-gather-l8jfw_53d9ba40-9322-4da9-b093-6717ce9ecc36/copy/0.log" Jul 07 15:03:08.706742 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:08.706458 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9dp88/must-gather-l8jfw" Jul 07 15:03:08.711530 ip-10-0-130-152 kubenswrapper[2557]: E0707 15:03:08.708856 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-l8jfw\" is forbidden: User \"system:node:ip-10-0-130-152.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-9dp88\": no relationship found between node 'ip-10-0-130-152.ec2.internal' and this object" podUID="53d9ba40-9322-4da9-b093-6717ce9ecc36" pod="openshift-must-gather-9dp88/must-gather-l8jfw" Jul 07 15:03:08.795676 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:08.795632 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/53d9ba40-9322-4da9-b093-6717ce9ecc36-must-gather-output\") pod \"53d9ba40-9322-4da9-b093-6717ce9ecc36\" (UID: \"53d9ba40-9322-4da9-b093-6717ce9ecc36\") " Jul 07 15:03:08.795869 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:08.795711 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pw5cb\" (UniqueName: \"kubernetes.io/projected/53d9ba40-9322-4da9-b093-6717ce9ecc36-kube-api-access-pw5cb\") pod \"53d9ba40-9322-4da9-b093-6717ce9ecc36\" (UID: \"53d9ba40-9322-4da9-b093-6717ce9ecc36\") " Jul 07 15:03:08.797782 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:08.797728 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/53d9ba40-9322-4da9-b093-6717ce9ecc36-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "53d9ba40-9322-4da9-b093-6717ce9ecc36" (UID: "53d9ba40-9322-4da9-b093-6717ce9ecc36"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 15:03:08.798821 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:08.798779 2557 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53d9ba40-9322-4da9-b093-6717ce9ecc36-kube-api-access-pw5cb" (OuterVolumeSpecName: "kube-api-access-pw5cb") pod "53d9ba40-9322-4da9-b093-6717ce9ecc36" (UID: "53d9ba40-9322-4da9-b093-6717ce9ecc36"). InnerVolumeSpecName "kube-api-access-pw5cb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 15:03:08.897190 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:08.897044 2557 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/53d9ba40-9322-4da9-b093-6717ce9ecc36-must-gather-output\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 07 15:03:08.897190 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:08.897084 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pw5cb\" (UniqueName: \"kubernetes.io/projected/53d9ba40-9322-4da9-b093-6717ce9ecc36-kube-api-access-pw5cb\") on node \"ip-10-0-130-152.ec2.internal\" DevicePath \"\"" Jul 07 15:03:09.105737 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:09.105530 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53d9ba40-9322-4da9-b093-6717ce9ecc36" path="/var/lib/kubelet/pods/53d9ba40-9322-4da9-b093-6717ce9ecc36/volumes" Jul 07 15:03:09.120216 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:09.120132 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-9dp88_must-gather-l8jfw_53d9ba40-9322-4da9-b093-6717ce9ecc36/copy/0.log" Jul 07 15:03:09.123525 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:09.120538 2557 generic.go:356] "Generic (PLEG): container finished" podID="53d9ba40-9322-4da9-b093-6717ce9ecc36" containerID="7c5a9d04ca758a9919e882ab72cacbfeea1433bc683bbc773733a08ca54a9745" exitCode=143 Jul 07 15:03:09.123525 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:09.120601 2557 scope.go:117] "RemoveContainer" containerID="7c5a9d04ca758a9919e882ab72cacbfeea1433bc683bbc773733a08ca54a9745" Jul 07 15:03:09.123525 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:09.120756 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9dp88/must-gather-l8jfw" Jul 07 15:03:09.143828 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:09.143796 2557 scope.go:117] "RemoveContainer" containerID="76266ab4cb1e0d8b4a6547a3d0939b30e152a90f54c6639b65253f7c12ac8347" Jul 07 15:03:09.167065 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:09.166990 2557 scope.go:117] "RemoveContainer" containerID="7c5a9d04ca758a9919e882ab72cacbfeea1433bc683bbc773733a08ca54a9745" Jul 07 15:03:09.168718 ip-10-0-130-152 kubenswrapper[2557]: E0707 15:03:09.168281 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c5a9d04ca758a9919e882ab72cacbfeea1433bc683bbc773733a08ca54a9745\": container with ID starting with 7c5a9d04ca758a9919e882ab72cacbfeea1433bc683bbc773733a08ca54a9745 not found: ID does not exist" containerID="7c5a9d04ca758a9919e882ab72cacbfeea1433bc683bbc773733a08ca54a9745" Jul 07 15:03:09.168718 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:09.168323 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c5a9d04ca758a9919e882ab72cacbfeea1433bc683bbc773733a08ca54a9745"} err="failed to get container status \"7c5a9d04ca758a9919e882ab72cacbfeea1433bc683bbc773733a08ca54a9745\": rpc error: code = NotFound desc = could not find container \"7c5a9d04ca758a9919e882ab72cacbfeea1433bc683bbc773733a08ca54a9745\": container with ID starting with 7c5a9d04ca758a9919e882ab72cacbfeea1433bc683bbc773733a08ca54a9745 not found: ID does not exist" Jul 07 15:03:09.168718 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:09.168351 2557 scope.go:117] "RemoveContainer" containerID="76266ab4cb1e0d8b4a6547a3d0939b30e152a90f54c6639b65253f7c12ac8347" Jul 07 15:03:09.168993 ip-10-0-130-152 kubenswrapper[2557]: E0707 15:03:09.168719 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76266ab4cb1e0d8b4a6547a3d0939b30e152a90f54c6639b65253f7c12ac8347\": container with ID starting with 76266ab4cb1e0d8b4a6547a3d0939b30e152a90f54c6639b65253f7c12ac8347 not found: ID does not exist" containerID="76266ab4cb1e0d8b4a6547a3d0939b30e152a90f54c6639b65253f7c12ac8347" Jul 07 15:03:09.168993 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:09.168747 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76266ab4cb1e0d8b4a6547a3d0939b30e152a90f54c6639b65253f7c12ac8347"} err="failed to get container status \"76266ab4cb1e0d8b4a6547a3d0939b30e152a90f54c6639b65253f7c12ac8347\": rpc error: code = NotFound desc = could not find container \"76266ab4cb1e0d8b4a6547a3d0939b30e152a90f54c6639b65253f7c12ac8347\": container with ID starting with 76266ab4cb1e0d8b4a6547a3d0939b30e152a90f54c6639b65253f7c12ac8347 not found: ID does not exist" Jul 07 15:03:09.264828 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:09.264788 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 15:03:09.344969 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:09.344929 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7f8r6_b0e566be-2b4d-47a4-bce3-79b9cb20739c/konnectivity-agent/0.log" limit=1024 Jul 07 15:03:11.120791 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:11.120708 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-nf787_c7c98b12-be0e-4355-b645-7538f11358f2/cluster-monitoring-operator/0.log" Jul 07 15:03:11.449986 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:11.449953 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cjwvj_03942954-a5e7-453f-9a32-00cded70d110/node-exporter/0.log" Jul 07 15:03:11.485968 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:11.485929 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cjwvj_03942954-a5e7-453f-9a32-00cded70d110/kube-rbac-proxy/0.log" Jul 07 15:03:11.519693 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:11.519668 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cjwvj_03942954-a5e7-453f-9a32-00cded70d110/init-textfile/0.log" Jul 07 15:03:11.776204 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:11.776160 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_452f29ea-3939-445d-a829-81263509c1b3/prometheus/0.log" Jul 07 15:03:11.806283 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:11.806245 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_452f29ea-3939-445d-a829-81263509c1b3/config-reloader/0.log" Jul 07 15:03:11.833249 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:11.833195 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_452f29ea-3939-445d-a829-81263509c1b3/thanos-sidecar/0.log" Jul 07 15:03:11.865994 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:11.865965 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_452f29ea-3939-445d-a829-81263509c1b3/kube-rbac-proxy-web/0.log" Jul 07 15:03:11.895954 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:11.895925 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_452f29ea-3939-445d-a829-81263509c1b3/kube-rbac-proxy/0.log" Jul 07 15:03:11.928615 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:11.928576 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_452f29ea-3939-445d-a829-81263509c1b3/kube-rbac-proxy-thanos/0.log" Jul 07 15:03:11.960359 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:11.960333 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_452f29ea-3939-445d-a829-81263509c1b3/init-config-reloader/0.log" Jul 07 15:03:12.011435 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:12.011395 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-4w89b_a7f86a3c-98a0-4a35-bdee-e9a5e6d2324d/prometheus-operator/0.log" Jul 07 15:03:12.036018 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:12.035942 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-4w89b_a7f86a3c-98a0-4a35-bdee-e9a5e6d2324d/kube-rbac-proxy/0.log" Jul 07 15:03:12.065200 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:12.065168 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-74kgl_841cca3a-a3f5-44c1-9908-061069bb22ce/prometheus-operator-admission-webhook/0.log" Jul 07 15:03:12.190048 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:12.190017 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7645b4c468-gbh8w_9eb98939-d529-4d08-b1e0-bb7286271149/thanos-query/0.log" Jul 07 15:03:12.223433 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:12.223407 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7645b4c468-gbh8w_9eb98939-d529-4d08-b1e0-bb7286271149/kube-rbac-proxy-web/0.log" Jul 07 15:03:12.260459 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:12.260418 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7645b4c468-gbh8w_9eb98939-d529-4d08-b1e0-bb7286271149/kube-rbac-proxy/0.log" Jul 07 15:03:12.294081 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:12.294000 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7645b4c468-gbh8w_9eb98939-d529-4d08-b1e0-bb7286271149/prom-label-proxy/0.log" Jul 07 15:03:12.330078 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:12.330048 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7645b4c468-gbh8w_9eb98939-d529-4d08-b1e0-bb7286271149/kube-rbac-proxy-rules/0.log" Jul 07 15:03:12.357081 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:12.357026 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7645b4c468-gbh8w_9eb98939-d529-4d08-b1e0-bb7286271149/kube-rbac-proxy-metrics/0.log" Jul 07 15:03:13.643110 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:13.643081 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-rxpf2_61c55aec-8d5a-486f-8e6d-2ed748969b6e/networking-console-plugin/0.log" Jul 07 15:03:14.200666 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:14.200598 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b66mb_82df755c-beec-4653-96a6-691507fee3e7/console-operator/1.log" Jul 07 15:03:14.206439 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:14.206411 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-b66mb_82df755c-beec-4653-96a6-691507fee3e7/console-operator/2.log" Jul 07 15:03:14.638616 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:14.638581 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-4qgfc_10871123-aa0e-4e5e-ad48-7ed10f811dcf/download-server/0.log" Jul 07 15:03:15.146512 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:15.146487 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-zld8k_2dc0a674-481e-4ad4-b50b-f61fba7ba171/volume-data-source-validator/0.log" Jul 07 15:03:15.477822 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:15.477787 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nrhtp/perf-node-gather-daemonset-8tvrg"] Jul 07 15:03:15.478520 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:15.478476 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53d9ba40-9322-4da9-b093-6717ce9ecc36" containerName="gather" Jul 07 15:03:15.478666 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:15.478652 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="53d9ba40-9322-4da9-b093-6717ce9ecc36" containerName="gather" Jul 07 15:03:15.478785 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:15.478773 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53d9ba40-9322-4da9-b093-6717ce9ecc36" containerName="copy" Jul 07 15:03:15.478870 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:15.478860 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="53d9ba40-9322-4da9-b093-6717ce9ecc36" containerName="copy" Jul 07 15:03:15.479035 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:15.479022 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="53d9ba40-9322-4da9-b093-6717ce9ecc36" containerName="gather" Jul 07 15:03:15.479129 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:15.479117 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="53d9ba40-9322-4da9-b093-6717ce9ecc36" containerName="copy" Jul 07 15:03:15.483560 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:15.483537 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nrhtp/perf-node-gather-daemonset-8tvrg" Jul 07 15:03:15.498975 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:15.498949 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nrhtp/perf-node-gather-daemonset-8tvrg"] Jul 07 15:03:15.663236 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:15.663196 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c0b24576-164d-4d66-9b39-9573af78dfe2-podres\") pod \"perf-node-gather-daemonset-8tvrg\" (UID: \"c0b24576-164d-4d66-9b39-9573af78dfe2\") " pod="openshift-must-gather-nrhtp/perf-node-gather-daemonset-8tvrg" Jul 07 15:03:15.663436 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:15.663284 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c0b24576-164d-4d66-9b39-9573af78dfe2-sys\") pod \"perf-node-gather-daemonset-8tvrg\" (UID: \"c0b24576-164d-4d66-9b39-9573af78dfe2\") " pod="openshift-must-gather-nrhtp/perf-node-gather-daemonset-8tvrg" Jul 07 15:03:15.663436 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:15.663317 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c0b24576-164d-4d66-9b39-9573af78dfe2-lib-modules\") pod \"perf-node-gather-daemonset-8tvrg\" (UID: \"c0b24576-164d-4d66-9b39-9573af78dfe2\") " pod="openshift-must-gather-nrhtp/perf-node-gather-daemonset-8tvrg" Jul 07 15:03:15.663436 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:15.663391 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcnst\" (UniqueName: \"kubernetes.io/projected/c0b24576-164d-4d66-9b39-9573af78dfe2-kube-api-access-gcnst\") pod \"perf-node-gather-daemonset-8tvrg\" (UID: \"c0b24576-164d-4d66-9b39-9573af78dfe2\") " pod="openshift-must-gather-nrhtp/perf-node-gather-daemonset-8tvrg" Jul 07 15:03:15.663643 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:15.663444 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c0b24576-164d-4d66-9b39-9573af78dfe2-proc\") pod \"perf-node-gather-daemonset-8tvrg\" (UID: \"c0b24576-164d-4d66-9b39-9573af78dfe2\") " pod="openshift-must-gather-nrhtp/perf-node-gather-daemonset-8tvrg" Jul 07 15:03:15.764389 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:15.764301 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c0b24576-164d-4d66-9b39-9573af78dfe2-sys\") pod \"perf-node-gather-daemonset-8tvrg\" (UID: \"c0b24576-164d-4d66-9b39-9573af78dfe2\") " pod="openshift-must-gather-nrhtp/perf-node-gather-daemonset-8tvrg" Jul 07 15:03:15.764389 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:15.764355 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c0b24576-164d-4d66-9b39-9573af78dfe2-lib-modules\") pod \"perf-node-gather-daemonset-8tvrg\" (UID: \"c0b24576-164d-4d66-9b39-9573af78dfe2\") " pod="openshift-must-gather-nrhtp/perf-node-gather-daemonset-8tvrg" Jul 07 15:03:15.764661 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:15.764416 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcnst\" (UniqueName: \"kubernetes.io/projected/c0b24576-164d-4d66-9b39-9573af78dfe2-kube-api-access-gcnst\") pod \"perf-node-gather-daemonset-8tvrg\" (UID: \"c0b24576-164d-4d66-9b39-9573af78dfe2\") " pod="openshift-must-gather-nrhtp/perf-node-gather-daemonset-8tvrg" Jul 07 15:03:15.764661 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:15.764438 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c0b24576-164d-4d66-9b39-9573af78dfe2-sys\") pod \"perf-node-gather-daemonset-8tvrg\" (UID: \"c0b24576-164d-4d66-9b39-9573af78dfe2\") " pod="openshift-must-gather-nrhtp/perf-node-gather-daemonset-8tvrg" Jul 07 15:03:15.764661 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:15.764466 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c0b24576-164d-4d66-9b39-9573af78dfe2-proc\") pod \"perf-node-gather-daemonset-8tvrg\" (UID: \"c0b24576-164d-4d66-9b39-9573af78dfe2\") " pod="openshift-must-gather-nrhtp/perf-node-gather-daemonset-8tvrg" Jul 07 15:03:15.764661 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:15.764549 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c0b24576-164d-4d66-9b39-9573af78dfe2-podres\") pod \"perf-node-gather-daemonset-8tvrg\" (UID: \"c0b24576-164d-4d66-9b39-9573af78dfe2\") " pod="openshift-must-gather-nrhtp/perf-node-gather-daemonset-8tvrg" Jul 07 15:03:15.764661 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:15.764607 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c0b24576-164d-4d66-9b39-9573af78dfe2-lib-modules\") pod \"perf-node-gather-daemonset-8tvrg\" (UID: \"c0b24576-164d-4d66-9b39-9573af78dfe2\") " pod="openshift-must-gather-nrhtp/perf-node-gather-daemonset-8tvrg" Jul 07 15:03:15.764931 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:15.764696 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c0b24576-164d-4d66-9b39-9573af78dfe2-podres\") pod \"perf-node-gather-daemonset-8tvrg\" (UID: \"c0b24576-164d-4d66-9b39-9573af78dfe2\") " pod="openshift-must-gather-nrhtp/perf-node-gather-daemonset-8tvrg" Jul 07 15:03:15.764931 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:15.764735 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c0b24576-164d-4d66-9b39-9573af78dfe2-proc\") pod \"perf-node-gather-daemonset-8tvrg\" (UID: \"c0b24576-164d-4d66-9b39-9573af78dfe2\") " pod="openshift-must-gather-nrhtp/perf-node-gather-daemonset-8tvrg" Jul 07 15:03:15.773484 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:15.773454 2557 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcnst\" (UniqueName: \"kubernetes.io/projected/c0b24576-164d-4d66-9b39-9573af78dfe2-kube-api-access-gcnst\") pod \"perf-node-gather-daemonset-8tvrg\" (UID: \"c0b24576-164d-4d66-9b39-9573af78dfe2\") " pod="openshift-must-gather-nrhtp/perf-node-gather-daemonset-8tvrg" Jul 07 15:03:15.799483 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:15.799442 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nrhtp/perf-node-gather-daemonset-8tvrg" Jul 07 15:03:15.967625 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:15.967586 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nrhtp/perf-node-gather-daemonset-8tvrg"] Jul 07 15:03:15.973723 ip-10-0-130-152 kubenswrapper[2557]: W0707 15:03:15.973685 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc0b24576_164d_4d66_9b39_9573af78dfe2.slice/crio-a6ef3a7cd57fc1d9adf38ad2e82d1b7ab8052e0e3794c75c4ae7a8f0d1c3fa95 WatchSource:0}: Error finding container a6ef3a7cd57fc1d9adf38ad2e82d1b7ab8052e0e3794c75c4ae7a8f0d1c3fa95: Status 404 returned error can't find the container with id a6ef3a7cd57fc1d9adf38ad2e82d1b7ab8052e0e3794c75c4ae7a8f0d1c3fa95 Jul 07 15:03:16.158808 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:16.158764 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nrhtp/perf-node-gather-daemonset-8tvrg" event={"ID":"c0b24576-164d-4d66-9b39-9573af78dfe2","Type":"ContainerStarted","Data":"a4cd7e15b4673ee5a0a1977807c560af1575911e276c1cf62959c5ee35018e01"} Jul 07 15:03:16.159284 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:16.158868 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nrhtp/perf-node-gather-daemonset-8tvrg" event={"ID":"c0b24576-164d-4d66-9b39-9573af78dfe2","Type":"ContainerStarted","Data":"a6ef3a7cd57fc1d9adf38ad2e82d1b7ab8052e0e3794c75c4ae7a8f0d1c3fa95"} Jul 07 15:03:16.159284 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:16.158900 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nrhtp/perf-node-gather-daemonset-8tvrg" Jul 07 15:03:16.177326 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:16.177232 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nrhtp/perf-node-gather-daemonset-8tvrg" podStartSLOduration=1.177211427 podStartE2EDuration="1.177211427s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 15:03:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 15:03:16.175475903 +0000 UTC m=+3249.558313332" watchObservedRunningTime="2026-07-07 15:03:16.177211427 +0000 UTC m=+3249.560048857" Jul 07 15:03:16.274684 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:16.274657 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m5g66_4139e191-c46c-4737-ac93-784c0df05814/dns/0.log" Jul 07 15:03:16.298222 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:16.298141 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-m5g66_4139e191-c46c-4737-ac93-784c0df05814/kube-rbac-proxy/0.log" Jul 07 15:03:16.323548 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:16.323519 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6dqdt_6a2d3927-7c87-4583-afec-33548d872aca/dns-node-resolver/0.log" Jul 07 15:03:16.989332 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:16.989298 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tdc99_d360f1dd-1647-4c4b-8626-fe12ac3751b5/node-ca/0.log" Jul 07 15:03:18.548618 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:18.548585 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xvg2g_63809651-c64b-4da4-bbee-b46f25e99eef/serve-healthcheck-canary/0.log" Jul 07 15:03:18.984720 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:18.984678 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-ntqmk_1eefdda1-18e3-429d-ad78-2f0b93e00b2e/insights-operator/0.log" Jul 07 15:03:18.985295 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:18.985267 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-ntqmk_1eefdda1-18e3-429d-ad78-2f0b93e00b2e/insights-operator/1.log" Jul 07 15:03:19.024057 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:19.024030 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-82r8c_01146df7-85d8-46ad-82d2-b625f84dc98d/kube-rbac-proxy/0.log" Jul 07 15:03:19.061303 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:19.061277 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-82r8c_01146df7-85d8-46ad-82d2-b625f84dc98d/exporter/0.log" Jul 07 15:03:19.089784 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:19.089755 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-82r8c_01146df7-85d8-46ad-82d2-b625f84dc98d/extractor/0.log" Jul 07 15:03:21.851738 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:21.851705 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-x9wgw_23c04fb3-def6-44a6-9bb4-874275c7219e/s3-init/0.log" Jul 07 15:03:21.893872 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:21.893842 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_s3-init-x9wgw_23c04fb3-def6-44a6-9bb4-874275c7219e/download-hf-model/0.log" Jul 07 15:03:22.176099 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:22.176011 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nrhtp/perf-node-gather-daemonset-8tvrg" Jul 07 15:03:26.282523 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:26.282469 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-4lvtr_7183cb56-3853-47da-90e0-6fe704d5f98d/migrator/0.log" Jul 07 15:03:26.306727 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:26.306685 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-4lvtr_7183cb56-3853-47da-90e0-6fe704d5f98d/graceful-termination/0.log" Jul 07 15:03:27.713132 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:27.713102 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6lrcb_e88256f8-e47a-4f61-b897-4ce91c24e80d/kube-multus/0.log" Jul 07 15:03:28.181775 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:28.181747 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t88rg_1093ee1a-7fa2-4027-860e-75334e677b42/kube-multus-additional-cni-plugins/0.log" Jul 07 15:03:28.209718 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:28.209691 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t88rg_1093ee1a-7fa2-4027-860e-75334e677b42/egress-router-binary-copy/0.log" Jul 07 15:03:28.231618 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:28.231595 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t88rg_1093ee1a-7fa2-4027-860e-75334e677b42/cni-plugins/0.log" Jul 07 15:03:28.255734 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:28.255708 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t88rg_1093ee1a-7fa2-4027-860e-75334e677b42/bond-cni-plugin/0.log" Jul 07 15:03:28.278541 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:28.278463 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t88rg_1093ee1a-7fa2-4027-860e-75334e677b42/routeoverride-cni/0.log" Jul 07 15:03:28.303892 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:28.303868 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t88rg_1093ee1a-7fa2-4027-860e-75334e677b42/whereabouts-cni-bincopy/0.log" Jul 07 15:03:28.327825 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:28.327798 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-t88rg_1093ee1a-7fa2-4027-860e-75334e677b42/whereabouts-cni/0.log" Jul 07 15:03:28.394100 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:28.394068 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rfmz4_1125d082-9200-4b6f-b03b-1edd11069009/network-metrics-daemon/0.log" Jul 07 15:03:28.419320 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:28.419295 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rfmz4_1125d082-9200-4b6f-b03b-1edd11069009/kube-rbac-proxy/0.log" Jul 07 15:03:29.774237 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:29.774202 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7sfl_89089a6f-7090-4264-bfc4-1ec644da32ab/ovn-controller/0.log" Jul 07 15:03:29.794724 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:29.794690 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7sfl_89089a6f-7090-4264-bfc4-1ec644da32ab/ovn-acl-logging/0.log" Jul 07 15:03:29.821820 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:29.821780 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7sfl_89089a6f-7090-4264-bfc4-1ec644da32ab/kube-rbac-proxy-node/0.log" Jul 07 15:03:29.843479 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:29.843455 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7sfl_89089a6f-7090-4264-bfc4-1ec644da32ab/kube-rbac-proxy-ovn-metrics/0.log" Jul 07 15:03:29.860524 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:29.860473 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7sfl_89089a6f-7090-4264-bfc4-1ec644da32ab/northd/0.log" Jul 07 15:03:29.883751 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:29.883709 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7sfl_89089a6f-7090-4264-bfc4-1ec644da32ab/nbdb/0.log" Jul 07 15:03:29.907422 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:29.907392 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7sfl_89089a6f-7090-4264-bfc4-1ec644da32ab/sbdb/0.log" Jul 07 15:03:29.955023 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:29.954993 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v7sfl_89089a6f-7090-4264-bfc4-1ec644da32ab/ovnkube-controller/0.log" Jul 07 15:03:30.977049 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:30.977015 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-989f8b8dc-bshp7_dd2613e2-dd7c-4b3d-88e2-464f50199e05/check-endpoints/0.log" Jul 07 15:03:31.055822 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:31.055794 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-xzfg2_a6bce278-b340-4280-882f-2337ec23b28e/network-check-target-container/0.log" Jul 07 15:03:32.042943 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:32.042912 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-xzl5w_b4eba203-0b3a-4e5d-9ff4-acfbf975ee2d/iptables-alerter/0.log" Jul 07 15:03:32.738487 ip-10-0-130-152 kubenswrapper[2557]: I0707 15:03:32.738456 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-swvr7_fd093dc2-b2a4-4c5a-9b12-5a65cef25df4/tuned/0.log"