Jul 17 13:54:19.697661 ip-10-0-138-92 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 17 13:54:19.697672 ip-10-0-138-92 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 17 13:54:19.697679 ip-10-0-138-92 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 17 13:54:19.697944 ip-10-0-138-92 systemd[1]: Failed to start Kubernetes Kubelet. Jul 17 13:54:29.815859 ip-10-0-138-92 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jul 17 13:54:29.815875 ip-10-0-138-92 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 88cd1055b5074341ae1d391adb34738c -- Jul 17 13:56:21.054419 ip-10-0-138-92 systemd[1]: Starting Kubernetes Kubelet... Jul 17 13:56:21.452264 ip-10-0-138-92 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 13:56:21.452792 ip-10-0-138-92 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 17 13:56:21.452792 ip-10-0-138-92 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 13:56:21.452792 ip-10-0-138-92 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 17 13:56:21.452792 ip-10-0-138-92 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 17 13:56:21.452792 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.452336 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 17 13:56:21.459150 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459133 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 13:56:21.459150 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459147 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 13:56:21.459150 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459151 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 13:56:21.459150 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459154 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 13:56:21.459293 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459157 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 13:56:21.459293 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459162 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 13:56:21.459293 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459165 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 13:56:21.459293 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459168 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 13:56:21.459293 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459171 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 13:56:21.459293 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459186 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 13:56:21.459293 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459190 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 13:56:21.459293 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459193 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 13:56:21.459293 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459196 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 13:56:21.459293 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459198 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 13:56:21.459293 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459201 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 13:56:21.459293 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459204 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 13:56:21.459293 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459206 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 13:56:21.459293 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459209 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 13:56:21.459293 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459211 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 17 13:56:21.459293 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459214 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 13:56:21.459293 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459217 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 13:56:21.459293 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459219 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 13:56:21.459293 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459221 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 13:56:21.459293 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459224 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 13:56:21.459811 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459226 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 13:56:21.459811 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459229 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 13:56:21.459811 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459231 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 13:56:21.459811 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459234 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 13:56:21.459811 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459236 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 13:56:21.459811 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459238 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 13:56:21.459811 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459241 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 13:56:21.459811 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459243 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 13:56:21.459811 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459246 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 13:56:21.459811 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459250 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 13:56:21.459811 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459253 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 13:56:21.459811 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459256 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 13:56:21.459811 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459259 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 13:56:21.459811 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459263 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 13:56:21.459811 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459266 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 13:56:21.459811 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459268 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 13:56:21.459811 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459271 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 13:56:21.459811 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459274 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 13:56:21.459811 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459277 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 13:56:21.459811 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459279 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 13:56:21.460318 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459283 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 13:56:21.460318 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459285 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 13:56:21.460318 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459288 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 13:56:21.460318 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459290 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 13:56:21.460318 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459293 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 13:56:21.460318 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459296 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 13:56:21.460318 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459298 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 13:56:21.460318 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459301 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 13:56:21.460318 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459303 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 13:56:21.460318 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459306 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 13:56:21.460318 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459309 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 13:56:21.460318 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459313 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 13:56:21.460318 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459317 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 13:56:21.460318 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459320 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 13:56:21.460318 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459322 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 13:56:21.460318 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459325 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 13:56:21.460318 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459328 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 13:56:21.460318 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459331 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 13:56:21.460318 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459333 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 13:56:21.460318 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459336 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 13:56:21.460790 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459338 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 13:56:21.460790 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459341 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 13:56:21.460790 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459344 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 13:56:21.460790 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459346 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 13:56:21.460790 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459349 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 13:56:21.460790 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459352 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 13:56:21.460790 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459354 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 13:56:21.460790 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459357 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 13:56:21.460790 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459359 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 13:56:21.460790 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459362 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 13:56:21.460790 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459365 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 13:56:21.460790 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459368 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 13:56:21.460790 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459370 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 13:56:21.460790 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459382 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 13:56:21.460790 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459385 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 13:56:21.460790 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459387 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 13:56:21.460790 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459390 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 13:56:21.460790 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459392 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 13:56:21.460790 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459395 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 13:56:21.460790 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459398 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 13:56:21.461287 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459400 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 13:56:21.461287 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459402 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 13:56:21.461287 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459405 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 13:56:21.461287 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459407 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 13:56:21.461287 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459413 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 13:56:21.461287 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459416 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 13:56:21.461287 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459419 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 13:56:21.461287 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459422 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 13:56:21.461287 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459425 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 13:56:21.461287 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459427 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 13:56:21.461287 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459430 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 13:56:21.461287 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459433 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 13:56:21.461287 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459436 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 13:56:21.461287 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459438 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 13:56:21.461287 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.459441 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 13:56:21.461287 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460116 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 13:56:21.461287 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460123 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 13:56:21.461287 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460127 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 13:56:21.461287 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460129 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 13:56:21.461287 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460132 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 13:56:21.461759 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460134 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 13:56:21.461759 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460137 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 13:56:21.461759 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460140 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 13:56:21.461759 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460142 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 13:56:21.461759 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460146 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 13:56:21.461759 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460148 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 13:56:21.461759 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460151 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 13:56:21.461759 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460153 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 13:56:21.461759 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460156 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 13:56:21.461759 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460158 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 13:56:21.461759 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460161 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 13:56:21.461759 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460163 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 13:56:21.461759 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460166 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 13:56:21.461759 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460168 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 13:56:21.461759 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460171 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 13:56:21.461759 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460188 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 13:56:21.461759 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460192 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 13:56:21.461759 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460194 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 13:56:21.461759 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460197 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 13:56:21.462253 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460200 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 13:56:21.462253 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460202 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 13:56:21.462253 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460205 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 13:56:21.462253 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460207 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 13:56:21.462253 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460210 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 13:56:21.462253 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460212 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 13:56:21.462253 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460215 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 13:56:21.462253 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460217 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 17 13:56:21.462253 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460220 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 13:56:21.462253 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460225 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 13:56:21.462253 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460227 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 13:56:21.462253 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460230 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 13:56:21.462253 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460233 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 13:56:21.462253 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460235 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 13:56:21.462253 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460238 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 13:56:21.462253 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460240 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 13:56:21.462253 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460245 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 13:56:21.462253 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460249 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 13:56:21.462253 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460252 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 13:56:21.462253 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460255 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 13:56:21.462729 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460258 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 13:56:21.462729 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460260 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 13:56:21.462729 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460263 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 13:56:21.462729 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460266 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 13:56:21.462729 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460269 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 13:56:21.462729 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460272 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 13:56:21.462729 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460275 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 13:56:21.462729 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460277 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 13:56:21.462729 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460279 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 13:56:21.462729 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460282 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 13:56:21.462729 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460284 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 13:56:21.462729 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460287 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 13:56:21.462729 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460289 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 13:56:21.462729 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460292 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 13:56:21.462729 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460295 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 13:56:21.462729 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460297 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 13:56:21.462729 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460300 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 13:56:21.462729 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460302 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 13:56:21.462729 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460305 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 13:56:21.462729 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460308 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 13:56:21.463236 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460310 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 13:56:21.463236 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460314 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 13:56:21.463236 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460317 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 13:56:21.463236 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460319 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 13:56:21.463236 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460322 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 13:56:21.463236 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460324 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 13:56:21.463236 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460327 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 13:56:21.463236 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460330 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 13:56:21.463236 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460332 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 13:56:21.463236 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460335 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 13:56:21.463236 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460337 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 13:56:21.463236 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460340 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 13:56:21.463236 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460343 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 13:56:21.463236 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460346 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 13:56:21.463236 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460350 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 13:56:21.463236 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460353 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 13:56:21.463236 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460356 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 13:56:21.463236 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460361 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 13:56:21.463236 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460365 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 13:56:21.463704 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460368 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 13:56:21.463704 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460371 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 13:56:21.463704 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460373 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 13:56:21.463704 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460376 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 13:56:21.463704 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460379 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 13:56:21.463704 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460382 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 13:56:21.463704 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460384 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 13:56:21.463704 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460387 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 13:56:21.463704 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460390 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 13:56:21.463704 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460393 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 13:56:21.463704 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460395 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 13:56:21.463704 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460398 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 13:56:21.463704 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460400 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 13:56:21.463704 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460403 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 13:56:21.463704 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460406 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 13:56:21.463704 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460409 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 13:56:21.463704 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460768 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 13:56:21.463704 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460773 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 13:56:21.463704 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460776 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 13:56:21.463704 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460778 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 13:56:21.464188 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460781 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 13:56:21.464188 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460783 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 13:56:21.464188 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460786 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 13:56:21.464188 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460789 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 13:56:21.464188 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460792 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 13:56:21.464188 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460794 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 13:56:21.464188 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460797 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 13:56:21.464188 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460800 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 13:56:21.464188 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460802 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 13:56:21.464188 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460805 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 13:56:21.464188 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460809 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 13:56:21.464188 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460812 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 13:56:21.464188 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460814 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 13:56:21.464188 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460817 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 13:56:21.464188 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460819 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 13:56:21.464188 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460822 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 13:56:21.464188 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460824 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 13:56:21.464188 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460826 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 13:56:21.464188 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460829 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 13:56:21.464188 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460831 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 13:56:21.464705 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460834 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 13:56:21.464705 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460837 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 13:56:21.464705 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460839 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 13:56:21.464705 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460841 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 13:56:21.464705 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460844 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 13:56:21.464705 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460847 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 13:56:21.464705 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460850 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 13:56:21.464705 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460853 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 13:56:21.464705 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460855 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 13:56:21.464705 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460857 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 13:56:21.464705 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460860 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 13:56:21.464705 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460863 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 13:56:21.464705 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460865 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 13:56:21.464705 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460868 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 13:56:21.464705 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460870 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 13:56:21.464705 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460873 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 13:56:21.464705 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460875 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 13:56:21.464705 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460878 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 13:56:21.464705 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460880 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 13:56:21.464705 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460883 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 13:56:21.465197 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460888 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 13:56:21.465197 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460891 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 13:56:21.465197 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460896 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 13:56:21.465197 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460898 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 13:56:21.465197 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460901 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 13:56:21.465197 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460904 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 13:56:21.465197 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460906 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 13:56:21.465197 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460908 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 13:56:21.465197 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460911 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 13:56:21.465197 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460913 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 13:56:21.465197 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460916 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 13:56:21.465197 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460918 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 13:56:21.465197 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460921 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 13:56:21.465197 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460923 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 13:56:21.465197 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460925 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 13:56:21.465197 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460927 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 13:56:21.465197 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460930 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 13:56:21.465197 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460932 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 13:56:21.465197 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460936 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 13:56:21.465660 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460938 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 13:56:21.465660 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460940 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 13:56:21.465660 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460943 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 13:56:21.465660 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460945 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 13:56:21.465660 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460947 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 13:56:21.465660 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460950 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 13:56:21.465660 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460954 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 13:56:21.465660 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460956 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 13:56:21.465660 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460959 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 13:56:21.465660 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460961 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 13:56:21.465660 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460964 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 13:56:21.465660 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460967 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 13:56:21.465660 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460969 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 13:56:21.465660 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460971 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 13:56:21.465660 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460974 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 13:56:21.465660 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460977 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 13:56:21.465660 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460980 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 13:56:21.465660 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460982 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 13:56:21.465660 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460984 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 13:56:21.466145 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460987 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 13:56:21.466145 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460989 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 13:56:21.466145 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460992 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 13:56:21.466145 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460994 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 13:56:21.466145 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460996 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 17 13:56:21.466145 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.460999 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 13:56:21.466145 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461001 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 13:56:21.466145 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461003 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 13:56:21.466145 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461006 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 13:56:21.466145 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461011 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 13:56:21.466145 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461014 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 13:56:21.466145 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461017 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 13:56:21.466145 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461021 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 13:56:21.466145 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461024 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 13:56:21.466145 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461027 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 13:56:21.466145 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461029 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 13:56:21.466145 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461032 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 13:56:21.466145 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461098 2565 flags.go:64] FLAG: --address="0.0.0.0" Jul 17 13:56:21.466145 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461105 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 17 13:56:21.466145 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461110 2565 flags.go:64] FLAG: --anonymous-auth="true" Jul 17 13:56:21.466145 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461114 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 17 13:56:21.466658 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461117 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 17 13:56:21.466658 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461120 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 17 13:56:21.466658 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461124 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 17 13:56:21.466658 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461128 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 17 13:56:21.466658 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461131 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 17 13:56:21.466658 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461134 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 17 13:56:21.466658 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461138 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 17 13:56:21.466658 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461142 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 17 13:56:21.466658 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461145 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 17 13:56:21.466658 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461148 2565 flags.go:64] FLAG: --cgroup-root="" Jul 17 13:56:21.466658 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461150 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 17 13:56:21.466658 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461153 2565 flags.go:64] FLAG: --client-ca-file="" Jul 17 13:56:21.466658 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461156 2565 flags.go:64] FLAG: --cloud-provider="external" Jul 17 13:56:21.466658 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461159 2565 flags.go:64] FLAG: --cluster-dns="[]" Jul 17 13:56:21.466658 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461163 2565 flags.go:64] FLAG: --cluster-domain="" Jul 17 13:56:21.466658 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461165 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 17 13:56:21.466658 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461168 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 17 13:56:21.466658 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461171 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 17 13:56:21.466658 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461191 2565 flags.go:64] FLAG: --container-log-max-files="5" Jul 17 13:56:21.466658 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461195 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 17 13:56:21.466658 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461198 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 17 13:56:21.466658 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461201 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 17 13:56:21.466658 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461205 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 17 13:56:21.467223 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461209 2565 flags.go:64] FLAG: --contention-profiling="false" Jul 17 13:56:21.467223 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461212 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 17 13:56:21.467223 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461215 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 17 13:56:21.467223 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461218 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 17 13:56:21.467223 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461220 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 17 13:56:21.467223 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461224 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 17 13:56:21.467223 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461227 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 17 13:56:21.467223 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461230 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 17 13:56:21.467223 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461232 2565 flags.go:64] FLAG: --enable-load-reader="false" Jul 17 13:56:21.467223 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461235 2565 flags.go:64] FLAG: --enable-server="true" Jul 17 13:56:21.467223 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461238 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 17 13:56:21.467223 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461242 2565 flags.go:64] FLAG: --event-burst="100" Jul 17 13:56:21.467223 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461245 2565 flags.go:64] FLAG: --event-qps="50" Jul 17 13:56:21.467223 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461248 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 17 13:56:21.467223 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461251 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 17 13:56:21.467223 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461254 2565 flags.go:64] FLAG: --eviction-hard="" Jul 17 13:56:21.467223 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461259 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 17 13:56:21.467223 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461262 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 17 13:56:21.467223 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461265 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 17 13:56:21.467223 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461268 2565 flags.go:64] FLAG: --eviction-soft="" Jul 17 13:56:21.467223 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461270 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 17 13:56:21.467223 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461273 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 17 13:56:21.467223 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461276 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 17 13:56:21.467223 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461279 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jul 17 13:56:21.467223 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461282 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 17 13:56:21.467841 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461284 2565 flags.go:64] FLAG: --fail-swap-on="true" Jul 17 13:56:21.467841 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461287 2565 flags.go:64] FLAG: --feature-gates="" Jul 17 13:56:21.467841 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461291 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jul 17 13:56:21.467841 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461294 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 17 13:56:21.467841 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461297 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 17 13:56:21.467841 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461300 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 17 13:56:21.467841 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461302 2565 flags.go:64] FLAG: --healthz-port="10248" Jul 17 13:56:21.467841 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461306 2565 flags.go:64] FLAG: --help="false" Jul 17 13:56:21.467841 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461309 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-138-92.ec2.internal" Jul 17 13:56:21.467841 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461312 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 17 13:56:21.467841 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461315 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jul 17 13:56:21.467841 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461317 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 17 13:56:21.467841 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461320 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 17 13:56:21.467841 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461324 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 17 13:56:21.467841 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461326 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 17 13:56:21.467841 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461329 2565 flags.go:64] FLAG: --image-service-endpoint="" Jul 17 13:56:21.467841 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461331 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 17 13:56:21.467841 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461334 2565 flags.go:64] FLAG: --kube-api-burst="100" Jul 17 13:56:21.467841 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461337 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 17 13:56:21.467841 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461340 2565 flags.go:64] FLAG: --kube-api-qps="50" Jul 17 13:56:21.467841 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461343 2565 flags.go:64] FLAG: --kube-reserved="" Jul 17 13:56:21.467841 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461345 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 17 13:56:21.467841 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461348 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 17 13:56:21.467841 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461353 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jul 17 13:56:21.468459 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461356 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 17 13:56:21.468459 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461359 2565 flags.go:64] FLAG: --lock-file="" Jul 17 13:56:21.468459 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461361 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 17 13:56:21.468459 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461364 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 17 13:56:21.468459 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461367 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 17 13:56:21.468459 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461372 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jul 17 13:56:21.468459 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461374 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 17 13:56:21.468459 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461377 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jul 17 13:56:21.468459 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461379 2565 flags.go:64] FLAG: --logging-format="text" Jul 17 13:56:21.468459 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461382 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 17 13:56:21.468459 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461386 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 17 13:56:21.468459 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461388 2565 flags.go:64] FLAG: --manifest-url="" Jul 17 13:56:21.468459 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461391 2565 flags.go:64] FLAG: --manifest-url-header="" Jul 17 13:56:21.468459 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461395 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 17 13:56:21.468459 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461398 2565 flags.go:64] FLAG: --max-open-files="1000000" Jul 17 13:56:21.468459 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461402 2565 flags.go:64] FLAG: --max-pods="110" Jul 17 13:56:21.468459 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461405 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 17 13:56:21.468459 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461408 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 17 13:56:21.468459 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461411 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jul 17 13:56:21.468459 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461414 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 17 13:56:21.468459 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461416 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 17 13:56:21.468459 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461419 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 17 13:56:21.468459 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461422 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 17 13:56:21.468459 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461428 2565 flags.go:64] FLAG: --node-status-max-images="50" Jul 17 13:56:21.468459 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461431 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 17 13:56:21.469053 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461434 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jul 17 13:56:21.469053 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461437 2565 flags.go:64] FLAG: --pod-cidr="" Jul 17 13:56:21.469053 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461440 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 17 13:56:21.469053 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461445 2565 flags.go:64] FLAG: --pod-manifest-path="" Jul 17 13:56:21.469053 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461447 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jul 17 13:56:21.469053 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461451 2565 flags.go:64] FLAG: --pods-per-core="0" Jul 17 13:56:21.469053 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461455 2565 flags.go:64] FLAG: --port="10250" Jul 17 13:56:21.469053 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461457 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 17 13:56:21.469053 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461461 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bc5c691d46b92695" Jul 17 13:56:21.469053 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461463 2565 flags.go:64] FLAG: --qos-reserved="" Jul 17 13:56:21.469053 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461466 2565 flags.go:64] FLAG: --read-only-port="10255" Jul 17 13:56:21.469053 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461469 2565 flags.go:64] FLAG: --register-node="true" Jul 17 13:56:21.469053 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461472 2565 flags.go:64] FLAG: --register-with-taints="" Jul 17 13:56:21.469053 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461475 2565 flags.go:64] FLAG: --registry-burst="10" Jul 17 13:56:21.469053 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461478 2565 flags.go:64] FLAG: --registry-qps="5" Jul 17 13:56:21.469053 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461481 2565 flags.go:64] FLAG: --reserved-cpus="" Jul 17 13:56:21.469053 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461483 2565 flags.go:64] FLAG: --reserved-memory="" Jul 17 13:56:21.469053 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461487 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 17 13:56:21.469053 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461490 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 17 13:56:21.469053 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461492 2565 flags.go:64] FLAG: --rotate-certificates="false" Jul 17 13:56:21.469053 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461495 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 17 13:56:21.469053 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461498 2565 flags.go:64] FLAG: --runonce="false" Jul 17 13:56:21.469053 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461501 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 17 13:56:21.469053 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461503 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 17 13:56:21.469053 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461506 2565 flags.go:64] FLAG: --seccomp-default="false" Jul 17 13:56:21.469928 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461509 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 17 13:56:21.469928 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461511 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 17 13:56:21.469928 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461514 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 17 13:56:21.469928 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461517 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 17 13:56:21.469928 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461520 2565 flags.go:64] FLAG: --storage-driver-password="root" Jul 17 13:56:21.469928 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461522 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jul 17 13:56:21.469928 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461525 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jul 17 13:56:21.469928 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461528 2565 flags.go:64] FLAG: --storage-driver-user="root" Jul 17 13:56:21.469928 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461530 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 17 13:56:21.469928 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461533 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 17 13:56:21.469928 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461535 2565 flags.go:64] FLAG: --system-cgroups="" Jul 17 13:56:21.469928 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461538 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 17 13:56:21.469928 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461543 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 17 13:56:21.469928 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461547 2565 flags.go:64] FLAG: --tls-cert-file="" Jul 17 13:56:21.469928 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461550 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 17 13:56:21.469928 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461554 2565 flags.go:64] FLAG: --tls-min-version="" Jul 17 13:56:21.469928 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461556 2565 flags.go:64] FLAG: --tls-private-key-file="" Jul 17 13:56:21.469928 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461559 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jul 17 13:56:21.469928 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461562 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 17 13:56:21.469928 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461564 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jul 17 13:56:21.469928 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461567 2565 flags.go:64] FLAG: --v="2" Jul 17 13:56:21.469928 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461571 2565 flags.go:64] FLAG: --version="false" Jul 17 13:56:21.469928 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461575 2565 flags.go:64] FLAG: --vmodule="" Jul 17 13:56:21.469928 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461578 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 17 13:56:21.469928 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.461581 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 17 13:56:21.470783 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461690 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 13:56:21.470783 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461694 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 13:56:21.470783 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461697 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 13:56:21.470783 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461699 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 13:56:21.470783 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461702 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 13:56:21.470783 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461704 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 13:56:21.470783 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461707 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 13:56:21.470783 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461710 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 13:56:21.470783 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461712 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 13:56:21.470783 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461714 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 13:56:21.470783 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461717 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 13:56:21.470783 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461719 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 13:56:21.470783 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461722 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 13:56:21.470783 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461724 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 13:56:21.470783 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461726 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 13:56:21.470783 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461729 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 13:56:21.470783 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461731 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 13:56:21.470783 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461734 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 13:56:21.470783 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461737 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 17 13:56:21.470783 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461740 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 13:56:21.471304 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461744 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 13:56:21.471304 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461746 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 13:56:21.471304 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461749 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 13:56:21.471304 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461751 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 13:56:21.471304 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461753 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 13:56:21.471304 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461756 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 13:56:21.471304 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461758 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 13:56:21.471304 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461760 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 13:56:21.471304 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461763 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 13:56:21.471304 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461766 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 13:56:21.471304 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461769 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 13:56:21.471304 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461771 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 13:56:21.471304 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461773 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 13:56:21.471304 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461776 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 13:56:21.471304 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461778 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 13:56:21.471304 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461780 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 13:56:21.471304 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461784 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 13:56:21.471304 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461787 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 13:56:21.471304 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461789 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 13:56:21.471304 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461792 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 13:56:21.471805 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461794 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 13:56:21.471805 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461797 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 13:56:21.471805 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461799 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 13:56:21.471805 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461801 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 13:56:21.471805 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461804 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 13:56:21.471805 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461808 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 13:56:21.471805 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461811 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 13:56:21.471805 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461814 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 13:56:21.471805 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461817 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 13:56:21.471805 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461820 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 13:56:21.471805 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461823 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 13:56:21.471805 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461826 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 13:56:21.471805 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461833 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 13:56:21.471805 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461836 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 13:56:21.471805 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461839 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 13:56:21.471805 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461842 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 13:56:21.471805 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461845 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 13:56:21.471805 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461848 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 13:56:21.471805 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461850 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 13:56:21.472278 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461852 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 13:56:21.472278 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461855 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 13:56:21.472278 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461857 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 13:56:21.472278 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461860 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 13:56:21.472278 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461862 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 13:56:21.472278 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461865 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 13:56:21.472278 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461868 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 13:56:21.472278 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461871 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 13:56:21.472278 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461874 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 13:56:21.472278 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461878 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 13:56:21.472278 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461881 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 13:56:21.472278 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461884 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 13:56:21.472278 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461886 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 13:56:21.472278 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461888 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 13:56:21.472278 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461892 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 13:56:21.472278 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461894 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 13:56:21.472278 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461897 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 13:56:21.472278 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461899 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 13:56:21.472278 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461902 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 13:56:21.472739 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461904 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 13:56:21.472739 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461906 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 13:56:21.472739 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461909 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 13:56:21.472739 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461911 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 13:56:21.472739 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461914 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 13:56:21.472739 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461916 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 13:56:21.472739 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461920 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 13:56:21.472739 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461922 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 13:56:21.472739 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461925 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 13:56:21.472739 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461927 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 13:56:21.472739 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461930 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 13:56:21.472739 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461932 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 13:56:21.472739 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461935 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 13:56:21.472739 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461937 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 13:56:21.472739 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461940 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 13:56:21.472739 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461942 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 13:56:21.472739 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461945 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 13:56:21.472739 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461947 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 13:56:21.472739 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461949 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 13:56:21.473218 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461952 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 13:56:21.473218 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.461954 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 13:56:21.473218 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.462552 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 13:56:21.473218 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.471353 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 17 13:56:21.473218 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.471381 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 17 13:56:21.473218 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.472110 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 17 13:56:21.473218 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.472118 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 17 13:56:21.473218 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472190 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 13:56:21.473218 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472195 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 13:56:21.473218 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472198 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 13:56:21.473218 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472202 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 13:56:21.473218 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472205 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 13:56:21.473218 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472208 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 13:56:21.473218 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472210 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 13:56:21.473218 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472213 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 13:56:21.473602 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472216 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 13:56:21.473602 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472220 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 13:56:21.473602 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472222 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 13:56:21.473602 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472225 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 13:56:21.473602 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472228 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 13:56:21.473602 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472231 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 13:56:21.473602 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472234 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 13:56:21.473602 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472237 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 13:56:21.473602 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472239 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 13:56:21.473602 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472242 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 13:56:21.473602 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472249 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 13:56:21.473602 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472252 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 13:56:21.473602 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472255 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 13:56:21.473602 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472257 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 13:56:21.473602 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472260 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 13:56:21.473602 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472262 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 13:56:21.473602 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472264 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 13:56:21.473602 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472267 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 13:56:21.473602 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472271 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 13:56:21.473602 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472275 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 13:56:21.474074 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472278 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 13:56:21.474074 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472281 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 13:56:21.474074 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472284 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 13:56:21.474074 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472287 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 13:56:21.474074 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472290 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 13:56:21.474074 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472292 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 13:56:21.474074 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472296 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 13:56:21.474074 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472298 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 13:56:21.474074 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472301 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 13:56:21.474074 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472303 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 13:56:21.474074 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472306 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 13:56:21.474074 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472308 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 13:56:21.474074 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472311 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 13:56:21.474074 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472313 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 13:56:21.474074 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472316 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 13:56:21.474074 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472318 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 13:56:21.474074 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472321 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 13:56:21.474074 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472323 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 13:56:21.474074 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472326 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 13:56:21.474074 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472329 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 13:56:21.474580 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472331 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 13:56:21.474580 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472333 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 13:56:21.474580 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472336 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 13:56:21.474580 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472338 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 13:56:21.474580 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472341 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 13:56:21.474580 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472343 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 13:56:21.474580 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472346 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 13:56:21.474580 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472348 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 13:56:21.474580 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472350 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 13:56:21.474580 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472353 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 13:56:21.474580 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472355 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 13:56:21.474580 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472358 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 17 13:56:21.474580 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472360 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 13:56:21.474580 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472363 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 13:56:21.474580 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472365 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 13:56:21.474580 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472368 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 13:56:21.474580 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472371 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 13:56:21.474580 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472373 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 13:56:21.474580 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472375 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 13:56:21.474580 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472378 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 13:56:21.475073 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472380 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 13:56:21.475073 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472383 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 13:56:21.475073 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472385 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 13:56:21.475073 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472387 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 13:56:21.475073 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472390 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 13:56:21.475073 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472392 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 13:56:21.475073 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472395 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 13:56:21.475073 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472397 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 13:56:21.475073 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472400 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 13:56:21.475073 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472404 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 13:56:21.475073 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472407 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 13:56:21.475073 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472410 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 13:56:21.475073 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472413 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 13:56:21.475073 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472416 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 13:56:21.475073 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472419 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 13:56:21.475073 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472423 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 13:56:21.475073 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472426 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 13:56:21.475073 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472429 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 13:56:21.475073 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472432 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 13:56:21.475644 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472434 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 13:56:21.475644 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472436 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 13:56:21.475644 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472439 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 13:56:21.475644 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472441 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 13:56:21.475644 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472444 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 13:56:21.475644 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472446 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 13:56:21.475644 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472449 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 13:56:21.475644 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472451 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 13:56:21.475644 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472454 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 13:56:21.475644 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472456 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 13:56:21.475644 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472459 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 13:56:21.475644 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472461 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 13:56:21.475644 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.472466 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 13:56:21.475644 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472582 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 17 13:56:21.475644 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472586 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 17 13:56:21.476050 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472589 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 17 13:56:21.476050 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472592 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 17 13:56:21.476050 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472595 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 17 13:56:21.476050 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472597 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 17 13:56:21.476050 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472600 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 17 13:56:21.476050 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472602 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 17 13:56:21.476050 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472605 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 17 13:56:21.476050 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472608 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 17 13:56:21.476050 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472610 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 17 13:56:21.476050 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472612 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 17 13:56:21.476050 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472615 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 17 13:56:21.476050 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472618 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 17 13:56:21.476050 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472621 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 17 13:56:21.476050 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472623 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 17 13:56:21.476050 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472626 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 17 13:56:21.476050 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472628 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 17 13:56:21.476050 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472631 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 17 13:56:21.476050 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472633 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 17 13:56:21.476050 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472636 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 17 13:56:21.476050 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472638 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 17 13:56:21.476563 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472641 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 17 13:56:21.476563 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472643 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 17 13:56:21.476563 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472646 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 17 13:56:21.476563 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472648 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 17 13:56:21.476563 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472651 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 17 13:56:21.476563 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472653 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 17 13:56:21.476563 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472656 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 17 13:56:21.476563 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472658 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 17 13:56:21.476563 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472660 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 17 13:56:21.476563 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472663 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 17 13:56:21.476563 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472665 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 17 13:56:21.476563 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472668 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 17 13:56:21.476563 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472670 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 17 13:56:21.476563 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472673 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 17 13:56:21.476563 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472675 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 17 13:56:21.476563 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472677 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 17 13:56:21.476563 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472680 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 17 13:56:21.476563 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472682 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 17 13:56:21.476563 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472685 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 17 13:56:21.477020 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472689 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 17 13:56:21.477020 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472696 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 17 13:56:21.477020 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472699 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 17 13:56:21.477020 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472701 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 17 13:56:21.477020 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472705 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 17 13:56:21.477020 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472707 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 17 13:56:21.477020 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472710 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 17 13:56:21.477020 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472712 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 17 13:56:21.477020 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472715 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 17 13:56:21.477020 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472717 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 17 13:56:21.477020 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472720 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 17 13:56:21.477020 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472722 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 17 13:56:21.477020 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472724 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 17 13:56:21.477020 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472727 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 17 13:56:21.477020 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472729 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 17 13:56:21.477020 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472732 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 17 13:56:21.477020 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472734 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 17 13:56:21.477020 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472737 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 17 13:56:21.477020 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472739 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 17 13:56:21.477598 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472742 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 17 13:56:21.477598 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472744 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 17 13:56:21.477598 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472747 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 17 13:56:21.477598 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472750 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 17 13:56:21.477598 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472754 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 17 13:56:21.477598 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472757 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 17 13:56:21.477598 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472760 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 17 13:56:21.477598 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472762 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 17 13:56:21.477598 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472765 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 17 13:56:21.477598 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472767 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 17 13:56:21.477598 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472770 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 17 13:56:21.477598 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472772 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 17 13:56:21.477598 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472775 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 17 13:56:21.477598 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472778 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 17 13:56:21.477598 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472781 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 17 13:56:21.477598 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472784 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 17 13:56:21.477598 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472787 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 17 13:56:21.477598 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472790 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 17 13:56:21.477598 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472797 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 17 13:56:21.478055 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472800 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 17 13:56:21.478055 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472803 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 17 13:56:21.478055 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472806 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 17 13:56:21.478055 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472808 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 17 13:56:21.478055 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472811 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 17 13:56:21.478055 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472814 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 17 13:56:21.478055 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472816 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 17 13:56:21.478055 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472818 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 17 13:56:21.478055 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472821 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 17 13:56:21.478055 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472823 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 17 13:56:21.478055 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472828 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 17 13:56:21.478055 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472830 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 17 13:56:21.478055 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472833 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 17 13:56:21.478055 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472835 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 17 13:56:21.478055 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472838 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 17 13:56:21.478055 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472840 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 17 13:56:21.478055 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472842 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 17 13:56:21.478055 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472845 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 17 13:56:21.478055 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472847 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 17 13:56:21.478055 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:21.472850 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 17 13:56:21.478562 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.472854 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 17 13:56:21.478562 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.472961 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jul 17 13:56:21.478562 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.475608 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 17 13:56:21.478562 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.477056 2565 server.go:1019] "Starting client certificate rotation" Jul 17 13:56:21.478562 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.477196 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 17 13:56:21.478562 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.477251 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 17 13:56:21.479409 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.479396 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 17 13:56:21.480501 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.480485 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 17 13:56:21.492769 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.492752 2565 log.go:25] "Validated CRI v1 runtime API" Jul 17 13:56:21.495278 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.495264 2565 log.go:25] "Validated CRI v1 image API" Jul 17 13:56:21.496060 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.496046 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 17 13:56:21.499155 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.499136 2565 fs.go:135] Filesystem UUIDs: map[3de8e445-5138-4588-805a-55995ba23bfd:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c497b4fc-5cd9-4c26-b6fb-7574b8aeae23:/dev/nvme0n1p3] Jul 17 13:56:21.499220 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.499156 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 17 13:56:21.505548 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.505437 2565 manager.go:216] Machine: {Timestamp:2026-07-17 13:56:21.504153682 +0000 UTC m=+0.332506018 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3095747 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a6fb4a144ad6222a194c038ddb6f3 SystemUUID:ec2a6fb4-a144-ad62-22a1-94c038ddb6f3 BootID:88cd1055-b507-4341-ae1d-391adb34738c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:db:c1:cf:78:13 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:db:c1:cf:78:13 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:22:02:d3:b1:35:cf Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 17 13:56:21.505548 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.505538 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 17 13:56:21.505697 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.505613 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 17 13:56:21.506910 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.506888 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 17 13:56:21.509000 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.508974 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 17 13:56:21.509159 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.509006 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-92.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 17 13:56:21.509797 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.509785 2565 topology_manager.go:138] "Creating topology manager with none policy" Jul 17 13:56:21.509853 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.509803 2565 container_manager_linux.go:309] "Creating device plugin manager" Jul 17 13:56:21.509853 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.509813 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 17 13:56:21.511272 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.511260 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 17 13:56:21.512413 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.512400 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 17 13:56:21.515274 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.515260 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 17 13:56:21.515413 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.515402 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 17 13:56:21.515469 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.515439 2565 kubelet.go:486] "Attempting to sync node with API server" Jul 17 13:56:21.515469 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.515453 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 17 13:56:21.515548 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.515473 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 17 13:56:21.515548 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.515486 2565 kubelet.go:398] "Adding apiserver pod source" Jul 17 13:56:21.515548 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.515498 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 17 13:56:21.515886 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.515872 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 17 13:56:21.515959 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.515897 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 17 13:56:21.518084 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.518070 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 17 13:56:21.519898 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.519876 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 17 13:56:21.519978 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.519907 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 17 13:56:21.520859 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.520847 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 17 13:56:21.520894 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.520871 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 17 13:56:21.520894 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.520881 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 17 13:56:21.520894 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.520888 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 17 13:56:21.520986 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.520899 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 17 13:56:21.520986 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.520906 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 17 13:56:21.520986 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.520916 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 17 13:56:21.520986 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.520923 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 17 13:56:21.520986 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.520932 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 17 13:56:21.520986 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.520939 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 17 13:56:21.520986 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.520952 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 17 13:56:21.520986 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.520957 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 17 13:56:21.523110 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.523096 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 17 13:56:21.523149 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.523114 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 17 13:56:21.525550 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.525533 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-92.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 17 13:56:21.526254 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:21.526229 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-92.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 17 13:56:21.526305 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:21.526232 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 17 13:56:21.526709 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.526696 2565 server.go:1268] "Started kubelet" Jul 17 13:56:21.526805 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.526785 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 17 13:56:21.526912 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.526868 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 17 13:56:21.526958 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.526934 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 17 13:56:21.528420 ip-10-0-138-92 systemd[1]: Started Kubernetes Kubelet. Jul 17 13:56:21.528692 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.528492 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 17 13:56:21.529520 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.529448 2565 server.go:310] "Adding debug handlers to kubelet server" Jul 17 13:56:21.531597 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:21.531575 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 17 13:56:21.534577 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.534559 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 17 13:56:21.534667 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.534563 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 17 13:56:21.534667 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:21.534639 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-92.ec2.internal\" not found" Jul 17 13:56:21.535106 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.535087 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 17 13:56:21.535301 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:21.534358 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-92.ec2.internal.18c318498bd74523 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-92.ec2.internal,UID:ip-10-0-138-92.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-92.ec2.internal,},FirstTimestamp:2026-07-17 13:56:21.526668579 +0000 UTC m=+0.355020916,LastTimestamp:2026-07-17 13:56:21.526668579 +0000 UTC m=+0.355020916,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-92.ec2.internal,}" Jul 17 13:56:21.535430 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.535414 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 17 13:56:21.535496 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.535434 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 17 13:56:21.535496 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.535422 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 17 13:56:21.535754 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.535496 2565 factory.go:55] Registering systemd factory Jul 17 13:56:21.535754 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.535508 2565 factory.go:223] Registration of the systemd container factory successfully Jul 17 13:56:21.535754 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.535552 2565 reconstruct.go:97] "Volume reconstruction finished" Jul 17 13:56:21.535754 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.535578 2565 reconciler.go:29] "Reconciler: start to sync state" Jul 17 13:56:21.536298 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.536285 2565 factory.go:153] Registering CRI-O factory Jul 17 13:56:21.536298 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.536298 2565 factory.go:223] Registration of the crio container factory successfully Jul 17 13:56:21.536426 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.536317 2565 factory.go:103] Registering Raw factory Jul 17 13:56:21.536426 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.536325 2565 manager.go:1196] Started watching for new ooms in manager Jul 17 13:56:21.536907 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.536885 2565 manager.go:349] Starting recovery of all containers Jul 17 13:56:21.537312 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:21.537290 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 17 13:56:21.537434 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:21.537413 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-92.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 17 13:56:21.548461 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.548312 2565 manager.go:354] Recovery completed Jul 17 13:56:21.553346 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.553334 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 13:56:21.555331 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.555212 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasSufficientMemory" Jul 17 13:56:21.555331 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.555261 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 13:56:21.555331 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.555275 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasSufficientPID" Jul 17 13:56:21.555908 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.555893 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 17 13:56:21.555908 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.555906 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 17 13:56:21.556038 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.555910 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 13:56:21.556038 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.555921 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 17 13:56:21.556706 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.556693 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasSufficientMemory" Jul 17 13:56:21.556765 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.556716 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 13:56:21.556765 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.556726 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasSufficientPID" Jul 17 13:56:21.556765 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.556731 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fjq4j" Jul 17 13:56:21.557081 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.557069 2565 policy_none.go:49] "None policy: Start" Jul 17 13:56:21.557113 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.557087 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 17 13:56:21.557113 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.557097 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 17 13:56:21.557641 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:21.557583 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-92.ec2.internal.18c318498d8b4311 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-92.ec2.internal,UID:ip-10-0-138-92.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-92.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-92.ec2.internal,},FirstTimestamp:2026-07-17 13:56:21.555241745 +0000 UTC m=+0.383594086,LastTimestamp:2026-07-17 13:56:21.555241745 +0000 UTC m=+0.383594086,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-92.ec2.internal,}" Jul 17 13:56:21.558131 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.558119 2565 policy_none.go:47] "Start" Jul 17 13:56:21.563031 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.563015 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fjq4j" Jul 17 13:56:21.591881 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.591862 2565 manager.go:337] "Starting Device Plugin manager" Jul 17 13:56:21.591963 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:21.591890 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 17 13:56:21.591963 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.591899 2565 server.go:87] "Starting device plugin registration server" Jul 17 13:56:21.592145 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.592132 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 17 13:56:21.592201 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.592151 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 17 13:56:21.592270 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.592255 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 17 13:56:21.592387 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.592350 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 17 13:56:21.592387 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.592361 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 17 13:56:21.592805 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:21.592780 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 17 13:56:21.592874 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:21.592844 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-92.ec2.internal\" not found" Jul 17 13:56:21.689578 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.689547 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 17 13:56:21.690851 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.690834 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 17 13:56:21.690921 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.690873 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 17 13:56:21.690921 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.690895 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jul 17 13:56:21.691021 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:21.690926 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 17 13:56:21.692342 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.692321 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 13:56:21.693166 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.693149 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasSufficientMemory" Jul 17 13:56:21.693254 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.693203 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 13:56:21.693254 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.693222 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasSufficientPID" Jul 17 13:56:21.693254 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.693253 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-92.ec2.internal" Jul 17 13:56:21.693636 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.693621 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 13:56:21.699542 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.699524 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-92.ec2.internal" Jul 17 13:56:21.699629 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:21.699557 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-92.ec2.internal\": node \"ip-10-0-138-92.ec2.internal\" not found" Jul 17 13:56:21.726806 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:21.726760 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-92.ec2.internal\" not found" Jul 17 13:56:21.791677 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.791642 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-92.ec2.internal"] Jul 17 13:56:21.791789 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.791720 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 13:56:21.792646 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.792631 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasSufficientMemory" Jul 17 13:56:21.792721 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.792660 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 13:56:21.792721 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.792670 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasSufficientPID" Jul 17 13:56:21.794083 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.794071 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 13:56:21.794216 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.794202 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal" Jul 17 13:56:21.794255 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.794242 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 13:56:21.794747 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.794732 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasSufficientMemory" Jul 17 13:56:21.794818 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.794750 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasSufficientMemory" Jul 17 13:56:21.794818 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.794761 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 13:56:21.794818 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.794771 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 13:56:21.794818 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.794776 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasSufficientPID" Jul 17 13:56:21.794818 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.794781 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasSufficientPID" Jul 17 13:56:21.796217 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.796203 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-92.ec2.internal" Jul 17 13:56:21.796268 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.796233 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 17 13:56:21.796889 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.796875 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasSufficientMemory" Jul 17 13:56:21.796953 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.796902 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasNoDiskPressure" Jul 17 13:56:21.796953 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.796914 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeHasSufficientPID" Jul 17 13:56:21.820897 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:21.820874 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-92.ec2.internal\" not found" node="ip-10-0-138-92.ec2.internal" Jul 17 13:56:21.825434 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:21.825419 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-92.ec2.internal\" not found" node="ip-10-0-138-92.ec2.internal" Jul 17 13:56:21.827461 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:21.827446 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-92.ec2.internal\" not found" Jul 17 13:56:21.837472 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.837455 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/84dd6aaeace753174afb8903ed9d6bac-config\") pod \"kube-apiserver-proxy-ip-10-0-138-92.ec2.internal\" (UID: \"84dd6aaeace753174afb8903ed9d6bac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-92.ec2.internal" Jul 17 13:56:21.837527 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.837484 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/436b0f12b9dfb4db688c0b344b7ab434-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal\" (UID: \"436b0f12b9dfb4db688c0b344b7ab434\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal" Jul 17 13:56:21.837527 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.837500 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/436b0f12b9dfb4db688c0b344b7ab434-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal\" (UID: \"436b0f12b9dfb4db688c0b344b7ab434\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal" Jul 17 13:56:21.928040 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:21.928018 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-92.ec2.internal\" not found" Jul 17 13:56:21.938379 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.938362 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/436b0f12b9dfb4db688c0b344b7ab434-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal\" (UID: \"436b0f12b9dfb4db688c0b344b7ab434\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal" Jul 17 13:56:21.938427 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.938384 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/436b0f12b9dfb4db688c0b344b7ab434-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal\" (UID: \"436b0f12b9dfb4db688c0b344b7ab434\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal" Jul 17 13:56:21.938427 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.938402 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/84dd6aaeace753174afb8903ed9d6bac-config\") pod \"kube-apiserver-proxy-ip-10-0-138-92.ec2.internal\" (UID: \"84dd6aaeace753174afb8903ed9d6bac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-92.ec2.internal" Jul 17 13:56:21.938487 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.938427 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/84dd6aaeace753174afb8903ed9d6bac-config\") pod \"kube-apiserver-proxy-ip-10-0-138-92.ec2.internal\" (UID: \"84dd6aaeace753174afb8903ed9d6bac\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-92.ec2.internal" Jul 17 13:56:21.938487 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.938444 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/436b0f12b9dfb4db688c0b344b7ab434-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal\" (UID: \"436b0f12b9dfb4db688c0b344b7ab434\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal" Jul 17 13:56:21.938487 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:21.938456 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/436b0f12b9dfb4db688c0b344b7ab434-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal\" (UID: \"436b0f12b9dfb4db688c0b344b7ab434\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal" Jul 17 13:56:22.028735 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:22.028716 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-92.ec2.internal\" not found" Jul 17 13:56:22.124330 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:22.124297 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal" Jul 17 13:56:22.128146 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:22.128074 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-92.ec2.internal" Jul 17 13:56:22.129129 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:22.129109 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-92.ec2.internal\" not found" Jul 17 13:56:22.229493 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:22.229455 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-92.ec2.internal\" not found" Jul 17 13:56:22.334666 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:22.334594 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-92.ec2.internal\" not found" Jul 17 13:56:22.401221 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:22.401183 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 13:56:22.435773 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:22.435738 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-92.ec2.internal\" not found" Jul 17 13:56:22.476908 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:22.476877 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 17 13:56:22.477425 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:22.477014 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 17 13:56:22.477425 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:22.477043 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 17 13:56:22.502593 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:22.502569 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 13:56:22.536186 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:22.536158 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-92.ec2.internal\" not found" Jul 17 13:56:22.566528 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:22.566484 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 13:51:21 +0000 UTC" deadline="2028-03-27 20:23:58.84341387 +0000 UTC" Jul 17 13:56:22.566528 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:22.566517 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14862h27m36.276900724s" Jul 17 13:56:22.636469 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:22.636397 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-92.ec2.internal\" not found" Jul 17 13:56:22.663285 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:22.663244 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84dd6aaeace753174afb8903ed9d6bac.slice/crio-05a35345ccbd84e05fe46f954a4497b731b7f6796623b6744228438bc3e411c2 WatchSource:0}: Error finding container 05a35345ccbd84e05fe46f954a4497b731b7f6796623b6744228438bc3e411c2: Status 404 returned error can't find the container with id 05a35345ccbd84e05fe46f954a4497b731b7f6796623b6744228438bc3e411c2 Jul 17 13:56:22.663636 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:22.663611 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod436b0f12b9dfb4db688c0b344b7ab434.slice/crio-42fea7d5d20808bd784210da3db787fddd5a8342ca6baf88da187addfcf20e88 WatchSource:0}: Error finding container 42fea7d5d20808bd784210da3db787fddd5a8342ca6baf88da187addfcf20e88: Status 404 returned error can't find the container with id 42fea7d5d20808bd784210da3db787fddd5a8342ca6baf88da187addfcf20e88 Jul 17 13:56:22.669259 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:22.669241 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 13:56:22.694683 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:22.694623 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal" event={"ID":"436b0f12b9dfb4db688c0b344b7ab434","Type":"ContainerStarted","Data":"42fea7d5d20808bd784210da3db787fddd5a8342ca6baf88da187addfcf20e88"} Jul 17 13:56:22.695713 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:22.695692 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-92.ec2.internal" event={"ID":"84dd6aaeace753174afb8903ed9d6bac","Type":"ContainerStarted","Data":"05a35345ccbd84e05fe46f954a4497b731b7f6796623b6744228438bc3e411c2"} Jul 17 13:56:22.737133 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:22.737113 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-92.ec2.internal\" not found" Jul 17 13:56:22.841247 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:22.841217 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-92.ec2.internal\" not found" Jul 17 13:56:22.942209 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:22.942111 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-92.ec2.internal\" not found" Jul 17 13:56:22.988441 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:22.988412 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 13:56:23.035378 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.035350 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-92.ec2.internal" Jul 17 13:56:23.046058 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.046039 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 17 13:56:23.047283 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.047271 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal" Jul 17 13:56:23.061808 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.061787 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 17 13:56:23.517465 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.517428 2565 apiserver.go:52] "Watching apiserver" Jul 17 13:56:23.523195 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.523154 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 17 13:56:23.524168 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.523751 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-92.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrql4","openshift-image-registry/node-ca-h5vnp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-5rgk4","kube-system/global-pull-secret-syncer-zjn62","openshift-cluster-node-tuning-operator/tuned-2ptt4","openshift-dns/node-resolver-7vl2s","openshift-multus/multus-additional-cni-plugins-v68k8","openshift-multus/multus-jxlrl","openshift-multus/network-metrics-daemon-kbq75","openshift-network-diagnostics/network-check-target-g6tlt","openshift-network-operator/iptables-alerter-7x4qw","kube-system/konnectivity-agent-6lmcm"] Jul 17 13:56:23.526711 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.525816 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h5vnp" Jul 17 13:56:23.529547 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.528118 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7x4qw" Jul 17 13:56:23.529547 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.529099 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m9qjq\"" Jul 17 13:56:23.529547 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.529396 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 17 13:56:23.529896 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.529697 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.530419 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.530258 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 17 13:56:23.530419 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.530258 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 17 13:56:23.530419 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.530339 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 17 13:56:23.530743 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.530588 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-z6dwj\"" Jul 17 13:56:23.530743 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.530613 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 17 13:56:23.530743 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.530595 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 17 13:56:23.531140 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.531115 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.531812 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.531790 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 17 13:56:23.531944 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.531814 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 17 13:56:23.531944 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.531908 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 17 13:56:23.532088 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.532069 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-z5f86\"" Jul 17 13:56:23.532319 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.532300 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 17 13:56:23.532495 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.532461 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:56:23.532607 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:23.532539 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjn62" podUID="6a493036-14a3-45e6-b0ac-db183e813fc8" Jul 17 13:56:23.534182 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.533053 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-t8cg6\"" Jul 17 13:56:23.534182 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.533226 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 17 13:56:23.534182 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.533454 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 17 13:56:23.534182 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.533705 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 17 13:56:23.534182 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.533828 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 17 13:56:23.534182 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.533880 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 17 13:56:23.534182 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.534014 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 17 13:56:23.534182 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.534196 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.535072 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.534969 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7vl2s" Jul 17 13:56:23.536172 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.536151 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6wfw9\"" Jul 17 13:56:23.539014 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.536609 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 17 13:56:23.539014 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.536804 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 17 13:56:23.539014 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.537662 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7rnfj\"" Jul 17 13:56:23.539014 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.538115 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 17 13:56:23.539014 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.538245 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v68k8" Jul 17 13:56:23.539014 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.538997 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbq75" Jul 17 13:56:23.539399 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:23.539065 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbq75" podUID="cbf9af62-a8f3-4f20-829d-6b23e69b412e" Jul 17 13:56:23.539563 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.539538 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 17 13:56:23.539772 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.539755 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 17 13:56:23.540051 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.540034 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 17 13:56:23.540586 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.540563 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 17 13:56:23.540762 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.540741 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qvww4\"" Jul 17 13:56:23.540894 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.540875 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6tlt" Jul 17 13:56:23.541029 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:23.540989 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6tlt" podUID="cd745e32-d2eb-4680-b42d-65a7410a8669" Jul 17 13:56:23.544051 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.544029 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrql4" Jul 17 13:56:23.545541 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.545192 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6lmcm" Jul 17 13:56:23.547093 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.546458 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 17 13:56:23.547093 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.546649 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 17 13:56:23.547093 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.546856 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 17 13:56:23.547093 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.547049 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qpvqf\"" Jul 17 13:56:23.550432 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.547727 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-wtc7c\"" Jul 17 13:56:23.550432 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.547952 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-os-release\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.550432 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.547986 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b64b331c-1e50-44df-96e8-3d2419bb0653-var-lib-kubelet\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.550432 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548015 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnsw7\" (UniqueName: \"kubernetes.io/projected/02fc3761-d97b-4f88-8b93-e3f3831728d8-kube-api-access-hnsw7\") pod \"iptables-alerter-7x4qw\" (UID: \"02fc3761-d97b-4f88-8b93-e3f3831728d8\") " pod="openshift-network-operator/iptables-alerter-7x4qw" Jul 17 13:56:23.550432 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548040 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-host-kubelet\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.550432 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548065 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-host-slash\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.550432 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548089 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-run-systemd\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.550432 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548113 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/47d4c929-8979-422d-a56e-c339542aa947-ovn-node-metrics-cert\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.550432 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548138 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwjl2\" (UniqueName: \"kubernetes.io/projected/a89f466c-3e1d-436f-a747-eb674d94e1ad-kube-api-access-dwjl2\") pod \"node-resolver-7vl2s\" (UID: \"a89f466c-3e1d-436f-a747-eb674d94e1ad\") " pod="openshift-dns/node-resolver-7vl2s" Jul 17 13:56:23.550432 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548165 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wbfw\" (UniqueName: \"kubernetes.io/projected/cbf9af62-a8f3-4f20-829d-6b23e69b412e-kube-api-access-6wbfw\") pod \"network-metrics-daemon-kbq75\" (UID: \"cbf9af62-a8f3-4f20-829d-6b23e69b412e\") " pod="openshift-multus/network-metrics-daemon-kbq75" Jul 17 13:56:23.550432 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548190 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/67792ecb-4c2c-4d9d-ae18-fcc9fe824b46-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v68k8\" (UID: \"67792ecb-4c2c-4d9d-ae18-fcc9fe824b46\") " pod="openshift-multus/multus-additional-cni-plugins-v68k8" Jul 17 13:56:23.550432 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548216 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b64b331c-1e50-44df-96e8-3d2419bb0653-etc-tuned\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.550432 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548246 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-systemd-units\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.550432 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548293 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-node-log\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.550432 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548316 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-cnibin\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.550432 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548341 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-host-run-k8s-cni-cncf-io\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.550432 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548367 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-host-run-netns\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.551330 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548412 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-etc-kubernetes\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.551330 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548451 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b64b331c-1e50-44df-96e8-3d2419bb0653-etc-kubernetes\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.551330 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548480 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-var-lib-openvswitch\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.551330 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548505 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-host-cni-netd\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.551330 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548528 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/47d4c929-8979-422d-a56e-c339542aa947-ovnkube-config\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.551330 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548552 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-multus-cni-dir\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.551330 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548576 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b64b331c-1e50-44df-96e8-3d2419bb0653-etc-modprobe-d\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.551330 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548600 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b64b331c-1e50-44df-96e8-3d2419bb0653-run\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.551330 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548627 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-host-cni-bin\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.551330 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548653 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gr9ls\" (UniqueName: \"kubernetes.io/projected/67792ecb-4c2c-4d9d-ae18-fcc9fe824b46-kube-api-access-gr9ls\") pod \"multus-additional-cni-plugins-v68k8\" (UID: \"67792ecb-4c2c-4d9d-ae18-fcc9fe824b46\") " pod="openshift-multus/multus-additional-cni-plugins-v68k8" Jul 17 13:56:23.551330 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548679 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d00f939-d019-4401-9be8-43ac747c82c9-cni-binary-copy\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.551330 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548702 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6a493036-14a3-45e6-b0ac-db183e813fc8-dbus\") pod \"global-pull-secret-syncer-zjn62\" (UID: \"6a493036-14a3-45e6-b0ac-db183e813fc8\") " pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:56:23.551330 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548741 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbf9af62-a8f3-4f20-829d-6b23e69b412e-metrics-certs\") pod \"network-metrics-daemon-kbq75\" (UID: \"cbf9af62-a8f3-4f20-829d-6b23e69b412e\") " pod="openshift-multus/network-metrics-daemon-kbq75" Jul 17 13:56:23.551330 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548765 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f760d5c-f6ca-406b-bc61-b18d9d6182fb-host\") pod \"node-ca-h5vnp\" (UID: \"0f760d5c-f6ca-406b-bc61-b18d9d6182fb\") " pod="openshift-image-registry/node-ca-h5vnp" Jul 17 13:56:23.551330 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548792 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-host-var-lib-kubelet\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.551330 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548815 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b64b331c-1e50-44df-96e8-3d2419bb0653-tmp\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.551330 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548847 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-host-run-netns\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.552191 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548871 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/47d4c929-8979-422d-a56e-c339542aa947-ovnkube-script-lib\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.552191 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548906 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/67792ecb-4c2c-4d9d-ae18-fcc9fe824b46-os-release\") pod \"multus-additional-cni-plugins-v68k8\" (UID: \"67792ecb-4c2c-4d9d-ae18-fcc9fe824b46\") " pod="openshift-multus/multus-additional-cni-plugins-v68k8" Jul 17 13:56:23.552191 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548932 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpkj4\" (UniqueName: \"kubernetes.io/projected/5d00f939-d019-4401-9be8-43ac747c82c9-kube-api-access-tpkj4\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.552191 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548956 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b64b331c-1e50-44df-96e8-3d2419bb0653-lib-modules\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.552191 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.548980 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02fc3761-d97b-4f88-8b93-e3f3831728d8-host-slash\") pod \"iptables-alerter-7x4qw\" (UID: \"02fc3761-d97b-4f88-8b93-e3f3831728d8\") " pod="openshift-network-operator/iptables-alerter-7x4qw" Jul 17 13:56:23.552191 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549003 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/47d4c929-8979-422d-a56e-c339542aa947-env-overrides\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.552191 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549027 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a89f466c-3e1d-436f-a747-eb674d94e1ad-tmp-dir\") pod \"node-resolver-7vl2s\" (UID: \"a89f466c-3e1d-436f-a747-eb674d94e1ad\") " pod="openshift-dns/node-resolver-7vl2s" Jul 17 13:56:23.552191 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549063 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/67792ecb-4c2c-4d9d-ae18-fcc9fe824b46-cni-binary-copy\") pod \"multus-additional-cni-plugins-v68k8\" (UID: \"67792ecb-4c2c-4d9d-ae18-fcc9fe824b46\") " pod="openshift-multus/multus-additional-cni-plugins-v68k8" Jul 17 13:56:23.552191 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549090 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkh4l\" (UniqueName: \"kubernetes.io/projected/b64b331c-1e50-44df-96e8-3d2419bb0653-kube-api-access-vkh4l\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.552191 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549147 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-etc-openvswitch\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.552191 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549174 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-run-ovn\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.552191 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549202 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-host-run-ovn-kubernetes\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.552191 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549228 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/67792ecb-4c2c-4d9d-ae18-fcc9fe824b46-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v68k8\" (UID: \"67792ecb-4c2c-4d9d-ae18-fcc9fe824b46\") " pod="openshift-multus/multus-additional-cni-plugins-v68k8" Jul 17 13:56:23.552191 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549281 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-multus-conf-dir\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.552191 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549304 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b64b331c-1e50-44df-96e8-3d2419bb0653-host\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.552191 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549329 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-log-socket\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.552942 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549354 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a89f466c-3e1d-436f-a747-eb674d94e1ad-hosts-file\") pod \"node-resolver-7vl2s\" (UID: \"a89f466c-3e1d-436f-a747-eb674d94e1ad\") " pod="openshift-dns/node-resolver-7vl2s" Jul 17 13:56:23.552942 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549383 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-multus-socket-dir-parent\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.552942 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549409 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-hostroot\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.552942 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549439 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/67792ecb-4c2c-4d9d-ae18-fcc9fe824b46-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v68k8\" (UID: \"67792ecb-4c2c-4d9d-ae18-fcc9fe824b46\") " pod="openshift-multus/multus-additional-cni-plugins-v68k8" Jul 17 13:56:23.552942 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549476 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b64b331c-1e50-44df-96e8-3d2419bb0653-etc-sysconfig\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.552942 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549501 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slxwq\" (UniqueName: \"kubernetes.io/projected/47d4c929-8979-422d-a56e-c339542aa947-kube-api-access-slxwq\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.552942 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549528 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67792ecb-4c2c-4d9d-ae18-fcc9fe824b46-system-cni-dir\") pod \"multus-additional-cni-plugins-v68k8\" (UID: \"67792ecb-4c2c-4d9d-ae18-fcc9fe824b46\") " pod="openshift-multus/multus-additional-cni-plugins-v68k8" Jul 17 13:56:23.552942 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549557 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-host-run-multus-certs\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.552942 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549581 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b64b331c-1e50-44df-96e8-3d2419bb0653-sys\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.552942 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549606 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/67792ecb-4c2c-4d9d-ae18-fcc9fe824b46-cnibin\") pod \"multus-additional-cni-plugins-v68k8\" (UID: \"67792ecb-4c2c-4d9d-ae18-fcc9fe824b46\") " pod="openshift-multus/multus-additional-cni-plugins-v68k8" Jul 17 13:56:23.552942 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549631 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-system-cni-dir\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.552942 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549657 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5d00f939-d019-4401-9be8-43ac747c82c9-multus-daemon-config\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.552942 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549682 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b64b331c-1e50-44df-96e8-3d2419bb0653-etc-sysctl-conf\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.552942 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549712 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-run-openvswitch\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.552942 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549742 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b64b331c-1e50-44df-96e8-3d2419bb0653-etc-systemd\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.552942 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549768 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/02fc3761-d97b-4f88-8b93-e3f3831728d8-iptables-alerter-script\") pod \"iptables-alerter-7x4qw\" (UID: \"02fc3761-d97b-4f88-8b93-e3f3831728d8\") " pod="openshift-network-operator/iptables-alerter-7x4qw" Jul 17 13:56:23.553687 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549793 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b64b331c-1e50-44df-96e8-3d2419bb0653-etc-sysctl-d\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.553687 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549822 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.553687 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549850 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6a493036-14a3-45e6-b0ac-db183e813fc8-kubelet-config\") pod \"global-pull-secret-syncer-zjn62\" (UID: \"6a493036-14a3-45e6-b0ac-db183e813fc8\") " pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:56:23.553687 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549881 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a493036-14a3-45e6-b0ac-db183e813fc8-original-pull-secret\") pod \"global-pull-secret-syncer-zjn62\" (UID: \"6a493036-14a3-45e6-b0ac-db183e813fc8\") " pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:56:23.553687 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549906 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0f760d5c-f6ca-406b-bc61-b18d9d6182fb-serviceca\") pod \"node-ca-h5vnp\" (UID: \"0f760d5c-f6ca-406b-bc61-b18d9d6182fb\") " pod="openshift-image-registry/node-ca-h5vnp" Jul 17 13:56:23.553687 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549932 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-host-var-lib-cni-multus\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.553687 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549959 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpvnd\" (UniqueName: \"kubernetes.io/projected/0f760d5c-f6ca-406b-bc61-b18d9d6182fb-kube-api-access-kpvnd\") pod \"node-ca-h5vnp\" (UID: \"0f760d5c-f6ca-406b-bc61-b18d9d6182fb\") " pod="openshift-image-registry/node-ca-h5vnp" Jul 17 13:56:23.553687 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.549988 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-host-var-lib-cni-bin\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.555919 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.555327 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 17 13:56:23.555919 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.555563 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 17 13:56:23.557203 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.557162 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 17 13:56:23.578975 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.577821 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kl94v" Jul 17 13:56:23.586812 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.586747 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kl94v" Jul 17 13:56:23.636713 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.636692 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 17 13:56:23.654825 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.650681 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b64b331c-1e50-44df-96e8-3d2419bb0653-etc-sysctl-conf\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.654825 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.650710 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-run-openvswitch\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.654825 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.650732 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5dcc5765-36dc-42af-b898-f6f9a73fab0e-registration-dir\") pod \"aws-ebs-csi-driver-node-xrql4\" (UID: \"5dcc5765-36dc-42af-b898-f6f9a73fab0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrql4" Jul 17 13:56:23.654825 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.650755 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b64b331c-1e50-44df-96e8-3d2419bb0653-etc-systemd\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.654825 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.650781 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/02fc3761-d97b-4f88-8b93-e3f3831728d8-iptables-alerter-script\") pod \"iptables-alerter-7x4qw\" (UID: \"02fc3761-d97b-4f88-8b93-e3f3831728d8\") " pod="openshift-network-operator/iptables-alerter-7x4qw" Jul 17 13:56:23.654825 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.650799 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zss5k\" (UniqueName: \"kubernetes.io/projected/cd745e32-d2eb-4680-b42d-65a7410a8669-kube-api-access-zss5k\") pod \"network-check-target-g6tlt\" (UID: \"cd745e32-d2eb-4680-b42d-65a7410a8669\") " pod="openshift-network-diagnostics/network-check-target-g6tlt" Jul 17 13:56:23.654825 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.650815 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/daa5b207-dac5-4e52-90a4-e144871e2db1-konnectivity-ca\") pod \"konnectivity-agent-6lmcm\" (UID: \"daa5b207-dac5-4e52-90a4-e144871e2db1\") " pod="kube-system/konnectivity-agent-6lmcm" Jul 17 13:56:23.654825 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.650830 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b64b331c-1e50-44df-96e8-3d2419bb0653-etc-sysctl-d\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.654825 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.650853 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.654825 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.650872 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6a493036-14a3-45e6-b0ac-db183e813fc8-kubelet-config\") pod \"global-pull-secret-syncer-zjn62\" (UID: \"6a493036-14a3-45e6-b0ac-db183e813fc8\") " pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:56:23.654825 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.650888 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a493036-14a3-45e6-b0ac-db183e813fc8-original-pull-secret\") pod \"global-pull-secret-syncer-zjn62\" (UID: \"6a493036-14a3-45e6-b0ac-db183e813fc8\") " pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:56:23.654825 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.650903 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0f760d5c-f6ca-406b-bc61-b18d9d6182fb-serviceca\") pod \"node-ca-h5vnp\" (UID: \"0f760d5c-f6ca-406b-bc61-b18d9d6182fb\") " pod="openshift-image-registry/node-ca-h5vnp" Jul 17 13:56:23.654825 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.650919 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-host-var-lib-cni-multus\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.654825 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.650944 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/daa5b207-dac5-4e52-90a4-e144871e2db1-agent-certs\") pod \"konnectivity-agent-6lmcm\" (UID: \"daa5b207-dac5-4e52-90a4-e144871e2db1\") " pod="kube-system/konnectivity-agent-6lmcm" Jul 17 13:56:23.654825 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.650961 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpvnd\" (UniqueName: \"kubernetes.io/projected/0f760d5c-f6ca-406b-bc61-b18d9d6182fb-kube-api-access-kpvnd\") pod \"node-ca-h5vnp\" (UID: \"0f760d5c-f6ca-406b-bc61-b18d9d6182fb\") " pod="openshift-image-registry/node-ca-h5vnp" Jul 17 13:56:23.654825 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.650976 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-host-var-lib-cni-bin\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.654825 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.650991 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-os-release\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.655848 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651006 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b64b331c-1e50-44df-96e8-3d2419bb0653-var-lib-kubelet\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.655848 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651052 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnsw7\" (UniqueName: \"kubernetes.io/projected/02fc3761-d97b-4f88-8b93-e3f3831728d8-kube-api-access-hnsw7\") pod \"iptables-alerter-7x4qw\" (UID: \"02fc3761-d97b-4f88-8b93-e3f3831728d8\") " pod="openshift-network-operator/iptables-alerter-7x4qw" Jul 17 13:56:23.655848 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651075 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-host-kubelet\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.655848 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651092 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-host-slash\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.655848 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651107 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-run-systemd\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.655848 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651124 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/47d4c929-8979-422d-a56e-c339542aa947-ovn-node-metrics-cert\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.655848 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651161 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwjl2\" (UniqueName: \"kubernetes.io/projected/a89f466c-3e1d-436f-a747-eb674d94e1ad-kube-api-access-dwjl2\") pod \"node-resolver-7vl2s\" (UID: \"a89f466c-3e1d-436f-a747-eb674d94e1ad\") " pod="openshift-dns/node-resolver-7vl2s" Jul 17 13:56:23.655848 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651183 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wbfw\" (UniqueName: \"kubernetes.io/projected/cbf9af62-a8f3-4f20-829d-6b23e69b412e-kube-api-access-6wbfw\") pod \"network-metrics-daemon-kbq75\" (UID: \"cbf9af62-a8f3-4f20-829d-6b23e69b412e\") " pod="openshift-multus/network-metrics-daemon-kbq75" Jul 17 13:56:23.655848 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651198 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/67792ecb-4c2c-4d9d-ae18-fcc9fe824b46-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v68k8\" (UID: \"67792ecb-4c2c-4d9d-ae18-fcc9fe824b46\") " pod="openshift-multus/multus-additional-cni-plugins-v68k8" Jul 17 13:56:23.655848 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651214 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b64b331c-1e50-44df-96e8-3d2419bb0653-etc-tuned\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.655848 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651250 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-systemd-units\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.655848 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651277 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-node-log\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.655848 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651301 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-cnibin\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.655848 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651322 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-host-run-k8s-cni-cncf-io\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.655848 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651347 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-host-run-netns\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.655848 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651364 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-etc-kubernetes\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.655848 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651382 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b64b331c-1e50-44df-96e8-3d2419bb0653-etc-kubernetes\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.656723 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651400 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-var-lib-openvswitch\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.656723 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651422 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-host-cni-netd\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.656723 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651440 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/47d4c929-8979-422d-a56e-c339542aa947-ovnkube-config\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.656723 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651458 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-multus-cni-dir\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.656723 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651481 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vr2mb\" (UniqueName: \"kubernetes.io/projected/5dcc5765-36dc-42af-b898-f6f9a73fab0e-kube-api-access-vr2mb\") pod \"aws-ebs-csi-driver-node-xrql4\" (UID: \"5dcc5765-36dc-42af-b898-f6f9a73fab0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrql4" Jul 17 13:56:23.656723 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651508 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b64b331c-1e50-44df-96e8-3d2419bb0653-etc-modprobe-d\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.656723 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651531 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b64b331c-1e50-44df-96e8-3d2419bb0653-run\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.656723 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651562 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-host-cni-bin\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.656723 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651584 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gr9ls\" (UniqueName: \"kubernetes.io/projected/67792ecb-4c2c-4d9d-ae18-fcc9fe824b46-kube-api-access-gr9ls\") pod \"multus-additional-cni-plugins-v68k8\" (UID: \"67792ecb-4c2c-4d9d-ae18-fcc9fe824b46\") " pod="openshift-multus/multus-additional-cni-plugins-v68k8" Jul 17 13:56:23.656723 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651605 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d00f939-d019-4401-9be8-43ac747c82c9-cni-binary-copy\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.656723 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651622 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5dcc5765-36dc-42af-b898-f6f9a73fab0e-socket-dir\") pod \"aws-ebs-csi-driver-node-xrql4\" (UID: \"5dcc5765-36dc-42af-b898-f6f9a73fab0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrql4" Jul 17 13:56:23.656723 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651650 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6a493036-14a3-45e6-b0ac-db183e813fc8-dbus\") pod \"global-pull-secret-syncer-zjn62\" (UID: \"6a493036-14a3-45e6-b0ac-db183e813fc8\") " pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:56:23.656723 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651667 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbf9af62-a8f3-4f20-829d-6b23e69b412e-metrics-certs\") pod \"network-metrics-daemon-kbq75\" (UID: \"cbf9af62-a8f3-4f20-829d-6b23e69b412e\") " pod="openshift-multus/network-metrics-daemon-kbq75" Jul 17 13:56:23.656723 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651681 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f760d5c-f6ca-406b-bc61-b18d9d6182fb-host\") pod \"node-ca-h5vnp\" (UID: \"0f760d5c-f6ca-406b-bc61-b18d9d6182fb\") " pod="openshift-image-registry/node-ca-h5vnp" Jul 17 13:56:23.656723 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651698 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-host-var-lib-kubelet\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.656723 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651713 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5dcc5765-36dc-42af-b898-f6f9a73fab0e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xrql4\" (UID: \"5dcc5765-36dc-42af-b898-f6f9a73fab0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrql4" Jul 17 13:56:23.656723 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651733 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b64b331c-1e50-44df-96e8-3d2419bb0653-tmp\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.657601 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651772 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-host-run-netns\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.657601 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651789 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/47d4c929-8979-422d-a56e-c339542aa947-ovnkube-script-lib\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.657601 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651809 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/67792ecb-4c2c-4d9d-ae18-fcc9fe824b46-os-release\") pod \"multus-additional-cni-plugins-v68k8\" (UID: \"67792ecb-4c2c-4d9d-ae18-fcc9fe824b46\") " pod="openshift-multus/multus-additional-cni-plugins-v68k8" Jul 17 13:56:23.657601 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651825 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpkj4\" (UniqueName: \"kubernetes.io/projected/5d00f939-d019-4401-9be8-43ac747c82c9-kube-api-access-tpkj4\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.657601 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651845 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b64b331c-1e50-44df-96e8-3d2419bb0653-lib-modules\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.657601 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651861 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02fc3761-d97b-4f88-8b93-e3f3831728d8-host-slash\") pod \"iptables-alerter-7x4qw\" (UID: \"02fc3761-d97b-4f88-8b93-e3f3831728d8\") " pod="openshift-network-operator/iptables-alerter-7x4qw" Jul 17 13:56:23.657601 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651883 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/47d4c929-8979-422d-a56e-c339542aa947-env-overrides\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.657601 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651899 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a89f466c-3e1d-436f-a747-eb674d94e1ad-tmp-dir\") pod \"node-resolver-7vl2s\" (UID: \"a89f466c-3e1d-436f-a747-eb674d94e1ad\") " pod="openshift-dns/node-resolver-7vl2s" Jul 17 13:56:23.657601 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651940 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/67792ecb-4c2c-4d9d-ae18-fcc9fe824b46-cni-binary-copy\") pod \"multus-additional-cni-plugins-v68k8\" (UID: \"67792ecb-4c2c-4d9d-ae18-fcc9fe824b46\") " pod="openshift-multus/multus-additional-cni-plugins-v68k8" Jul 17 13:56:23.657601 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.651977 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkh4l\" (UniqueName: \"kubernetes.io/projected/b64b331c-1e50-44df-96e8-3d2419bb0653-kube-api-access-vkh4l\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.657601 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.652001 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-etc-openvswitch\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.657601 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.652024 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-run-ovn\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.657601 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.652041 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-host-run-ovn-kubernetes\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.657601 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.652065 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/67792ecb-4c2c-4d9d-ae18-fcc9fe824b46-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v68k8\" (UID: \"67792ecb-4c2c-4d9d-ae18-fcc9fe824b46\") " pod="openshift-multus/multus-additional-cni-plugins-v68k8" Jul 17 13:56:23.657601 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.652085 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-multus-conf-dir\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.657601 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.652101 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5dcc5765-36dc-42af-b898-f6f9a73fab0e-device-dir\") pod \"aws-ebs-csi-driver-node-xrql4\" (UID: \"5dcc5765-36dc-42af-b898-f6f9a73fab0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrql4" Jul 17 13:56:23.657601 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.652123 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b64b331c-1e50-44df-96e8-3d2419bb0653-host\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.658428 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.652142 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-log-socket\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.658428 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.652167 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a89f466c-3e1d-436f-a747-eb674d94e1ad-hosts-file\") pod \"node-resolver-7vl2s\" (UID: \"a89f466c-3e1d-436f-a747-eb674d94e1ad\") " pod="openshift-dns/node-resolver-7vl2s" Jul 17 13:56:23.658428 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.652194 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-multus-socket-dir-parent\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.658428 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.652226 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-hostroot\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.658428 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.652242 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/67792ecb-4c2c-4d9d-ae18-fcc9fe824b46-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v68k8\" (UID: \"67792ecb-4c2c-4d9d-ae18-fcc9fe824b46\") " pod="openshift-multus/multus-additional-cni-plugins-v68k8" Jul 17 13:56:23.658428 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.652286 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b64b331c-1e50-44df-96e8-3d2419bb0653-etc-sysconfig\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.658428 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.652311 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slxwq\" (UniqueName: \"kubernetes.io/projected/47d4c929-8979-422d-a56e-c339542aa947-kube-api-access-slxwq\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.658428 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.652347 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-host-cni-netd\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.658428 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.652371 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67792ecb-4c2c-4d9d-ae18-fcc9fe824b46-system-cni-dir\") pod \"multus-additional-cni-plugins-v68k8\" (UID: \"67792ecb-4c2c-4d9d-ae18-fcc9fe824b46\") " pod="openshift-multus/multus-additional-cni-plugins-v68k8" Jul 17 13:56:23.658428 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.652428 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-host-run-multus-certs\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.658428 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.652463 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5dcc5765-36dc-42af-b898-f6f9a73fab0e-etc-selinux\") pod \"aws-ebs-csi-driver-node-xrql4\" (UID: \"5dcc5765-36dc-42af-b898-f6f9a73fab0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrql4" Jul 17 13:56:23.658428 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.652491 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5dcc5765-36dc-42af-b898-f6f9a73fab0e-sys-fs\") pod \"aws-ebs-csi-driver-node-xrql4\" (UID: \"5dcc5765-36dc-42af-b898-f6f9a73fab0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrql4" Jul 17 13:56:23.658428 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.652496 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b64b331c-1e50-44df-96e8-3d2419bb0653-etc-sysctl-conf\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.658428 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.652552 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-run-openvswitch\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.658428 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.652603 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b64b331c-1e50-44df-96e8-3d2419bb0653-etc-systemd\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.658428 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.652624 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b64b331c-1e50-44df-96e8-3d2419bb0653-lib-modules\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.658428 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.652693 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02fc3761-d97b-4f88-8b93-e3f3831728d8-host-slash\") pod \"iptables-alerter-7x4qw\" (UID: \"02fc3761-d97b-4f88-8b93-e3f3831728d8\") " pod="openshift-network-operator/iptables-alerter-7x4qw" Jul 17 13:56:23.659244 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.652793 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b64b331c-1e50-44df-96e8-3d2419bb0653-etc-modprobe-d\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.659244 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.652830 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b64b331c-1e50-44df-96e8-3d2419bb0653-run\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.659244 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.652858 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-host-cni-bin\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.659244 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.653128 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/47d4c929-8979-422d-a56e-c339542aa947-env-overrides\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.659244 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.653218 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/02fc3761-d97b-4f88-8b93-e3f3831728d8-iptables-alerter-script\") pod \"iptables-alerter-7x4qw\" (UID: \"02fc3761-d97b-4f88-8b93-e3f3831728d8\") " pod="openshift-network-operator/iptables-alerter-7x4qw" Jul 17 13:56:23.659244 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.653325 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-multus-cni-dir\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.659244 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.653638 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5d00f939-d019-4401-9be8-43ac747c82c9-cni-binary-copy\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.659244 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.653644 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a89f466c-3e1d-436f-a747-eb674d94e1ad-tmp-dir\") pod \"node-resolver-7vl2s\" (UID: \"a89f466c-3e1d-436f-a747-eb674d94e1ad\") " pod="openshift-dns/node-resolver-7vl2s" Jul 17 13:56:23.659244 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.653757 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6a493036-14a3-45e6-b0ac-db183e813fc8-dbus\") pod \"global-pull-secret-syncer-zjn62\" (UID: \"6a493036-14a3-45e6-b0ac-db183e813fc8\") " pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:56:23.659244 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.653789 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/47d4c929-8979-422d-a56e-c339542aa947-ovnkube-config\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.659244 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:23.653865 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:23.659244 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:23.653917 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbf9af62-a8f3-4f20-829d-6b23e69b412e-metrics-certs podName:cbf9af62-a8f3-4f20-829d-6b23e69b412e nodeName:}" failed. No retries permitted until 2026-07-17 13:56:24.153902367 +0000 UTC m=+2.982254693 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cbf9af62-a8f3-4f20-829d-6b23e69b412e-metrics-certs") pod "network-metrics-daemon-kbq75" (UID: "cbf9af62-a8f3-4f20-829d-6b23e69b412e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:23.659244 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.653916 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b64b331c-1e50-44df-96e8-3d2419bb0653-etc-sysctl-d\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.659244 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.653962 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.659244 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.654012 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6a493036-14a3-45e6-b0ac-db183e813fc8-kubelet-config\") pod \"global-pull-secret-syncer-zjn62\" (UID: \"6a493036-14a3-45e6-b0ac-db183e813fc8\") " pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:56:23.659244 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.654074 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0f760d5c-f6ca-406b-bc61-b18d9d6182fb-host\") pod \"node-ca-h5vnp\" (UID: \"0f760d5c-f6ca-406b-bc61-b18d9d6182fb\") " pod="openshift-image-registry/node-ca-h5vnp" Jul 17 13:56:23.659244 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:23.654102 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:23.659244 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.654110 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-host-var-lib-kubelet\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.659933 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:23.654153 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a493036-14a3-45e6-b0ac-db183e813fc8-original-pull-secret podName:6a493036-14a3-45e6-b0ac-db183e813fc8 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:24.154136918 +0000 UTC m=+2.982489250 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a493036-14a3-45e6-b0ac-db183e813fc8-original-pull-secret") pod "global-pull-secret-syncer-zjn62" (UID: "6a493036-14a3-45e6-b0ac-db183e813fc8") : object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:23.659933 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.654190 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/67792ecb-4c2c-4d9d-ae18-fcc9fe824b46-cni-binary-copy\") pod \"multus-additional-cni-plugins-v68k8\" (UID: \"67792ecb-4c2c-4d9d-ae18-fcc9fe824b46\") " pod="openshift-multus/multus-additional-cni-plugins-v68k8" Jul 17 13:56:23.659933 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.654367 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 17 13:56:23.659933 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.654370 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-host-var-lib-cni-multus\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.659933 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.654498 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-etc-openvswitch\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.659933 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.654552 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-run-ovn\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.659933 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.654568 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-multus-socket-dir-parent\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.659933 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.654608 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/0f760d5c-f6ca-406b-bc61-b18d9d6182fb-serviceca\") pod \"node-ca-h5vnp\" (UID: \"0f760d5c-f6ca-406b-bc61-b18d9d6182fb\") " pod="openshift-image-registry/node-ca-h5vnp" Jul 17 13:56:23.659933 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.654625 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-host-run-ovn-kubernetes\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.659933 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.654678 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-hostroot\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.659933 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.654852 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-host-kubelet\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.659933 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.654908 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-host-slash\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.659933 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.654961 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-run-systemd\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.659933 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.655212 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/67792ecb-4c2c-4d9d-ae18-fcc9fe824b46-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v68k8\" (UID: \"67792ecb-4c2c-4d9d-ae18-fcc9fe824b46\") " pod="openshift-multus/multus-additional-cni-plugins-v68k8" Jul 17 13:56:23.659933 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.655180 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-os-release\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.659933 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.655324 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-multus-conf-dir\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.659933 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.655383 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b64b331c-1e50-44df-96e8-3d2419bb0653-host\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.660729 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.655404 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a89f466c-3e1d-436f-a747-eb674d94e1ad-hosts-file\") pod \"node-resolver-7vl2s\" (UID: \"a89f466c-3e1d-436f-a747-eb674d94e1ad\") " pod="openshift-dns/node-resolver-7vl2s" Jul 17 13:56:23.660729 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.655434 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-log-socket\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.660729 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.655477 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b64b331c-1e50-44df-96e8-3d2419bb0653-var-lib-kubelet\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.660729 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.655521 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-host-run-k8s-cni-cncf-io\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.660729 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.655549 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-host-run-netns\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.660729 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.655620 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-etc-kubernetes\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.660729 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.655655 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/67792ecb-4c2c-4d9d-ae18-fcc9fe824b46-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v68k8\" (UID: \"67792ecb-4c2c-4d9d-ae18-fcc9fe824b46\") " pod="openshift-multus/multus-additional-cni-plugins-v68k8" Jul 17 13:56:23.660729 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.655690 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b64b331c-1e50-44df-96e8-3d2419bb0653-etc-kubernetes\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.660729 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.655741 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-var-lib-openvswitch\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.660729 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.655776 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b64b331c-1e50-44df-96e8-3d2419bb0653-sys\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.660729 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.655808 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/67792ecb-4c2c-4d9d-ae18-fcc9fe824b46-cnibin\") pod \"multus-additional-cni-plugins-v68k8\" (UID: \"67792ecb-4c2c-4d9d-ae18-fcc9fe824b46\") " pod="openshift-multus/multus-additional-cni-plugins-v68k8" Jul 17 13:56:23.660729 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.655841 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-system-cni-dir\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.660729 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.655864 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5d00f939-d019-4401-9be8-43ac747c82c9-multus-daemon-config\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.660729 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.655988 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b64b331c-1e50-44df-96e8-3d2419bb0653-etc-sysconfig\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.660729 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.656441 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5d00f939-d019-4401-9be8-43ac747c82c9-multus-daemon-config\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.660729 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.656509 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b64b331c-1e50-44df-96e8-3d2419bb0653-sys\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.660729 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.656551 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/67792ecb-4c2c-4d9d-ae18-fcc9fe824b46-cnibin\") pod \"multus-additional-cni-plugins-v68k8\" (UID: \"67792ecb-4c2c-4d9d-ae18-fcc9fe824b46\") " pod="openshift-multus/multus-additional-cni-plugins-v68k8" Jul 17 13:56:23.660729 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.656540 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/67792ecb-4c2c-4d9d-ae18-fcc9fe824b46-system-cni-dir\") pod \"multus-additional-cni-plugins-v68k8\" (UID: \"67792ecb-4c2c-4d9d-ae18-fcc9fe824b46\") " pod="openshift-multus/multus-additional-cni-plugins-v68k8" Jul 17 13:56:23.661869 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.656608 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-system-cni-dir\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.661869 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.656631 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-host-run-multus-certs\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.661869 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.656658 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-node-log\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.661869 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.656689 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-systemd-units\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.661869 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.656715 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-cnibin\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.661869 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.656755 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5d00f939-d019-4401-9be8-43ac747c82c9-host-var-lib-cni-bin\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.661869 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.656747 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/67792ecb-4c2c-4d9d-ae18-fcc9fe824b46-os-release\") pod \"multus-additional-cni-plugins-v68k8\" (UID: \"67792ecb-4c2c-4d9d-ae18-fcc9fe824b46\") " pod="openshift-multus/multus-additional-cni-plugins-v68k8" Jul 17 13:56:23.661869 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.656863 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/47d4c929-8979-422d-a56e-c339542aa947-host-run-netns\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.661869 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.657321 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/47d4c929-8979-422d-a56e-c339542aa947-ovnkube-script-lib\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.661869 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.659259 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b64b331c-1e50-44df-96e8-3d2419bb0653-etc-tuned\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.662923 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.662709 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/67792ecb-4c2c-4d9d-ae18-fcc9fe824b46-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v68k8\" (UID: \"67792ecb-4c2c-4d9d-ae18-fcc9fe824b46\") " pod="openshift-multus/multus-additional-cni-plugins-v68k8" Jul 17 13:56:23.664489 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.663866 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/47d4c929-8979-422d-a56e-c339542aa947-ovn-node-metrics-cert\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.666712 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.666436 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b64b331c-1e50-44df-96e8-3d2419bb0653-tmp\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.668993 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.668963 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpvnd\" (UniqueName: \"kubernetes.io/projected/0f760d5c-f6ca-406b-bc61-b18d9d6182fb-kube-api-access-kpvnd\") pod \"node-ca-h5vnp\" (UID: \"0f760d5c-f6ca-406b-bc61-b18d9d6182fb\") " pod="openshift-image-registry/node-ca-h5vnp" Jul 17 13:56:23.673854 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.673825 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwjl2\" (UniqueName: \"kubernetes.io/projected/a89f466c-3e1d-436f-a747-eb674d94e1ad-kube-api-access-dwjl2\") pod \"node-resolver-7vl2s\" (UID: \"a89f466c-3e1d-436f-a747-eb674d94e1ad\") " pod="openshift-dns/node-resolver-7vl2s" Jul 17 13:56:23.675364 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.675337 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gr9ls\" (UniqueName: \"kubernetes.io/projected/67792ecb-4c2c-4d9d-ae18-fcc9fe824b46-kube-api-access-gr9ls\") pod \"multus-additional-cni-plugins-v68k8\" (UID: \"67792ecb-4c2c-4d9d-ae18-fcc9fe824b46\") " pod="openshift-multus/multus-additional-cni-plugins-v68k8" Jul 17 13:56:23.675881 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.675842 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wbfw\" (UniqueName: \"kubernetes.io/projected/cbf9af62-a8f3-4f20-829d-6b23e69b412e-kube-api-access-6wbfw\") pod \"network-metrics-daemon-kbq75\" (UID: \"cbf9af62-a8f3-4f20-829d-6b23e69b412e\") " pod="openshift-multus/network-metrics-daemon-kbq75" Jul 17 13:56:23.676248 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.676227 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnsw7\" (UniqueName: \"kubernetes.io/projected/02fc3761-d97b-4f88-8b93-e3f3831728d8-kube-api-access-hnsw7\") pod \"iptables-alerter-7x4qw\" (UID: \"02fc3761-d97b-4f88-8b93-e3f3831728d8\") " pod="openshift-network-operator/iptables-alerter-7x4qw" Jul 17 13:56:23.683211 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.683128 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpkj4\" (UniqueName: \"kubernetes.io/projected/5d00f939-d019-4401-9be8-43ac747c82c9-kube-api-access-tpkj4\") pod \"multus-jxlrl\" (UID: \"5d00f939-d019-4401-9be8-43ac747c82c9\") " pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.683445 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.683393 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slxwq\" (UniqueName: \"kubernetes.io/projected/47d4c929-8979-422d-a56e-c339542aa947-kube-api-access-slxwq\") pod \"ovnkube-node-5rgk4\" (UID: \"47d4c929-8979-422d-a56e-c339542aa947\") " pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.683868 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.683835 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkh4l\" (UniqueName: \"kubernetes.io/projected/b64b331c-1e50-44df-96e8-3d2419bb0653-kube-api-access-vkh4l\") pod \"tuned-2ptt4\" (UID: \"b64b331c-1e50-44df-96e8-3d2419bb0653\") " pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.756443 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.756411 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5dcc5765-36dc-42af-b898-f6f9a73fab0e-etc-selinux\") pod \"aws-ebs-csi-driver-node-xrql4\" (UID: \"5dcc5765-36dc-42af-b898-f6f9a73fab0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrql4" Jul 17 13:56:23.756616 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.756451 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5dcc5765-36dc-42af-b898-f6f9a73fab0e-sys-fs\") pod \"aws-ebs-csi-driver-node-xrql4\" (UID: \"5dcc5765-36dc-42af-b898-f6f9a73fab0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrql4" Jul 17 13:56:23.756616 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.756483 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5dcc5765-36dc-42af-b898-f6f9a73fab0e-registration-dir\") pod \"aws-ebs-csi-driver-node-xrql4\" (UID: \"5dcc5765-36dc-42af-b898-f6f9a73fab0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrql4" Jul 17 13:56:23.756616 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.756512 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zss5k\" (UniqueName: \"kubernetes.io/projected/cd745e32-d2eb-4680-b42d-65a7410a8669-kube-api-access-zss5k\") pod \"network-check-target-g6tlt\" (UID: \"cd745e32-d2eb-4680-b42d-65a7410a8669\") " pod="openshift-network-diagnostics/network-check-target-g6tlt" Jul 17 13:56:23.756616 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.756539 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/daa5b207-dac5-4e52-90a4-e144871e2db1-konnectivity-ca\") pod \"konnectivity-agent-6lmcm\" (UID: \"daa5b207-dac5-4e52-90a4-e144871e2db1\") " pod="kube-system/konnectivity-agent-6lmcm" Jul 17 13:56:23.756616 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.756579 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/daa5b207-dac5-4e52-90a4-e144871e2db1-agent-certs\") pod \"konnectivity-agent-6lmcm\" (UID: \"daa5b207-dac5-4e52-90a4-e144871e2db1\") " pod="kube-system/konnectivity-agent-6lmcm" Jul 17 13:56:23.756898 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.756624 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vr2mb\" (UniqueName: \"kubernetes.io/projected/5dcc5765-36dc-42af-b898-f6f9a73fab0e-kube-api-access-vr2mb\") pod \"aws-ebs-csi-driver-node-xrql4\" (UID: \"5dcc5765-36dc-42af-b898-f6f9a73fab0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrql4" Jul 17 13:56:23.756898 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.756644 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5dcc5765-36dc-42af-b898-f6f9a73fab0e-socket-dir\") pod \"aws-ebs-csi-driver-node-xrql4\" (UID: \"5dcc5765-36dc-42af-b898-f6f9a73fab0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrql4" Jul 17 13:56:23.756898 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.756673 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5dcc5765-36dc-42af-b898-f6f9a73fab0e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xrql4\" (UID: \"5dcc5765-36dc-42af-b898-f6f9a73fab0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrql4" Jul 17 13:56:23.756898 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.756698 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5dcc5765-36dc-42af-b898-f6f9a73fab0e-device-dir\") pod \"aws-ebs-csi-driver-node-xrql4\" (UID: \"5dcc5765-36dc-42af-b898-f6f9a73fab0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrql4" Jul 17 13:56:23.756898 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.756765 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5dcc5765-36dc-42af-b898-f6f9a73fab0e-device-dir\") pod \"aws-ebs-csi-driver-node-xrql4\" (UID: \"5dcc5765-36dc-42af-b898-f6f9a73fab0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrql4" Jul 17 13:56:23.757314 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.757284 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5dcc5765-36dc-42af-b898-f6f9a73fab0e-sys-fs\") pod \"aws-ebs-csi-driver-node-xrql4\" (UID: \"5dcc5765-36dc-42af-b898-f6f9a73fab0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrql4" Jul 17 13:56:23.757405 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.757293 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/daa5b207-dac5-4e52-90a4-e144871e2db1-konnectivity-ca\") pod \"konnectivity-agent-6lmcm\" (UID: \"daa5b207-dac5-4e52-90a4-e144871e2db1\") " pod="kube-system/konnectivity-agent-6lmcm" Jul 17 13:56:23.757405 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.757339 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5dcc5765-36dc-42af-b898-f6f9a73fab0e-registration-dir\") pod \"aws-ebs-csi-driver-node-xrql4\" (UID: \"5dcc5765-36dc-42af-b898-f6f9a73fab0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrql4" Jul 17 13:56:23.757547 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.757427 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5dcc5765-36dc-42af-b898-f6f9a73fab0e-etc-selinux\") pod \"aws-ebs-csi-driver-node-xrql4\" (UID: \"5dcc5765-36dc-42af-b898-f6f9a73fab0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrql4" Jul 17 13:56:23.757547 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.757531 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5dcc5765-36dc-42af-b898-f6f9a73fab0e-socket-dir\") pod \"aws-ebs-csi-driver-node-xrql4\" (UID: \"5dcc5765-36dc-42af-b898-f6f9a73fab0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrql4" Jul 17 13:56:23.757640 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.757563 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5dcc5765-36dc-42af-b898-f6f9a73fab0e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xrql4\" (UID: \"5dcc5765-36dc-42af-b898-f6f9a73fab0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrql4" Jul 17 13:56:23.759896 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.759856 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/daa5b207-dac5-4e52-90a4-e144871e2db1-agent-certs\") pod \"konnectivity-agent-6lmcm\" (UID: \"daa5b207-dac5-4e52-90a4-e144871e2db1\") " pod="kube-system/konnectivity-agent-6lmcm" Jul 17 13:56:23.762775 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:23.762755 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 13:56:23.762871 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:23.762781 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 13:56:23.762871 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:23.762796 2565 projected.go:196] Error preparing data for projected volume kube-api-access-zss5k for pod openshift-network-diagnostics/network-check-target-g6tlt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:23.762871 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:23.762850 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd745e32-d2eb-4680-b42d-65a7410a8669-kube-api-access-zss5k podName:cd745e32-d2eb-4680-b42d-65a7410a8669 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:24.262837099 +0000 UTC m=+3.091189424 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zss5k" (UniqueName: "kubernetes.io/projected/cd745e32-d2eb-4680-b42d-65a7410a8669-kube-api-access-zss5k") pod "network-check-target-g6tlt" (UID: "cd745e32-d2eb-4680-b42d-65a7410a8669") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:23.765689 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.765670 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vr2mb\" (UniqueName: \"kubernetes.io/projected/5dcc5765-36dc-42af-b898-f6f9a73fab0e-kube-api-access-vr2mb\") pod \"aws-ebs-csi-driver-node-xrql4\" (UID: \"5dcc5765-36dc-42af-b898-f6f9a73fab0e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrql4" Jul 17 13:56:23.804449 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.804423 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 13:56:23.855694 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.855674 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h5vnp" Jul 17 13:56:23.863154 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.863133 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7x4qw" Jul 17 13:56:23.873099 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.873078 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jxlrl" Jul 17 13:56:23.880045 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.880023 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:23.890804 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.890786 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" Jul 17 13:56:23.899659 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.899640 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7vl2s" Jul 17 13:56:23.908537 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.908518 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v68k8" Jul 17 13:56:23.919454 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.919438 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrql4" Jul 17 13:56:23.927118 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:23.927098 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6lmcm" Jul 17 13:56:24.159783 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:24.159693 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbf9af62-a8f3-4f20-829d-6b23e69b412e-metrics-certs\") pod \"network-metrics-daemon-kbq75\" (UID: \"cbf9af62-a8f3-4f20-829d-6b23e69b412e\") " pod="openshift-multus/network-metrics-daemon-kbq75" Jul 17 13:56:24.159987 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:24.159786 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a493036-14a3-45e6-b0ac-db183e813fc8-original-pull-secret\") pod \"global-pull-secret-syncer-zjn62\" (UID: \"6a493036-14a3-45e6-b0ac-db183e813fc8\") " pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:56:24.159987 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:24.159862 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:24.159987 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:24.159905 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:24.159987 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:24.159945 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbf9af62-a8f3-4f20-829d-6b23e69b412e-metrics-certs podName:cbf9af62-a8f3-4f20-829d-6b23e69b412e nodeName:}" failed. No retries permitted until 2026-07-17 13:56:25.159923163 +0000 UTC m=+3.988275504 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cbf9af62-a8f3-4f20-829d-6b23e69b412e-metrics-certs") pod "network-metrics-daemon-kbq75" (UID: "cbf9af62-a8f3-4f20-829d-6b23e69b412e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:24.159987 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:24.159970 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a493036-14a3-45e6-b0ac-db183e813fc8-original-pull-secret podName:6a493036-14a3-45e6-b0ac-db183e813fc8 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:25.159957297 +0000 UTC m=+3.988309631 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a493036-14a3-45e6-b0ac-db183e813fc8-original-pull-secret") pod "global-pull-secret-syncer-zjn62" (UID: "6a493036-14a3-45e6-b0ac-db183e813fc8") : object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:24.361562 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:24.361527 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zss5k\" (UniqueName: \"kubernetes.io/projected/cd745e32-d2eb-4680-b42d-65a7410a8669-kube-api-access-zss5k\") pod \"network-check-target-g6tlt\" (UID: \"cd745e32-d2eb-4680-b42d-65a7410a8669\") " pod="openshift-network-diagnostics/network-check-target-g6tlt" Jul 17 13:56:24.361768 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:24.361702 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 13:56:24.361768 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:24.361725 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 13:56:24.361768 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:24.361735 2565 projected.go:196] Error preparing data for projected volume kube-api-access-zss5k for pod openshift-network-diagnostics/network-check-target-g6tlt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:24.361924 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:24.361800 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd745e32-d2eb-4680-b42d-65a7410a8669-kube-api-access-zss5k podName:cd745e32-d2eb-4680-b42d-65a7410a8669 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:25.361779832 +0000 UTC m=+4.190132158 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zss5k" (UniqueName: "kubernetes.io/projected/cd745e32-d2eb-4680-b42d-65a7410a8669-kube-api-access-zss5k") pod "network-check-target-g6tlt" (UID: "cd745e32-d2eb-4680-b42d-65a7410a8669") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:24.589785 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:24.589737 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 13:51:23 +0000 UTC" deadline="2027-12-18 21:48:41.56224832 +0000 UTC" Jul 17 13:56:24.589785 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:24.589770 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12463h52m16.972482792s" Jul 17 13:56:24.762455 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:24.762427 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f760d5c_f6ca_406b_bc61_b18d9d6182fb.slice/crio-3f8070c28808bcaa7064360811270b9ebb079f0ec512379bc1ad7940a927c85c WatchSource:0}: Error finding container 3f8070c28808bcaa7064360811270b9ebb079f0ec512379bc1ad7940a927c85c: Status 404 returned error can't find the container with id 3f8070c28808bcaa7064360811270b9ebb079f0ec512379bc1ad7940a927c85c Jul 17 13:56:24.767512 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:24.767482 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d00f939_d019_4401_9be8_43ac747c82c9.slice/crio-dafd7a8bb35f3b5ef8d127d534088dd60488c4c00855855b79c4d1b9bd3fc39f WatchSource:0}: Error finding container dafd7a8bb35f3b5ef8d127d534088dd60488c4c00855855b79c4d1b9bd3fc39f: Status 404 returned error can't find the container with id dafd7a8bb35f3b5ef8d127d534088dd60488c4c00855855b79c4d1b9bd3fc39f Jul 17 13:56:24.769999 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:24.769163 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb64b331c_1e50_44df_96e8_3d2419bb0653.slice/crio-f07d743396ac462943ff0c6c2b483710957c7771652bfc3e9c7a7c6451bb1548 WatchSource:0}: Error finding container f07d743396ac462943ff0c6c2b483710957c7771652bfc3e9c7a7c6451bb1548: Status 404 returned error can't find the container with id f07d743396ac462943ff0c6c2b483710957c7771652bfc3e9c7a7c6451bb1548 Jul 17 13:56:24.771142 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:24.771119 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda89f466c_3e1d_436f_a747_eb674d94e1ad.slice/crio-4d02cff81bc19526628856eda3187f212f93ed758190be540a4bc51d77f53bcd WatchSource:0}: Error finding container 4d02cff81bc19526628856eda3187f212f93ed758190be540a4bc51d77f53bcd: Status 404 returned error can't find the container with id 4d02cff81bc19526628856eda3187f212f93ed758190be540a4bc51d77f53bcd Jul 17 13:56:24.771954 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:24.771870 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47d4c929_8979_422d_a56e_c339542aa947.slice/crio-1e47e71013d2c73489ccccf7c7f49517c84925b394a0515636d520baedaea87c WatchSource:0}: Error finding container 1e47e71013d2c73489ccccf7c7f49517c84925b394a0515636d520baedaea87c: Status 404 returned error can't find the container with id 1e47e71013d2c73489ccccf7c7f49517c84925b394a0515636d520baedaea87c Jul 17 13:56:24.776092 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:24.775623 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02fc3761_d97b_4f88_8b93_e3f3831728d8.slice/crio-ec752478124e746248861436aff8083ad1def9c42e2569ff2d1f66a2e723c191 WatchSource:0}: Error finding container ec752478124e746248861436aff8083ad1def9c42e2569ff2d1f66a2e723c191: Status 404 returned error can't find the container with id ec752478124e746248861436aff8083ad1def9c42e2569ff2d1f66a2e723c191 Jul 17 13:56:25.170062 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:25.169848 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbf9af62-a8f3-4f20-829d-6b23e69b412e-metrics-certs\") pod \"network-metrics-daemon-kbq75\" (UID: \"cbf9af62-a8f3-4f20-829d-6b23e69b412e\") " pod="openshift-multus/network-metrics-daemon-kbq75" Jul 17 13:56:25.170259 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:25.170096 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a493036-14a3-45e6-b0ac-db183e813fc8-original-pull-secret\") pod \"global-pull-secret-syncer-zjn62\" (UID: \"6a493036-14a3-45e6-b0ac-db183e813fc8\") " pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:56:25.170259 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:25.169999 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:25.170259 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:25.170205 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:25.170259 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:25.170217 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbf9af62-a8f3-4f20-829d-6b23e69b412e-metrics-certs podName:cbf9af62-a8f3-4f20-829d-6b23e69b412e nodeName:}" failed. No retries permitted until 2026-07-17 13:56:27.170174056 +0000 UTC m=+5.998526398 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cbf9af62-a8f3-4f20-829d-6b23e69b412e-metrics-certs") pod "network-metrics-daemon-kbq75" (UID: "cbf9af62-a8f3-4f20-829d-6b23e69b412e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:25.170608 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:25.170270 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a493036-14a3-45e6-b0ac-db183e813fc8-original-pull-secret podName:6a493036-14a3-45e6-b0ac-db183e813fc8 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:27.170256118 +0000 UTC m=+5.998608444 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a493036-14a3-45e6-b0ac-db183e813fc8-original-pull-secret") pod "global-pull-secret-syncer-zjn62" (UID: "6a493036-14a3-45e6-b0ac-db183e813fc8") : object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:25.287003 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:25.286970 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 17 13:56:25.372686 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:25.372642 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zss5k\" (UniqueName: \"kubernetes.io/projected/cd745e32-d2eb-4680-b42d-65a7410a8669-kube-api-access-zss5k\") pod \"network-check-target-g6tlt\" (UID: \"cd745e32-d2eb-4680-b42d-65a7410a8669\") " pod="openshift-network-diagnostics/network-check-target-g6tlt" Jul 17 13:56:25.372888 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:25.372868 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 13:56:25.372957 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:25.372899 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 13:56:25.372957 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:25.372914 2565 projected.go:196] Error preparing data for projected volume kube-api-access-zss5k for pod openshift-network-diagnostics/network-check-target-g6tlt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:25.373061 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:25.372999 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd745e32-d2eb-4680-b42d-65a7410a8669-kube-api-access-zss5k podName:cd745e32-d2eb-4680-b42d-65a7410a8669 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:27.372980099 +0000 UTC m=+6.201332439 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zss5k" (UniqueName: "kubernetes.io/projected/cd745e32-d2eb-4680-b42d-65a7410a8669-kube-api-access-zss5k") pod "network-check-target-g6tlt" (UID: "cd745e32-d2eb-4680-b42d-65a7410a8669") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:25.590817 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:25.590697 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 13:51:23 +0000 UTC" deadline="2028-02-23 21:04:03.467144822 +0000 UTC" Jul 17 13:56:25.590817 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:25.590763 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14071h7m37.876386405s" Jul 17 13:56:25.695134 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:25.694331 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:56:25.695134 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:25.694455 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjn62" podUID="6a493036-14a3-45e6-b0ac-db183e813fc8" Jul 17 13:56:25.695134 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:25.694861 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbq75" Jul 17 13:56:25.695134 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:25.694961 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbq75" podUID="cbf9af62-a8f3-4f20-829d-6b23e69b412e" Jul 17 13:56:25.695134 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:25.695021 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6tlt" Jul 17 13:56:25.695134 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:25.695085 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6tlt" podUID="cd745e32-d2eb-4680-b42d-65a7410a8669" Jul 17 13:56:25.721205 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:25.720469 2565 generic.go:356] "Generic (PLEG): container finished" podID="436b0f12b9dfb4db688c0b344b7ab434" containerID="ae8a4ed0231c63e481bc041437f0e0da9a8f5fa6e7304812bc6a406d076dbe42" exitCode=0 Jul 17 13:56:25.721205 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:25.720549 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal" event={"ID":"436b0f12b9dfb4db688c0b344b7ab434","Type":"ContainerDied","Data":"ae8a4ed0231c63e481bc041437f0e0da9a8f5fa6e7304812bc6a406d076dbe42"} Jul 17 13:56:25.734243 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:25.734214 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" event={"ID":"47d4c929-8979-422d-a56e-c339542aa947","Type":"ContainerStarted","Data":"1e47e71013d2c73489ccccf7c7f49517c84925b394a0515636d520baedaea87c"} Jul 17 13:56:25.740006 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:25.739978 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6lmcm" event={"ID":"daa5b207-dac5-4e52-90a4-e144871e2db1","Type":"ContainerStarted","Data":"71aa77e685b000294c2a9df1157189208530a8745a32e87cbd5a11a974dcc577"} Jul 17 13:56:25.759229 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:25.759160 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7x4qw" event={"ID":"02fc3761-d97b-4f88-8b93-e3f3831728d8","Type":"ContainerStarted","Data":"ec752478124e746248861436aff8083ad1def9c42e2569ff2d1f66a2e723c191"} Jul 17 13:56:25.766084 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:25.766013 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7vl2s" event={"ID":"a89f466c-3e1d-436f-a747-eb674d94e1ad","Type":"ContainerStarted","Data":"4d02cff81bc19526628856eda3187f212f93ed758190be540a4bc51d77f53bcd"} Jul 17 13:56:25.777340 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:25.776911 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" event={"ID":"b64b331c-1e50-44df-96e8-3d2419bb0653","Type":"ContainerStarted","Data":"f07d743396ac462943ff0c6c2b483710957c7771652bfc3e9c7a7c6451bb1548"} Jul 17 13:56:25.784589 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:25.784536 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jxlrl" event={"ID":"5d00f939-d019-4401-9be8-43ac747c82c9","Type":"ContainerStarted","Data":"dafd7a8bb35f3b5ef8d127d534088dd60488c4c00855855b79c4d1b9bd3fc39f"} Jul 17 13:56:25.796896 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:25.796219 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-92.ec2.internal" event={"ID":"84dd6aaeace753174afb8903ed9d6bac","Type":"ContainerStarted","Data":"21c44a8993323fdaca4261d89cbec71e84b27e2937bab008553ca38d0c86c83b"} Jul 17 13:56:25.806470 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:25.806441 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrql4" event={"ID":"5dcc5765-36dc-42af-b898-f6f9a73fab0e","Type":"ContainerStarted","Data":"0e1b08bfe30e4c9b4c610ebec43f83a36e734ce923261ec0246737dd5c7e4f45"} Jul 17 13:56:25.811876 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:25.811853 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v68k8" event={"ID":"67792ecb-4c2c-4d9d-ae18-fcc9fe824b46","Type":"ContainerStarted","Data":"774e9541426b15378a9ff1889d6979ff580da03e8df9b7a18b1e73fc7b8613e8"} Jul 17 13:56:25.817854 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:25.817827 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h5vnp" event={"ID":"0f760d5c-f6ca-406b-bc61-b18d9d6182fb","Type":"ContainerStarted","Data":"3f8070c28808bcaa7064360811270b9ebb079f0ec512379bc1ad7940a927c85c"} Jul 17 13:56:26.832490 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:26.832457 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal" event={"ID":"436b0f12b9dfb4db688c0b344b7ab434","Type":"ContainerStarted","Data":"be1e1ae95a92b4e9362c3122bd425419e6edb87fbed39f9231e206c69cac0806"} Jul 17 13:56:26.848543 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:26.848490 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-92.ec2.internal" podStartSLOduration=3.848469446 podStartE2EDuration="3.848469446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:56:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:56:25.811725492 +0000 UTC m=+4.640077869" watchObservedRunningTime="2026-07-17 13:56:26.848469446 +0000 UTC m=+5.676821794" Jul 17 13:56:27.190850 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:27.190765 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a493036-14a3-45e6-b0ac-db183e813fc8-original-pull-secret\") pod \"global-pull-secret-syncer-zjn62\" (UID: \"6a493036-14a3-45e6-b0ac-db183e813fc8\") " pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:56:27.191003 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:27.190850 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbf9af62-a8f3-4f20-829d-6b23e69b412e-metrics-certs\") pod \"network-metrics-daemon-kbq75\" (UID: \"cbf9af62-a8f3-4f20-829d-6b23e69b412e\") " pod="openshift-multus/network-metrics-daemon-kbq75" Jul 17 13:56:27.191003 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:27.190994 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:27.191107 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:27.191036 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:27.191107 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:27.191064 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbf9af62-a8f3-4f20-829d-6b23e69b412e-metrics-certs podName:cbf9af62-a8f3-4f20-829d-6b23e69b412e nodeName:}" failed. No retries permitted until 2026-07-17 13:56:31.191046165 +0000 UTC m=+10.019398489 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cbf9af62-a8f3-4f20-829d-6b23e69b412e-metrics-certs") pod "network-metrics-daemon-kbq75" (UID: "cbf9af62-a8f3-4f20-829d-6b23e69b412e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:27.191107 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:27.191107 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a493036-14a3-45e6-b0ac-db183e813fc8-original-pull-secret podName:6a493036-14a3-45e6-b0ac-db183e813fc8 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:31.191096693 +0000 UTC m=+10.019449023 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a493036-14a3-45e6-b0ac-db183e813fc8-original-pull-secret") pod "global-pull-secret-syncer-zjn62" (UID: "6a493036-14a3-45e6-b0ac-db183e813fc8") : object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:27.392481 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:27.392442 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zss5k\" (UniqueName: \"kubernetes.io/projected/cd745e32-d2eb-4680-b42d-65a7410a8669-kube-api-access-zss5k\") pod \"network-check-target-g6tlt\" (UID: \"cd745e32-d2eb-4680-b42d-65a7410a8669\") " pod="openshift-network-diagnostics/network-check-target-g6tlt" Jul 17 13:56:27.392707 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:27.392688 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 13:56:27.392803 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:27.392717 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 13:56:27.392803 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:27.392729 2565 projected.go:196] Error preparing data for projected volume kube-api-access-zss5k for pod openshift-network-diagnostics/network-check-target-g6tlt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:27.392907 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:27.392821 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd745e32-d2eb-4680-b42d-65a7410a8669-kube-api-access-zss5k podName:cd745e32-d2eb-4680-b42d-65a7410a8669 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:31.392802241 +0000 UTC m=+10.221154579 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zss5k" (UniqueName: "kubernetes.io/projected/cd745e32-d2eb-4680-b42d-65a7410a8669-kube-api-access-zss5k") pod "network-check-target-g6tlt" (UID: "cd745e32-d2eb-4680-b42d-65a7410a8669") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:27.694731 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:27.694699 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbq75" Jul 17 13:56:27.694905 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:27.694834 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbq75" podUID="cbf9af62-a8f3-4f20-829d-6b23e69b412e" Jul 17 13:56:27.695257 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:27.695236 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6tlt" Jul 17 13:56:27.695374 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:27.695326 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6tlt" podUID="cd745e32-d2eb-4680-b42d-65a7410a8669" Jul 17 13:56:27.695439 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:27.695381 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:56:27.695491 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:27.695469 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjn62" podUID="6a493036-14a3-45e6-b0ac-db183e813fc8" Jul 17 13:56:29.692290 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:29.692259 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:56:29.692699 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:29.692392 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjn62" podUID="6a493036-14a3-45e6-b0ac-db183e813fc8" Jul 17 13:56:29.692749 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:29.692716 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbq75" Jul 17 13:56:29.692813 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:29.692795 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbq75" podUID="cbf9af62-a8f3-4f20-829d-6b23e69b412e" Jul 17 13:56:29.693992 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:29.693971 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6tlt" Jul 17 13:56:29.694101 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:29.694050 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6tlt" podUID="cd745e32-d2eb-4680-b42d-65a7410a8669" Jul 17 13:56:31.222892 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:31.222851 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbf9af62-a8f3-4f20-829d-6b23e69b412e-metrics-certs\") pod \"network-metrics-daemon-kbq75\" (UID: \"cbf9af62-a8f3-4f20-829d-6b23e69b412e\") " pod="openshift-multus/network-metrics-daemon-kbq75" Jul 17 13:56:31.223278 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:31.222931 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a493036-14a3-45e6-b0ac-db183e813fc8-original-pull-secret\") pod \"global-pull-secret-syncer-zjn62\" (UID: \"6a493036-14a3-45e6-b0ac-db183e813fc8\") " pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:56:31.223278 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:31.223055 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:31.223278 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:31.223112 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a493036-14a3-45e6-b0ac-db183e813fc8-original-pull-secret podName:6a493036-14a3-45e6-b0ac-db183e813fc8 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:39.223094861 +0000 UTC m=+18.051447188 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a493036-14a3-45e6-b0ac-db183e813fc8-original-pull-secret") pod "global-pull-secret-syncer-zjn62" (UID: "6a493036-14a3-45e6-b0ac-db183e813fc8") : object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:31.223532 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:31.223513 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:31.223576 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:31.223566 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbf9af62-a8f3-4f20-829d-6b23e69b412e-metrics-certs podName:cbf9af62-a8f3-4f20-829d-6b23e69b412e nodeName:}" failed. No retries permitted until 2026-07-17 13:56:39.223551103 +0000 UTC m=+18.051903431 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cbf9af62-a8f3-4f20-829d-6b23e69b412e-metrics-certs") pod "network-metrics-daemon-kbq75" (UID: "cbf9af62-a8f3-4f20-829d-6b23e69b412e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:31.424982 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:31.424946 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zss5k\" (UniqueName: \"kubernetes.io/projected/cd745e32-d2eb-4680-b42d-65a7410a8669-kube-api-access-zss5k\") pod \"network-check-target-g6tlt\" (UID: \"cd745e32-d2eb-4680-b42d-65a7410a8669\") " pod="openshift-network-diagnostics/network-check-target-g6tlt" Jul 17 13:56:31.425159 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:31.425108 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 13:56:31.425159 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:31.425138 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 13:56:31.425308 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:31.425164 2565 projected.go:196] Error preparing data for projected volume kube-api-access-zss5k for pod openshift-network-diagnostics/network-check-target-g6tlt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:31.425308 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:31.425243 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd745e32-d2eb-4680-b42d-65a7410a8669-kube-api-access-zss5k podName:cd745e32-d2eb-4680-b42d-65a7410a8669 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:39.425221092 +0000 UTC m=+18.253573439 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zss5k" (UniqueName: "kubernetes.io/projected/cd745e32-d2eb-4680-b42d-65a7410a8669-kube-api-access-zss5k") pod "network-check-target-g6tlt" (UID: "cd745e32-d2eb-4680-b42d-65a7410a8669") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:31.692579 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:31.692538 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6tlt" Jul 17 13:56:31.692732 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:31.692652 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6tlt" podUID="cd745e32-d2eb-4680-b42d-65a7410a8669" Jul 17 13:56:31.693016 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:31.692923 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:56:31.693891 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:31.693855 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjn62" podUID="6a493036-14a3-45e6-b0ac-db183e813fc8" Jul 17 13:56:31.694004 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:31.693939 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbq75" Jul 17 13:56:31.694115 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:31.694077 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbq75" podUID="cbf9af62-a8f3-4f20-829d-6b23e69b412e" Jul 17 13:56:33.692058 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:33.692024 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6tlt" Jul 17 13:56:33.692514 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:33.692196 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6tlt" podUID="cd745e32-d2eb-4680-b42d-65a7410a8669" Jul 17 13:56:33.692604 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:33.692577 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:56:33.692729 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:33.692676 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjn62" podUID="6a493036-14a3-45e6-b0ac-db183e813fc8" Jul 17 13:56:33.692777 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:33.692737 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbq75" Jul 17 13:56:33.692837 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:33.692817 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbq75" podUID="cbf9af62-a8f3-4f20-829d-6b23e69b412e" Jul 17 13:56:35.694401 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:35.694374 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbq75" Jul 17 13:56:35.694782 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:35.694374 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:56:35.694782 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:35.694482 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbq75" podUID="cbf9af62-a8f3-4f20-829d-6b23e69b412e" Jul 17 13:56:35.694782 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:35.694578 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjn62" podUID="6a493036-14a3-45e6-b0ac-db183e813fc8" Jul 17 13:56:35.694782 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:35.694377 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6tlt" Jul 17 13:56:35.694782 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:35.694693 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6tlt" podUID="cd745e32-d2eb-4680-b42d-65a7410a8669" Jul 17 13:56:37.692126 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:37.692094 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6tlt" Jul 17 13:56:37.692582 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:37.692095 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:56:37.692582 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:37.692107 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbq75" Jul 17 13:56:37.692582 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:37.692239 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6tlt" podUID="cd745e32-d2eb-4680-b42d-65a7410a8669" Jul 17 13:56:37.692582 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:37.692316 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjn62" podUID="6a493036-14a3-45e6-b0ac-db183e813fc8" Jul 17 13:56:37.692582 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:37.692381 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbq75" podUID="cbf9af62-a8f3-4f20-829d-6b23e69b412e" Jul 17 13:56:39.281930 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:39.281893 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a493036-14a3-45e6-b0ac-db183e813fc8-original-pull-secret\") pod \"global-pull-secret-syncer-zjn62\" (UID: \"6a493036-14a3-45e6-b0ac-db183e813fc8\") " pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:56:39.282356 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:39.281956 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbf9af62-a8f3-4f20-829d-6b23e69b412e-metrics-certs\") pod \"network-metrics-daemon-kbq75\" (UID: \"cbf9af62-a8f3-4f20-829d-6b23e69b412e\") " pod="openshift-multus/network-metrics-daemon-kbq75" Jul 17 13:56:39.282356 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:39.282077 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:39.282356 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:39.282079 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:39.282356 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:39.282142 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbf9af62-a8f3-4f20-829d-6b23e69b412e-metrics-certs podName:cbf9af62-a8f3-4f20-829d-6b23e69b412e nodeName:}" failed. No retries permitted until 2026-07-17 13:56:55.282121795 +0000 UTC m=+34.110474127 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cbf9af62-a8f3-4f20-829d-6b23e69b412e-metrics-certs") pod "network-metrics-daemon-kbq75" (UID: "cbf9af62-a8f3-4f20-829d-6b23e69b412e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:39.282356 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:39.282155 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a493036-14a3-45e6-b0ac-db183e813fc8-original-pull-secret podName:6a493036-14a3-45e6-b0ac-db183e813fc8 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:55.282149543 +0000 UTC m=+34.110501867 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a493036-14a3-45e6-b0ac-db183e813fc8-original-pull-secret") pod "global-pull-secret-syncer-zjn62" (UID: "6a493036-14a3-45e6-b0ac-db183e813fc8") : object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:39.484258 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:39.484226 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zss5k\" (UniqueName: \"kubernetes.io/projected/cd745e32-d2eb-4680-b42d-65a7410a8669-kube-api-access-zss5k\") pod \"network-check-target-g6tlt\" (UID: \"cd745e32-d2eb-4680-b42d-65a7410a8669\") " pod="openshift-network-diagnostics/network-check-target-g6tlt" Jul 17 13:56:39.484427 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:39.484412 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 13:56:39.484494 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:39.484435 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 13:56:39.484494 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:39.484445 2565 projected.go:196] Error preparing data for projected volume kube-api-access-zss5k for pod openshift-network-diagnostics/network-check-target-g6tlt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:39.484590 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:39.484507 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd745e32-d2eb-4680-b42d-65a7410a8669-kube-api-access-zss5k podName:cd745e32-d2eb-4680-b42d-65a7410a8669 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:55.484488256 +0000 UTC m=+34.312840580 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zss5k" (UniqueName: "kubernetes.io/projected/cd745e32-d2eb-4680-b42d-65a7410a8669-kube-api-access-zss5k") pod "network-check-target-g6tlt" (UID: "cd745e32-d2eb-4680-b42d-65a7410a8669") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:39.691356 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:39.691279 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbq75" Jul 17 13:56:39.691505 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:39.691291 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:56:39.691505 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:39.691403 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbq75" podUID="cbf9af62-a8f3-4f20-829d-6b23e69b412e" Jul 17 13:56:39.691505 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:39.691291 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6tlt" Jul 17 13:56:39.691505 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:39.691488 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjn62" podUID="6a493036-14a3-45e6-b0ac-db183e813fc8" Jul 17 13:56:39.691675 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:39.691552 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6tlt" podUID="cd745e32-d2eb-4680-b42d-65a7410a8669" Jul 17 13:56:41.693141 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:41.693068 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:56:41.693141 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:41.693139 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbq75" Jul 17 13:56:41.693654 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:41.693255 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6tlt" Jul 17 13:56:41.693654 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:41.693295 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjn62" podUID="6a493036-14a3-45e6-b0ac-db183e813fc8" Jul 17 13:56:41.693654 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:41.693332 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6tlt" podUID="cd745e32-d2eb-4680-b42d-65a7410a8669" Jul 17 13:56:41.693654 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:41.693421 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbq75" podUID="cbf9af62-a8f3-4f20-829d-6b23e69b412e" Jul 17 13:56:43.692371 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:43.691171 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:56:43.692371 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:43.691546 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjn62" podUID="6a493036-14a3-45e6-b0ac-db183e813fc8" Jul 17 13:56:43.692371 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:43.691251 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbq75" Jul 17 13:56:43.692371 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:43.691655 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbq75" podUID="cbf9af62-a8f3-4f20-829d-6b23e69b412e" Jul 17 13:56:43.692371 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:43.691169 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6tlt" Jul 17 13:56:43.692371 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:43.691728 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6tlt" podUID="cd745e32-d2eb-4680-b42d-65a7410a8669" Jul 17 13:56:43.870206 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:43.870000 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrql4" event={"ID":"5dcc5765-36dc-42af-b898-f6f9a73fab0e","Type":"ContainerStarted","Data":"b91fe73c2b26e52a5e90c898f6e643c14cac46d5b02e34bdf2c47ed8b5c18a75"} Jul 17 13:56:43.874612 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:43.874566 2565 generic.go:356] "Generic (PLEG): container finished" podID="67792ecb-4c2c-4d9d-ae18-fcc9fe824b46" containerID="bc30094488c8e45c8475bcabafc03d1b1144ccc622bf770caf51463154cb2dea" exitCode=0 Jul 17 13:56:43.874703 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:43.874644 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v68k8" event={"ID":"67792ecb-4c2c-4d9d-ae18-fcc9fe824b46","Type":"ContainerDied","Data":"bc30094488c8e45c8475bcabafc03d1b1144ccc622bf770caf51463154cb2dea"} Jul 17 13:56:43.876692 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:43.876662 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h5vnp" event={"ID":"0f760d5c-f6ca-406b-bc61-b18d9d6182fb","Type":"ContainerStarted","Data":"a18aebb71c14ea4bd462fcd40c782270bc28096ff6ffc1ee3f6202aeb8ae621d"} Jul 17 13:56:43.879800 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:43.879774 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" event={"ID":"47d4c929-8979-422d-a56e-c339542aa947","Type":"ContainerStarted","Data":"edf0462c0527edc27e30708742d7f9918ca48c08f23d97349df0e86069c268a1"} Jul 17 13:56:43.879936 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:43.879854 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" event={"ID":"47d4c929-8979-422d-a56e-c339542aa947","Type":"ContainerStarted","Data":"49e2a2658c7c22aaa53333d8aa20bb5638f73fceee34e2e5c3194ed2b7b70e3b"} Jul 17 13:56:43.879936 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:43.879904 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" event={"ID":"47d4c929-8979-422d-a56e-c339542aa947","Type":"ContainerStarted","Data":"8161b2dbfe531059288fc504034002aa5649530c170f4faee0af809e02525981"} Jul 17 13:56:43.880165 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:43.879950 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" event={"ID":"47d4c929-8979-422d-a56e-c339542aa947","Type":"ContainerStarted","Data":"22c0107385f842a58ebd2de27b286961170d8d17e218c38923800e461e911653"} Jul 17 13:56:43.881512 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:43.881490 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6lmcm" event={"ID":"daa5b207-dac5-4e52-90a4-e144871e2db1","Type":"ContainerStarted","Data":"a157f275b32477ec5068db4587c7490eba80725362210a2c8ceb75598af1cedd"} Jul 17 13:56:43.884172 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:43.884150 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7vl2s" event={"ID":"a89f466c-3e1d-436f-a747-eb674d94e1ad","Type":"ContainerStarted","Data":"d5326d69f3756b63cdfd7e53ccf9a8f04e4cfb664d3535ba6c078ee704f0c9df"} Jul 17 13:56:43.885910 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:43.885889 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" event={"ID":"b64b331c-1e50-44df-96e8-3d2419bb0653","Type":"ContainerStarted","Data":"26f94b46250a5e4319ed840540a392f1831a1491741add4f64f60381fcc5e685"} Jul 17 13:56:43.887372 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:43.887351 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jxlrl" event={"ID":"5d00f939-d019-4401-9be8-43ac747c82c9","Type":"ContainerStarted","Data":"e46c84b98afecdc6f1f70468907ecebb0d47d2f6e960945089049309fd0387e6"} Jul 17 13:56:43.895242 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:43.895196 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-92.ec2.internal" podStartSLOduration=20.895163461 podStartE2EDuration="20.895163461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:56:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:56:26.849166093 +0000 UTC m=+5.677518444" watchObservedRunningTime="2026-07-17 13:56:43.895163461 +0000 UTC m=+22.723515805" Jul 17 13:56:43.907726 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:43.907695 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6lmcm" podStartSLOduration=3.195999449 podStartE2EDuration="21.907683336s" totalImagesPullingTime="18.711683887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:56:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:56:43.907496103 +0000 UTC m=+22.735848451" watchObservedRunningTime="2026-07-17 13:56:43.907683336 +0000 UTC m=+22.736035681" Jul 17 13:56:43.922938 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:43.922892 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-h5vnp" podStartSLOduration=12.458757378 podStartE2EDuration="22.922874839s" totalImagesPullingTime="10.464117461s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:56:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:56:43.922297594 +0000 UTC m=+22.750649939" watchObservedRunningTime="2026-07-17 13:56:43.922874839 +0000 UTC m=+22.751227188" Jul 17 13:56:43.954990 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:43.954954 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2ptt4" podStartSLOduration=3.235594169 podStartE2EDuration="21.954941957s" totalImagesPullingTime="18.719347788s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:56:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:56:43.938932117 +0000 UTC m=+22.767284462" watchObservedRunningTime="2026-07-17 13:56:43.954941957 +0000 UTC m=+22.783294303" Jul 17 13:56:43.955099 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:43.955077 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7vl2s" podStartSLOduration=3.240343216 podStartE2EDuration="21.955069272s" totalImagesPullingTime="18.714726056s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:56:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:56:43.954995062 +0000 UTC m=+22.783347407" watchObservedRunningTime="2026-07-17 13:56:43.955069272 +0000 UTC m=+22.783421631" Jul 17 13:56:43.985666 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:43.985621 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jxlrl" podStartSLOduration=3.235290728 podStartE2EDuration="21.985607611s" totalImagesPullingTime="18.750316883s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:56:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:56:43.984942093 +0000 UTC m=+22.813294439" watchObservedRunningTime="2026-07-17 13:56:43.985607611 +0000 UTC m=+22.813959956" Jul 17 13:56:44.743108 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:44.743079 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 17 13:56:44.892223 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:44.892155 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrql4" event={"ID":"5dcc5765-36dc-42af-b898-f6f9a73fab0e","Type":"ContainerStarted","Data":"31ce113aca0b697a5ea31e9d812672111f1729e4c6c8b8d3d460327b6e6f95d8"} Jul 17 13:56:44.895602 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:44.895575 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" event={"ID":"47d4c929-8979-422d-a56e-c339542aa947","Type":"ContainerStarted","Data":"956ddf0d88daf45f8f8bf15636bbd57227a918b1d406df614652eedb48cf9138"} Jul 17 13:56:44.895728 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:44.895653 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" event={"ID":"47d4c929-8979-422d-a56e-c339542aa947","Type":"ContainerStarted","Data":"e0e50669a21cc9f836881740e16d0b68013d24b8d9764575f3c790f7162e4629"} Jul 17 13:56:45.604760 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:45.604663 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T13:56:44.743099826Z","UUID":"84e74a14-07be-496f-a9f3-35a83d8fd287","Handler":null,"Name":"","Endpoint":""} Jul 17 13:56:45.606279 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:45.606257 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 17 13:56:45.606391 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:45.606305 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 17 13:56:45.692212 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:45.692168 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbq75" Jul 17 13:56:45.692381 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:45.692317 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbq75" podUID="cbf9af62-a8f3-4f20-829d-6b23e69b412e" Jul 17 13:56:45.692672 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:45.692652 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6tlt" Jul 17 13:56:45.692773 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:45.692743 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6tlt" podUID="cd745e32-d2eb-4680-b42d-65a7410a8669" Jul 17 13:56:45.692861 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:45.692840 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:56:45.692943 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:45.692928 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjn62" podUID="6a493036-14a3-45e6-b0ac-db183e813fc8" Jul 17 13:56:45.900060 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:45.899983 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrql4" event={"ID":"5dcc5765-36dc-42af-b898-f6f9a73fab0e","Type":"ContainerStarted","Data":"ac2c002fb238f242937ee596aa1b3b48bb19d394b715e5c0a3a0ec06590c5d87"} Jul 17 13:56:45.901577 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:45.901550 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7x4qw" event={"ID":"02fc3761-d97b-4f88-8b93-e3f3831728d8","Type":"ContainerStarted","Data":"1677813e4666f87e1e64850f29535099e6849b0368d3be714bbdc5e3eb64388b"} Jul 17 13:56:45.917014 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:45.916973 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xrql4" podStartSLOduration=3.280092373 podStartE2EDuration="23.916960414s" totalImagesPullingTime="20.636868041s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:56:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:56:45.916412591 +0000 UTC m=+24.744764938" watchObservedRunningTime="2026-07-17 13:56:45.916960414 +0000 UTC m=+24.745312760" Jul 17 13:56:45.935668 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:45.935616 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7x4qw" podStartSLOduration=6.226002368 podStartE2EDuration="24.93559923s" totalImagesPullingTime="18.709596862s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:56:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:56:45.935028807 +0000 UTC m=+24.763381152" watchObservedRunningTime="2026-07-17 13:56:45.93559923 +0000 UTC m=+24.763951577" Jul 17 13:56:46.907438 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:46.907401 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" event={"ID":"47d4c929-8979-422d-a56e-c339542aa947","Type":"ContainerStarted","Data":"37f11997cc7a8a22385da86be6c679936a957b8eb55852200c607dd518c4de9f"} Jul 17 13:56:47.692163 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:47.691985 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbq75" Jul 17 13:56:47.692338 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:47.691985 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6tlt" Jul 17 13:56:47.692338 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:47.691989 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:56:47.692338 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:47.692300 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbq75" podUID="cbf9af62-a8f3-4f20-829d-6b23e69b412e" Jul 17 13:56:47.692496 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:47.692410 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjn62" podUID="6a493036-14a3-45e6-b0ac-db183e813fc8" Jul 17 13:56:47.692555 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:47.692502 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6tlt" podUID="cd745e32-d2eb-4680-b42d-65a7410a8669" Jul 17 13:56:48.458675 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:48.458245 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6lmcm" Jul 17 13:56:48.459090 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:48.458781 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6lmcm" Jul 17 13:56:48.911589 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:48.911568 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6lmcm" Jul 17 13:56:48.912095 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:48.912078 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6lmcm" Jul 17 13:56:49.691573 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:49.691399 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:56:49.692245 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:49.691399 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6tlt" Jul 17 13:56:49.692245 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:49.691654 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjn62" podUID="6a493036-14a3-45e6-b0ac-db183e813fc8" Jul 17 13:56:49.692245 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:49.691749 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6tlt" podUID="cd745e32-d2eb-4680-b42d-65a7410a8669" Jul 17 13:56:49.692245 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:49.691414 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbq75" Jul 17 13:56:49.692245 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:49.691865 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbq75" podUID="cbf9af62-a8f3-4f20-829d-6b23e69b412e" Jul 17 13:56:49.914815 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:49.914781 2565 generic.go:356] "Generic (PLEG): container finished" podID="67792ecb-4c2c-4d9d-ae18-fcc9fe824b46" containerID="606b1c5f38c5616b9a01ba222f8d6aba163845b1dd4c3ab9fd330828095147c1" exitCode=0 Jul 17 13:56:49.914983 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:49.914872 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v68k8" event={"ID":"67792ecb-4c2c-4d9d-ae18-fcc9fe824b46","Type":"ContainerDied","Data":"606b1c5f38c5616b9a01ba222f8d6aba163845b1dd4c3ab9fd330828095147c1"} Jul 17 13:56:49.918673 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:49.918650 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" event={"ID":"47d4c929-8979-422d-a56e-c339542aa947","Type":"ContainerStarted","Data":"2506d9450b42c157e019c20a6e826eddfe90ad279a0a881a20e56f05bde6ff83"} Jul 17 13:56:49.918980 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:49.918943 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:49.919070 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:49.919056 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:49.934754 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:49.934730 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:49.934895 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:49.934880 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:49.959522 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:49.959485 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" podStartSLOduration=9.173083541 podStartE2EDuration="27.959472803s" totalImagesPullingTime="18.786389262s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:56:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:56:49.958639096 +0000 UTC m=+28.786991439" watchObservedRunningTime="2026-07-17 13:56:49.959472803 +0000 UTC m=+28.787825149" Jul 17 13:56:50.821642 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:50.821595 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:56:51.102147 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:51.102124 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-g6tlt"] Jul 17 13:56:51.102287 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:51.102281 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6tlt" Jul 17 13:56:51.102375 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:51.102357 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6tlt" podUID="cd745e32-d2eb-4680-b42d-65a7410a8669" Jul 17 13:56:51.105165 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:51.105139 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zjn62"] Jul 17 13:56:51.105284 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:51.105267 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:56:51.105387 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:51.105366 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjn62" podUID="6a493036-14a3-45e6-b0ac-db183e813fc8" Jul 17 13:56:51.105824 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:51.105802 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kbq75"] Jul 17 13:56:51.105917 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:51.105904 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbq75" Jul 17 13:56:51.106011 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:51.105996 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbq75" podUID="cbf9af62-a8f3-4f20-829d-6b23e69b412e" Jul 17 13:56:51.924968 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:51.924933 2565 generic.go:356] "Generic (PLEG): container finished" podID="67792ecb-4c2c-4d9d-ae18-fcc9fe824b46" containerID="17b356bf085eac794333d6a9f1a7a057bffa25b7d1fcc1e82730e8f9fa3ef6b6" exitCode=0 Jul 17 13:56:51.925324 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:51.925020 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v68k8" event={"ID":"67792ecb-4c2c-4d9d-ae18-fcc9fe824b46","Type":"ContainerDied","Data":"17b356bf085eac794333d6a9f1a7a057bffa25b7d1fcc1e82730e8f9fa3ef6b6"} Jul 17 13:56:52.691794 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:52.691769 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:56:52.691926 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:52.691772 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6tlt" Jul 17 13:56:52.691926 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:52.691873 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjn62" podUID="6a493036-14a3-45e6-b0ac-db183e813fc8" Jul 17 13:56:52.691997 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:52.691951 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6tlt" podUID="cd745e32-d2eb-4680-b42d-65a7410a8669" Jul 17 13:56:52.691997 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:52.691772 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbq75" Jul 17 13:56:52.692058 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:52.692039 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbq75" podUID="cbf9af62-a8f3-4f20-829d-6b23e69b412e" Jul 17 13:56:53.931414 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:53.931164 2565 generic.go:356] "Generic (PLEG): container finished" podID="67792ecb-4c2c-4d9d-ae18-fcc9fe824b46" containerID="d3dc138140c8e8db29e6ac5ff3f6dad613bb41834a3662f380d683c3f3d03744" exitCode=0 Jul 17 13:56:53.931799 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:53.931207 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v68k8" event={"ID":"67792ecb-4c2c-4d9d-ae18-fcc9fe824b46","Type":"ContainerDied","Data":"d3dc138140c8e8db29e6ac5ff3f6dad613bb41834a3662f380d683c3f3d03744"} Jul 17 13:56:54.691415 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:54.691338 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbq75" Jul 17 13:56:54.691624 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:54.691338 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:56:54.691624 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:54.691461 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kbq75" podUID="cbf9af62-a8f3-4f20-829d-6b23e69b412e" Jul 17 13:56:54.691624 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:54.691338 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6tlt" Jul 17 13:56:54.691624 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:54.691539 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zjn62" podUID="6a493036-14a3-45e6-b0ac-db183e813fc8" Jul 17 13:56:54.691624 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:54.691584 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-g6tlt" podUID="cd745e32-d2eb-4680-b42d-65a7410a8669" Jul 17 13:56:55.300472 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:55.300443 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a493036-14a3-45e6-b0ac-db183e813fc8-original-pull-secret\") pod \"global-pull-secret-syncer-zjn62\" (UID: \"6a493036-14a3-45e6-b0ac-db183e813fc8\") " pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:56:55.300925 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:55.300484 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbf9af62-a8f3-4f20-829d-6b23e69b412e-metrics-certs\") pod \"network-metrics-daemon-kbq75\" (UID: \"cbf9af62-a8f3-4f20-829d-6b23e69b412e\") " pod="openshift-multus/network-metrics-daemon-kbq75" Jul 17 13:56:55.300925 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:55.300590 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:55.300925 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:55.300591 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:55.300925 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:55.300645 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a493036-14a3-45e6-b0ac-db183e813fc8-original-pull-secret podName:6a493036-14a3-45e6-b0ac-db183e813fc8 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:27.300631453 +0000 UTC m=+66.128983781 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6a493036-14a3-45e6-b0ac-db183e813fc8-original-pull-secret") pod "global-pull-secret-syncer-zjn62" (UID: "6a493036-14a3-45e6-b0ac-db183e813fc8") : object "kube-system"/"original-pull-secret" not registered Jul 17 13:56:55.300925 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:55.300659 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbf9af62-a8f3-4f20-829d-6b23e69b412e-metrics-certs podName:cbf9af62-a8f3-4f20-829d-6b23e69b412e nodeName:}" failed. No retries permitted until 2026-07-17 13:57:27.300652568 +0000 UTC m=+66.129004891 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cbf9af62-a8f3-4f20-829d-6b23e69b412e-metrics-certs") pod "network-metrics-daemon-kbq75" (UID: "cbf9af62-a8f3-4f20-829d-6b23e69b412e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 17 13:56:55.502078 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:55.502049 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zss5k\" (UniqueName: \"kubernetes.io/projected/cd745e32-d2eb-4680-b42d-65a7410a8669-kube-api-access-zss5k\") pod \"network-check-target-g6tlt\" (UID: \"cd745e32-d2eb-4680-b42d-65a7410a8669\") " pod="openshift-network-diagnostics/network-check-target-g6tlt" Jul 17 13:56:55.502313 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:55.502168 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 17 13:56:55.502313 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:55.502201 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 17 13:56:55.502313 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:55.502213 2565 projected.go:196] Error preparing data for projected volume kube-api-access-zss5k for pod openshift-network-diagnostics/network-check-target-g6tlt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:55.502313 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:55.502261 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd745e32-d2eb-4680-b42d-65a7410a8669-kube-api-access-zss5k podName:cd745e32-d2eb-4680-b42d-65a7410a8669 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:27.502248705 +0000 UTC m=+66.330601028 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zss5k" (UniqueName: "kubernetes.io/projected/cd745e32-d2eb-4680-b42d-65a7410a8669-kube-api-access-zss5k") pod "network-check-target-g6tlt" (UID: "cd745e32-d2eb-4680-b42d-65a7410a8669") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 17 13:56:56.510628 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.510603 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-92.ec2.internal" event="NodeReady" Jul 17 13:56:56.510981 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.510720 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 17 13:56:56.553122 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.552203 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-9l9rw"] Jul 17 13:56:56.580172 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.579573 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-phbnw"] Jul 17 13:56:56.580172 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.579695 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-9l9rw" Jul 17 13:56:56.581858 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.581833 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-qqpqm\"" Jul 17 13:56:56.581976 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.581835 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 17 13:56:56.582145 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.582091 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 17 13:56:56.594725 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.594677 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-69588b5c66-jk8qx"] Jul 17 13:56:56.594945 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.594923 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-phbnw" Jul 17 13:56:56.597333 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.597314 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-9l6g9\"" Jul 17 13:56:56.597478 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.597461 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 17 13:56:56.597873 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.597853 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 17 13:56:56.598006 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.597990 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 17 13:56:56.598382 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.598363 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 17 13:56:56.615112 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.615079 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-j9zpm"] Jul 17 13:56:56.615344 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.615319 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:56:56.617399 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.617380 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 17 13:56:56.617500 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.617450 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 17 13:56:56.617746 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.617729 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8dzmb\"" Jul 17 13:56:56.618025 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.618007 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 17 13:56:56.624482 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.624460 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 17 13:56:56.635131 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.635110 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwn9r"] Jul 17 13:56:56.635267 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.635251 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-j9zpm" Jul 17 13:56:56.637248 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.637155 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 17 13:56:56.637248 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.637240 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 17 13:56:56.637628 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.637610 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-vv8bk\"" Jul 17 13:56:56.637706 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.637633 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 17 13:56:56.638165 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.638146 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 17 13:56:56.658623 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.658602 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-j9zpm"] Jul 17 13:56:56.658752 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.658639 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kjqdb"] Jul 17 13:56:56.658752 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.658722 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwn9r" Jul 17 13:56:56.663209 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.661666 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 17 13:56:56.663209 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.661764 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 17 13:56:56.663209 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.661931 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 17 13:56:56.663209 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.662310 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rshch\"" Jul 17 13:56:56.675603 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.675584 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-r6gsw"] Jul 17 13:56:56.675714 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.675700 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kjqdb" Jul 17 13:56:56.677480 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.677460 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 17 13:56:56.677866 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.677848 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 17 13:56:56.678016 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.677974 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 17 13:56:56.678016 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.678012 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rt4d9\"" Jul 17 13:56:56.678164 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.677999 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 17 13:56:56.696897 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.696876 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-76cc77cc44-b58sp"] Jul 17 13:56:56.697011 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.696963 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:56:56.697122 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.696964 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbq75" Jul 17 13:56:56.697122 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.697088 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-r6gsw" Jul 17 13:56:56.697344 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.697329 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6tlt" Jul 17 13:56:56.698747 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.698732 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 17 13:56:56.698836 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.698772 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 17 13:56:56.698896 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.698865 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ctrdf\"" Jul 17 13:56:56.699065 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.699041 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 17 13:56:56.699065 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.699049 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 17 13:56:56.699340 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.699324 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 17 13:56:56.699611 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.699465 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 17 13:56:56.699611 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.699475 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 17 13:56:56.700074 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.700057 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-f9n4f\"" Jul 17 13:56:56.700074 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.700069 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 17 13:56:56.700230 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.700073 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hnkr8\"" Jul 17 13:56:56.705832 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.705805 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 17 13:56:56.710170 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.710012 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/abc092dc-0b98-4726-a513-94b21f1a0b26-trusted-ca\") pod \"image-registry-69588b5c66-jk8qx\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:56:56.710170 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.710050 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/45230f7f-2bb9-4737-adf5-e47da33d503c-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-phbnw\" (UID: \"45230f7f-2bb9-4737-adf5-e47da33d503c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-phbnw" Jul 17 13:56:56.710170 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.710088 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf4xd\" (UniqueName: \"kubernetes.io/projected/45230f7f-2bb9-4737-adf5-e47da33d503c-kube-api-access-nf4xd\") pod \"kube-storage-version-migrator-operator-7658d9b749-phbnw\" (UID: \"45230f7f-2bb9-4737-adf5-e47da33d503c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-phbnw" Jul 17 13:56:56.710170 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.710130 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/38ccf43f-fbcf-41d3-a0b2-2ba57dd0a94a-config\") pod \"service-ca-operator-5bcbc94c78-j9zpm\" (UID: \"38ccf43f-fbcf-41d3-a0b2-2ba57dd0a94a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-j9zpm" Jul 17 13:56:56.710170 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.710146 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-registry-tls\") pod \"image-registry-69588b5c66-jk8qx\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:56:56.710401 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.710234 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/abc092dc-0b98-4726-a513-94b21f1a0b26-registry-certificates\") pod \"image-registry-69588b5c66-jk8qx\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:56:56.710401 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.710321 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxnrv\" (UniqueName: \"kubernetes.io/projected/10b00003-e1e9-41fb-8218-479d03a2c5a9-kube-api-access-sxnrv\") pod \"volume-data-source-validator-78cf4c6f6-9l9rw\" (UID: \"10b00003-e1e9-41fb-8218-479d03a2c5a9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-9l9rw" Jul 17 13:56:56.710401 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.710363 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/abc092dc-0b98-4726-a513-94b21f1a0b26-image-registry-private-configuration\") pod \"image-registry-69588b5c66-jk8qx\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:56:56.710401 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.710397 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnf4j\" (UniqueName: \"kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-kube-api-access-jnf4j\") pod \"image-registry-69588b5c66-jk8qx\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:56:56.710590 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.710424 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/45230f7f-2bb9-4737-adf5-e47da33d503c-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-phbnw\" (UID: \"45230f7f-2bb9-4737-adf5-e47da33d503c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-phbnw" Jul 17 13:56:56.710590 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.710463 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsmnw\" (UniqueName: \"kubernetes.io/projected/38ccf43f-fbcf-41d3-a0b2-2ba57dd0a94a-kube-api-access-fsmnw\") pod \"service-ca-operator-5bcbc94c78-j9zpm\" (UID: \"38ccf43f-fbcf-41d3-a0b2-2ba57dd0a94a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-j9zpm" Jul 17 13:56:56.710590 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.710479 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/abc092dc-0b98-4726-a513-94b21f1a0b26-installation-pull-secrets\") pod \"image-registry-69588b5c66-jk8qx\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:56:56.710590 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.710512 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/38ccf43f-fbcf-41d3-a0b2-2ba57dd0a94a-serving-cert\") pod \"service-ca-operator-5bcbc94c78-j9zpm\" (UID: \"38ccf43f-fbcf-41d3-a0b2-2ba57dd0a94a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-j9zpm" Jul 17 13:56:56.710590 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.710530 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/abc092dc-0b98-4726-a513-94b21f1a0b26-ca-trust-extracted\") pod \"image-registry-69588b5c66-jk8qx\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:56:56.710590 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.710551 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-bound-sa-token\") pod \"image-registry-69588b5c66-jk8qx\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:56:56.721040 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.721022 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-9l9rw"] Jul 17 13:56:56.721124 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.721050 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69588b5c66-jk8qx"] Jul 17 13:56:56.721124 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.721068 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-r6gsw"] Jul 17 13:56:56.721124 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.721084 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kjqdb"] Jul 17 13:56:56.721124 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.721097 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwn9r"] Jul 17 13:56:56.721124 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.721115 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qhjd8"] Jul 17 13:56:56.721369 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.721203 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-76cc77cc44-b58sp" Jul 17 13:56:56.723698 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.723681 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 17 13:56:56.723698 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.723702 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 17 13:56:56.723876 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.723737 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 17 13:56:56.723876 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.723864 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8sdnt\"" Jul 17 13:56:56.724049 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.724033 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 17 13:56:56.724110 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.724061 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 17 13:56:56.724165 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.724107 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 17 13:56:56.742425 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.742410 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-47dp7"] Jul 17 13:56:56.742550 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.742535 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qhjd8" Jul 17 13:56:56.744944 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.744924 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 17 13:56:56.745369 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.745350 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 17 13:56:56.745984 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.745958 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zf4sj\"" Jul 17 13:56:56.760517 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.760498 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-86jkr"] Jul 17 13:56:56.760709 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.760654 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-47dp7" Jul 17 13:56:56.763193 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.763156 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 17 13:56:56.763286 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.763225 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fn6fd\"" Jul 17 13:56:56.763286 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.763233 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 17 13:56:56.763381 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.763225 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 17 13:56:56.784879 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.784855 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-mclw4"] Jul 17 13:56:56.784985 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.784904 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-86jkr" Jul 17 13:56:56.789119 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.789096 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 17 13:56:56.789230 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.789105 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 17 13:56:56.789355 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.789327 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 17 13:56:56.789447 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.789425 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-m7klq\"" Jul 17 13:56:56.789838 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.789820 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 17 13:56:56.797925 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.797904 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 17 13:56:56.810937 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.810918 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-76cc77cc44-b58sp"] Jul 17 13:56:56.811054 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.810954 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-phbnw"] Jul 17 13:56:56.811054 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.810975 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-47dp7"] Jul 17 13:56:56.811054 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.810977 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/313552d6-2c32-4553-98fc-2a5f01d7722c-service-ca-bundle\") pod \"insights-operator-555d9d7885-r6gsw\" (UID: \"313552d6-2c32-4553-98fc-2a5f01d7722c\") " pod="openshift-insights/insights-operator-555d9d7885-r6gsw" Jul 17 13:56:56.811054 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.810992 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-mclw4"] Jul 17 13:56:56.811054 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.811014 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-86jkr"] Jul 17 13:56:56.811054 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.811011 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/82857eb2-5266-41f0-a333-56f15ab82e28-stats-auth\") pod \"router-default-76cc77cc44-b58sp\" (UID: \"82857eb2-5266-41f0-a333-56f15ab82e28\") " pod="openshift-ingress/router-default-76cc77cc44-b58sp" Jul 17 13:56:56.811054 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.811031 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qhjd8"] Jul 17 13:56:56.811442 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.811062 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txmg5\" (UniqueName: \"kubernetes.io/projected/9c528470-2f64-4de3-918a-9e510c262890-kube-api-access-txmg5\") pod \"dns-default-qhjd8\" (UID: \"9c528470-2f64-4de3-918a-9e510c262890\") " pod="openshift-dns/dns-default-qhjd8" Jul 17 13:56:56.811442 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.811090 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-bound-sa-token\") pod \"image-registry-69588b5c66-jk8qx\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:56:56.811442 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.811115 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/82857eb2-5266-41f0-a333-56f15ab82e28-default-certificate\") pod \"router-default-76cc77cc44-b58sp\" (UID: \"82857eb2-5266-41f0-a333-56f15ab82e28\") " pod="openshift-ingress/router-default-76cc77cc44-b58sp" Jul 17 13:56:56.811442 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.811142 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82857eb2-5266-41f0-a333-56f15ab82e28-service-ca-bundle\") pod \"router-default-76cc77cc44-b58sp\" (UID: \"82857eb2-5266-41f0-a333-56f15ab82e28\") " pod="openshift-ingress/router-default-76cc77cc44-b58sp" Jul 17 13:56:56.811442 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.811169 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9c528470-2f64-4de3-918a-9e510c262890-config-volume\") pod \"dns-default-qhjd8\" (UID: \"9c528470-2f64-4de3-918a-9e510c262890\") " pod="openshift-dns/dns-default-qhjd8" Jul 17 13:56:56.811442 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.811206 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-mclw4" Jul 17 13:56:56.811442 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.811218 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pcl8\" (UniqueName: \"kubernetes.io/projected/34186a54-c1f6-42eb-9348-9836c9885642-kube-api-access-7pcl8\") pod \"cluster-samples-operator-79b7c55f87-nwn9r\" (UID: \"34186a54-c1f6-42eb-9348-9836c9885642\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwn9r" Jul 17 13:56:56.811442 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.811246 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/418f4e52-7ba5-475c-83a7-f23adbfd0f21-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-kjqdb\" (UID: \"418f4e52-7ba5-475c-83a7-f23adbfd0f21\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kjqdb" Jul 17 13:56:56.811442 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.811288 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/abc092dc-0b98-4726-a513-94b21f1a0b26-image-registry-private-configuration\") pod \"image-registry-69588b5c66-jk8qx\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:56:56.811442 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.811313 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnf4j\" (UniqueName: \"kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-kube-api-access-jnf4j\") pod \"image-registry-69588b5c66-jk8qx\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:56:56.811442 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.811341 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/34186a54-c1f6-42eb-9348-9836c9885642-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nwn9r\" (UID: \"34186a54-c1f6-42eb-9348-9836c9885642\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwn9r" Jul 17 13:56:56.811442 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.811368 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/45230f7f-2bb9-4737-adf5-e47da33d503c-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-phbnw\" (UID: \"45230f7f-2bb9-4737-adf5-e47da33d503c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-phbnw" Jul 17 13:56:56.811442 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.811412 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/313552d6-2c32-4553-98fc-2a5f01d7722c-snapshots\") pod \"insights-operator-555d9d7885-r6gsw\" (UID: \"313552d6-2c32-4553-98fc-2a5f01d7722c\") " pod="openshift-insights/insights-operator-555d9d7885-r6gsw" Jul 17 13:56:56.811442 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.811442 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/38ccf43f-fbcf-41d3-a0b2-2ba57dd0a94a-serving-cert\") pod \"service-ca-operator-5bcbc94c78-j9zpm\" (UID: \"38ccf43f-fbcf-41d3-a0b2-2ba57dd0a94a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-j9zpm" Jul 17 13:56:56.812137 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.811466 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/abc092dc-0b98-4726-a513-94b21f1a0b26-ca-trust-extracted\") pod \"image-registry-69588b5c66-jk8qx\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:56:56.812137 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.811500 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsmnw\" (UniqueName: \"kubernetes.io/projected/38ccf43f-fbcf-41d3-a0b2-2ba57dd0a94a-kube-api-access-fsmnw\") pod \"service-ca-operator-5bcbc94c78-j9zpm\" (UID: \"38ccf43f-fbcf-41d3-a0b2-2ba57dd0a94a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-j9zpm" Jul 17 13:56:56.812137 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.811524 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/abc092dc-0b98-4726-a513-94b21f1a0b26-installation-pull-secrets\") pod \"image-registry-69588b5c66-jk8qx\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:56:56.812137 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.811625 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82857eb2-5266-41f0-a333-56f15ab82e28-metrics-certs\") pod \"router-default-76cc77cc44-b58sp\" (UID: \"82857eb2-5266-41f0-a333-56f15ab82e28\") " pod="openshift-ingress/router-default-76cc77cc44-b58sp" Jul 17 13:56:56.812137 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.811975 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/313552d6-2c32-4553-98fc-2a5f01d7722c-tmp\") pod \"insights-operator-555d9d7885-r6gsw\" (UID: \"313552d6-2c32-4553-98fc-2a5f01d7722c\") " pod="openshift-insights/insights-operator-555d9d7885-r6gsw" Jul 17 13:56:56.812137 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.812004 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c528470-2f64-4de3-918a-9e510c262890-metrics-tls\") pod \"dns-default-qhjd8\" (UID: \"9c528470-2f64-4de3-918a-9e510c262890\") " pod="openshift-dns/dns-default-qhjd8" Jul 17 13:56:56.812137 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.812039 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/abc092dc-0b98-4726-a513-94b21f1a0b26-trusted-ca\") pod \"image-registry-69588b5c66-jk8qx\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:56:56.812137 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.812066 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/45230f7f-2bb9-4737-adf5-e47da33d503c-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-phbnw\" (UID: \"45230f7f-2bb9-4737-adf5-e47da33d503c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-phbnw" Jul 17 13:56:56.812137 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.812093 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fckd2\" (UniqueName: \"kubernetes.io/projected/418f4e52-7ba5-475c-83a7-f23adbfd0f21-kube-api-access-fckd2\") pod \"cluster-monitoring-operator-76cf8966f8-kjqdb\" (UID: \"418f4e52-7ba5-475c-83a7-f23adbfd0f21\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kjqdb" Jul 17 13:56:56.812137 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.812129 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf4xd\" (UniqueName: \"kubernetes.io/projected/45230f7f-2bb9-4737-adf5-e47da33d503c-kube-api-access-nf4xd\") pod \"kube-storage-version-migrator-operator-7658d9b749-phbnw\" (UID: \"45230f7f-2bb9-4737-adf5-e47da33d503c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-phbnw" Jul 17 13:56:56.812622 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.812136 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/abc092dc-0b98-4726-a513-94b21f1a0b26-ca-trust-extracted\") pod \"image-registry-69588b5c66-jk8qx\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:56:56.812622 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.812152 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xg55\" (UniqueName: \"kubernetes.io/projected/82857eb2-5266-41f0-a333-56f15ab82e28-kube-api-access-4xg55\") pod \"router-default-76cc77cc44-b58sp\" (UID: \"82857eb2-5266-41f0-a333-56f15ab82e28\") " pod="openshift-ingress/router-default-76cc77cc44-b58sp" Jul 17 13:56:56.812622 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.812198 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s79gx\" (UniqueName: \"kubernetes.io/projected/313552d6-2c32-4553-98fc-2a5f01d7722c-kube-api-access-s79gx\") pod \"insights-operator-555d9d7885-r6gsw\" (UID: \"313552d6-2c32-4553-98fc-2a5f01d7722c\") " pod="openshift-insights/insights-operator-555d9d7885-r6gsw" Jul 17 13:56:56.812622 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.812224 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/418f4e52-7ba5-475c-83a7-f23adbfd0f21-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-kjqdb\" (UID: \"418f4e52-7ba5-475c-83a7-f23adbfd0f21\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kjqdb" Jul 17 13:56:56.812622 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.812269 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/38ccf43f-fbcf-41d3-a0b2-2ba57dd0a94a-config\") pod \"service-ca-operator-5bcbc94c78-j9zpm\" (UID: \"38ccf43f-fbcf-41d3-a0b2-2ba57dd0a94a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-j9zpm" Jul 17 13:56:56.812622 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.812293 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-registry-tls\") pod \"image-registry-69588b5c66-jk8qx\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:56:56.812622 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.812321 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/abc092dc-0b98-4726-a513-94b21f1a0b26-registry-certificates\") pod \"image-registry-69588b5c66-jk8qx\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:56:56.812622 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.812346 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/313552d6-2c32-4553-98fc-2a5f01d7722c-serving-cert\") pod \"insights-operator-555d9d7885-r6gsw\" (UID: \"313552d6-2c32-4553-98fc-2a5f01d7722c\") " pod="openshift-insights/insights-operator-555d9d7885-r6gsw" Jul 17 13:56:56.812622 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.812373 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c528470-2f64-4de3-918a-9e510c262890-tmp-dir\") pod \"dns-default-qhjd8\" (UID: \"9c528470-2f64-4de3-918a-9e510c262890\") " pod="openshift-dns/dns-default-qhjd8" Jul 17 13:56:56.812622 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.812400 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxnrv\" (UniqueName: \"kubernetes.io/projected/10b00003-e1e9-41fb-8218-479d03a2c5a9-kube-api-access-sxnrv\") pod \"volume-data-source-validator-78cf4c6f6-9l9rw\" (UID: \"10b00003-e1e9-41fb-8218-479d03a2c5a9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-9l9rw" Jul 17 13:56:56.812622 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.812424 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/313552d6-2c32-4553-98fc-2a5f01d7722c-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-r6gsw\" (UID: \"313552d6-2c32-4553-98fc-2a5f01d7722c\") " pod="openshift-insights/insights-operator-555d9d7885-r6gsw" Jul 17 13:56:56.814660 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.813725 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/45230f7f-2bb9-4737-adf5-e47da33d503c-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-phbnw\" (UID: \"45230f7f-2bb9-4737-adf5-e47da33d503c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-phbnw" Jul 17 13:56:56.814660 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:56.813907 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 13:56:56.814660 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:56.813926 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69588b5c66-jk8qx: secret "image-registry-tls" not found Jul 17 13:56:56.814660 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:56.813977 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-registry-tls podName:abc092dc-0b98-4726-a513-94b21f1a0b26 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:57.313960927 +0000 UTC m=+36.142313256 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-registry-tls") pod "image-registry-69588b5c66-jk8qx" (UID: "abc092dc-0b98-4726-a513-94b21f1a0b26") : secret "image-registry-tls" not found Jul 17 13:56:56.814660 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.814257 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/38ccf43f-fbcf-41d3-a0b2-2ba57dd0a94a-config\") pod \"service-ca-operator-5bcbc94c78-j9zpm\" (UID: \"38ccf43f-fbcf-41d3-a0b2-2ba57dd0a94a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-j9zpm" Jul 17 13:56:56.814660 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.814331 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/abc092dc-0b98-4726-a513-94b21f1a0b26-trusted-ca\") pod \"image-registry-69588b5c66-jk8qx\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:56:56.814660 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.814623 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/abc092dc-0b98-4726-a513-94b21f1a0b26-registry-certificates\") pod \"image-registry-69588b5c66-jk8qx\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:56:56.814992 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.814701 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-lbtss\"" Jul 17 13:56:56.817413 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.817394 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/38ccf43f-fbcf-41d3-a0b2-2ba57dd0a94a-serving-cert\") pod \"service-ca-operator-5bcbc94c78-j9zpm\" (UID: \"38ccf43f-fbcf-41d3-a0b2-2ba57dd0a94a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-j9zpm" Jul 17 13:56:56.817493 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.817434 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/45230f7f-2bb9-4737-adf5-e47da33d503c-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-phbnw\" (UID: \"45230f7f-2bb9-4737-adf5-e47da33d503c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-phbnw" Jul 17 13:56:56.817696 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.817677 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/abc092dc-0b98-4726-a513-94b21f1a0b26-installation-pull-secrets\") pod \"image-registry-69588b5c66-jk8qx\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:56:56.817728 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.817695 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/abc092dc-0b98-4726-a513-94b21f1a0b26-image-registry-private-configuration\") pod \"image-registry-69588b5c66-jk8qx\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:56:56.820867 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.820847 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-bound-sa-token\") pod \"image-registry-69588b5c66-jk8qx\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:56:56.823884 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.823860 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf4xd\" (UniqueName: \"kubernetes.io/projected/45230f7f-2bb9-4737-adf5-e47da33d503c-kube-api-access-nf4xd\") pod \"kube-storage-version-migrator-operator-7658d9b749-phbnw\" (UID: \"45230f7f-2bb9-4737-adf5-e47da33d503c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-phbnw" Jul 17 13:56:56.823986 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.823945 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsmnw\" (UniqueName: \"kubernetes.io/projected/38ccf43f-fbcf-41d3-a0b2-2ba57dd0a94a-kube-api-access-fsmnw\") pod \"service-ca-operator-5bcbc94c78-j9zpm\" (UID: \"38ccf43f-fbcf-41d3-a0b2-2ba57dd0a94a\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-j9zpm" Jul 17 13:56:56.824426 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.824400 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxnrv\" (UniqueName: \"kubernetes.io/projected/10b00003-e1e9-41fb-8218-479d03a2c5a9-kube-api-access-sxnrv\") pod \"volume-data-source-validator-78cf4c6f6-9l9rw\" (UID: \"10b00003-e1e9-41fb-8218-479d03a2c5a9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-9l9rw" Jul 17 13:56:56.824881 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.824862 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnf4j\" (UniqueName: \"kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-kube-api-access-jnf4j\") pod \"image-registry-69588b5c66-jk8qx\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:56:56.894519 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.894493 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-9l9rw" Jul 17 13:56:56.904680 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.904656 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-phbnw" Jul 17 13:56:56.912971 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.912951 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txmg5\" (UniqueName: \"kubernetes.io/projected/9c528470-2f64-4de3-918a-9e510c262890-kube-api-access-txmg5\") pod \"dns-default-qhjd8\" (UID: \"9c528470-2f64-4de3-918a-9e510c262890\") " pod="openshift-dns/dns-default-qhjd8" Jul 17 13:56:56.913076 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.912980 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c4b20c0f-f85e-488d-aee9-b772cb8738a0-serving-cert\") pod \"console-operator-565b7b569d-86jkr\" (UID: \"c4b20c0f-f85e-488d-aee9-b772cb8738a0\") " pod="openshift-console-operator/console-operator-565b7b569d-86jkr" Jul 17 13:56:56.913076 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.913005 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/82857eb2-5266-41f0-a333-56f15ab82e28-default-certificate\") pod \"router-default-76cc77cc44-b58sp\" (UID: \"82857eb2-5266-41f0-a333-56f15ab82e28\") " pod="openshift-ingress/router-default-76cc77cc44-b58sp" Jul 17 13:56:56.913161 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.913114 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brjpt\" (UniqueName: \"kubernetes.io/projected/c4b20c0f-f85e-488d-aee9-b772cb8738a0-kube-api-access-brjpt\") pod \"console-operator-565b7b569d-86jkr\" (UID: \"c4b20c0f-f85e-488d-aee9-b772cb8738a0\") " pod="openshift-console-operator/console-operator-565b7b569d-86jkr" Jul 17 13:56:56.913161 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.913150 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82857eb2-5266-41f0-a333-56f15ab82e28-service-ca-bundle\") pod \"router-default-76cc77cc44-b58sp\" (UID: \"82857eb2-5266-41f0-a333-56f15ab82e28\") " pod="openshift-ingress/router-default-76cc77cc44-b58sp" Jul 17 13:56:56.913268 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.913171 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9c528470-2f64-4de3-918a-9e510c262890-config-volume\") pod \"dns-default-qhjd8\" (UID: \"9c528470-2f64-4de3-918a-9e510c262890\") " pod="openshift-dns/dns-default-qhjd8" Jul 17 13:56:56.913268 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.913208 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pcl8\" (UniqueName: \"kubernetes.io/projected/34186a54-c1f6-42eb-9348-9836c9885642-kube-api-access-7pcl8\") pod \"cluster-samples-operator-79b7c55f87-nwn9r\" (UID: \"34186a54-c1f6-42eb-9348-9836c9885642\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwn9r" Jul 17 13:56:56.913268 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.913235 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/418f4e52-7ba5-475c-83a7-f23adbfd0f21-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-kjqdb\" (UID: \"418f4e52-7ba5-475c-83a7-f23adbfd0f21\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kjqdb" Jul 17 13:56:56.913412 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.913278 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/34186a54-c1f6-42eb-9348-9836c9885642-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nwn9r\" (UID: \"34186a54-c1f6-42eb-9348-9836c9885642\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwn9r" Jul 17 13:56:56.913412 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.913297 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6a77fbc-7a50-43ba-9c98-3655564837f6-cert\") pod \"ingress-canary-47dp7\" (UID: \"a6a77fbc-7a50-43ba-9c98-3655564837f6\") " pod="openshift-ingress-canary/ingress-canary-47dp7" Jul 17 13:56:56.913412 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.913323 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/313552d6-2c32-4553-98fc-2a5f01d7722c-snapshots\") pod \"insights-operator-555d9d7885-r6gsw\" (UID: \"313552d6-2c32-4553-98fc-2a5f01d7722c\") " pod="openshift-insights/insights-operator-555d9d7885-r6gsw" Jul 17 13:56:56.913412 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.913339 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjbg4\" (UniqueName: \"kubernetes.io/projected/b5f8c02b-c7ab-4e40-9502-0186ac149d3c-kube-api-access-bjbg4\") pod \"network-check-source-7bc5b6bf85-mclw4\" (UID: \"b5f8c02b-c7ab-4e40-9502-0186ac149d3c\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-mclw4" Jul 17 13:56:56.913412 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.913368 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82857eb2-5266-41f0-a333-56f15ab82e28-metrics-certs\") pod \"router-default-76cc77cc44-b58sp\" (UID: \"82857eb2-5266-41f0-a333-56f15ab82e28\") " pod="openshift-ingress/router-default-76cc77cc44-b58sp" Jul 17 13:56:56.913412 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.913396 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/313552d6-2c32-4553-98fc-2a5f01d7722c-tmp\") pod \"insights-operator-555d9d7885-r6gsw\" (UID: \"313552d6-2c32-4553-98fc-2a5f01d7722c\") " pod="openshift-insights/insights-operator-555d9d7885-r6gsw" Jul 17 13:56:56.913687 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.913418 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c528470-2f64-4de3-918a-9e510c262890-metrics-tls\") pod \"dns-default-qhjd8\" (UID: \"9c528470-2f64-4de3-918a-9e510c262890\") " pod="openshift-dns/dns-default-qhjd8" Jul 17 13:56:56.913687 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.913440 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c4b20c0f-f85e-488d-aee9-b772cb8738a0-config\") pod \"console-operator-565b7b569d-86jkr\" (UID: \"c4b20c0f-f85e-488d-aee9-b772cb8738a0\") " pod="openshift-console-operator/console-operator-565b7b569d-86jkr" Jul 17 13:56:56.913687 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.913477 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fckd2\" (UniqueName: \"kubernetes.io/projected/418f4e52-7ba5-475c-83a7-f23adbfd0f21-kube-api-access-fckd2\") pod \"cluster-monitoring-operator-76cf8966f8-kjqdb\" (UID: \"418f4e52-7ba5-475c-83a7-f23adbfd0f21\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kjqdb" Jul 17 13:56:56.913687 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.913498 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfkw6\" (UniqueName: \"kubernetes.io/projected/a6a77fbc-7a50-43ba-9c98-3655564837f6-kube-api-access-dfkw6\") pod \"ingress-canary-47dp7\" (UID: \"a6a77fbc-7a50-43ba-9c98-3655564837f6\") " pod="openshift-ingress-canary/ingress-canary-47dp7" Jul 17 13:56:56.913687 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.913561 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xg55\" (UniqueName: \"kubernetes.io/projected/82857eb2-5266-41f0-a333-56f15ab82e28-kube-api-access-4xg55\") pod \"router-default-76cc77cc44-b58sp\" (UID: \"82857eb2-5266-41f0-a333-56f15ab82e28\") " pod="openshift-ingress/router-default-76cc77cc44-b58sp" Jul 17 13:56:56.913687 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.913676 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s79gx\" (UniqueName: \"kubernetes.io/projected/313552d6-2c32-4553-98fc-2a5f01d7722c-kube-api-access-s79gx\") pod \"insights-operator-555d9d7885-r6gsw\" (UID: \"313552d6-2c32-4553-98fc-2a5f01d7722c\") " pod="openshift-insights/insights-operator-555d9d7885-r6gsw" Jul 17 13:56:56.914009 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.913708 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/418f4e52-7ba5-475c-83a7-f23adbfd0f21-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-kjqdb\" (UID: \"418f4e52-7ba5-475c-83a7-f23adbfd0f21\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kjqdb" Jul 17 13:56:56.914009 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:56.913727 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 13:56:56.914009 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:56.913778 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/82857eb2-5266-41f0-a333-56f15ab82e28-service-ca-bundle podName:82857eb2-5266-41f0-a333-56f15ab82e28 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:57.413751633 +0000 UTC m=+36.242103973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/82857eb2-5266-41f0-a333-56f15ab82e28-service-ca-bundle") pod "router-default-76cc77cc44-b58sp" (UID: "82857eb2-5266-41f0-a333-56f15ab82e28") : configmap references non-existent config key: service-ca.crt Jul 17 13:56:56.914009 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.913788 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9c528470-2f64-4de3-918a-9e510c262890-config-volume\") pod \"dns-default-qhjd8\" (UID: \"9c528470-2f64-4de3-918a-9e510c262890\") " pod="openshift-dns/dns-default-qhjd8" Jul 17 13:56:56.914009 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:56.913808 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 13:56:56.914009 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:56.913835 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c528470-2f64-4de3-918a-9e510c262890-metrics-tls podName:9c528470-2f64-4de3-918a-9e510c262890 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:57.413790429 +0000 UTC m=+36.242142768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c528470-2f64-4de3-918a-9e510c262890-metrics-tls") pod "dns-default-qhjd8" (UID: "9c528470-2f64-4de3-918a-9e510c262890") : secret "dns-default-metrics-tls" not found Jul 17 13:56:56.914009 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:56.913872 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/418f4e52-7ba5-475c-83a7-f23adbfd0f21-cluster-monitoring-operator-tls podName:418f4e52-7ba5-475c-83a7-f23adbfd0f21 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:57.413854157 +0000 UTC m=+36.242206484 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/418f4e52-7ba5-475c-83a7-f23adbfd0f21-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-kjqdb" (UID: "418f4e52-7ba5-475c-83a7-f23adbfd0f21") : secret "cluster-monitoring-operator-tls" not found Jul 17 13:56:56.914009 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:56.913930 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 13:56:56.914009 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:56.913941 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 13:56:56.914543 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:56.914019 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82857eb2-5266-41f0-a333-56f15ab82e28-metrics-certs podName:82857eb2-5266-41f0-a333-56f15ab82e28 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:57.414004168 +0000 UTC m=+36.242356494 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82857eb2-5266-41f0-a333-56f15ab82e28-metrics-certs") pod "router-default-76cc77cc44-b58sp" (UID: "82857eb2-5266-41f0-a333-56f15ab82e28") : secret "router-metrics-certs-default" not found Jul 17 13:56:56.914543 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:56.914050 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34186a54-c1f6-42eb-9348-9836c9885642-samples-operator-tls podName:34186a54-c1f6-42eb-9348-9836c9885642 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:57.414039682 +0000 UTC m=+36.242392006 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/34186a54-c1f6-42eb-9348-9836c9885642-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-nwn9r" (UID: "34186a54-c1f6-42eb-9348-9836c9885642") : secret "samples-operator-tls" not found Jul 17 13:56:56.914543 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.914064 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/313552d6-2c32-4553-98fc-2a5f01d7722c-serving-cert\") pod \"insights-operator-555d9d7885-r6gsw\" (UID: \"313552d6-2c32-4553-98fc-2a5f01d7722c\") " pod="openshift-insights/insights-operator-555d9d7885-r6gsw" Jul 17 13:56:56.914543 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.914085 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c528470-2f64-4de3-918a-9e510c262890-tmp-dir\") pod \"dns-default-qhjd8\" (UID: \"9c528470-2f64-4de3-918a-9e510c262890\") " pod="openshift-dns/dns-default-qhjd8" Jul 17 13:56:56.914543 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.914113 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c4b20c0f-f85e-488d-aee9-b772cb8738a0-trusted-ca\") pod \"console-operator-565b7b569d-86jkr\" (UID: \"c4b20c0f-f85e-488d-aee9-b772cb8738a0\") " pod="openshift-console-operator/console-operator-565b7b569d-86jkr" Jul 17 13:56:56.914543 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.914131 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/313552d6-2c32-4553-98fc-2a5f01d7722c-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-r6gsw\" (UID: \"313552d6-2c32-4553-98fc-2a5f01d7722c\") " pod="openshift-insights/insights-operator-555d9d7885-r6gsw" Jul 17 13:56:56.914543 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.914162 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/313552d6-2c32-4553-98fc-2a5f01d7722c-service-ca-bundle\") pod \"insights-operator-555d9d7885-r6gsw\" (UID: \"313552d6-2c32-4553-98fc-2a5f01d7722c\") " pod="openshift-insights/insights-operator-555d9d7885-r6gsw" Jul 17 13:56:56.914543 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.914213 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/82857eb2-5266-41f0-a333-56f15ab82e28-stats-auth\") pod \"router-default-76cc77cc44-b58sp\" (UID: \"82857eb2-5266-41f0-a333-56f15ab82e28\") " pod="openshift-ingress/router-default-76cc77cc44-b58sp" Jul 17 13:56:56.914543 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.914336 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/313552d6-2c32-4553-98fc-2a5f01d7722c-snapshots\") pod \"insights-operator-555d9d7885-r6gsw\" (UID: \"313552d6-2c32-4553-98fc-2a5f01d7722c\") " pod="openshift-insights/insights-operator-555d9d7885-r6gsw" Jul 17 13:56:56.914543 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.914460 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c528470-2f64-4de3-918a-9e510c262890-tmp-dir\") pod \"dns-default-qhjd8\" (UID: \"9c528470-2f64-4de3-918a-9e510c262890\") " pod="openshift-dns/dns-default-qhjd8" Jul 17 13:56:56.915074 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.914594 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/418f4e52-7ba5-475c-83a7-f23adbfd0f21-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-kjqdb\" (UID: \"418f4e52-7ba5-475c-83a7-f23adbfd0f21\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kjqdb" Jul 17 13:56:56.915074 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.914606 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/313552d6-2c32-4553-98fc-2a5f01d7722c-tmp\") pod \"insights-operator-555d9d7885-r6gsw\" (UID: \"313552d6-2c32-4553-98fc-2a5f01d7722c\") " pod="openshift-insights/insights-operator-555d9d7885-r6gsw" Jul 17 13:56:56.915074 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.914919 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/313552d6-2c32-4553-98fc-2a5f01d7722c-service-ca-bundle\") pod \"insights-operator-555d9d7885-r6gsw\" (UID: \"313552d6-2c32-4553-98fc-2a5f01d7722c\") " pod="openshift-insights/insights-operator-555d9d7885-r6gsw" Jul 17 13:56:56.915523 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.915502 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/313552d6-2c32-4553-98fc-2a5f01d7722c-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-r6gsw\" (UID: \"313552d6-2c32-4553-98fc-2a5f01d7722c\") " pod="openshift-insights/insights-operator-555d9d7885-r6gsw" Jul 17 13:56:56.916739 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.916720 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/82857eb2-5266-41f0-a333-56f15ab82e28-default-certificate\") pod \"router-default-76cc77cc44-b58sp\" (UID: \"82857eb2-5266-41f0-a333-56f15ab82e28\") " pod="openshift-ingress/router-default-76cc77cc44-b58sp" Jul 17 13:56:56.916830 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.916792 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/313552d6-2c32-4553-98fc-2a5f01d7722c-serving-cert\") pod \"insights-operator-555d9d7885-r6gsw\" (UID: \"313552d6-2c32-4553-98fc-2a5f01d7722c\") " pod="openshift-insights/insights-operator-555d9d7885-r6gsw" Jul 17 13:56:56.917247 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.917227 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/82857eb2-5266-41f0-a333-56f15ab82e28-stats-auth\") pod \"router-default-76cc77cc44-b58sp\" (UID: \"82857eb2-5266-41f0-a333-56f15ab82e28\") " pod="openshift-ingress/router-default-76cc77cc44-b58sp" Jul 17 13:56:56.926204 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.926156 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pcl8\" (UniqueName: \"kubernetes.io/projected/34186a54-c1f6-42eb-9348-9836c9885642-kube-api-access-7pcl8\") pod \"cluster-samples-operator-79b7c55f87-nwn9r\" (UID: \"34186a54-c1f6-42eb-9348-9836c9885642\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwn9r" Jul 17 13:56:56.926299 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.926218 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xg55\" (UniqueName: \"kubernetes.io/projected/82857eb2-5266-41f0-a333-56f15ab82e28-kube-api-access-4xg55\") pod \"router-default-76cc77cc44-b58sp\" (UID: \"82857eb2-5266-41f0-a333-56f15ab82e28\") " pod="openshift-ingress/router-default-76cc77cc44-b58sp" Jul 17 13:56:56.926299 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.926230 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s79gx\" (UniqueName: \"kubernetes.io/projected/313552d6-2c32-4553-98fc-2a5f01d7722c-kube-api-access-s79gx\") pod \"insights-operator-555d9d7885-r6gsw\" (UID: \"313552d6-2c32-4553-98fc-2a5f01d7722c\") " pod="openshift-insights/insights-operator-555d9d7885-r6gsw" Jul 17 13:56:56.926505 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.926488 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txmg5\" (UniqueName: \"kubernetes.io/projected/9c528470-2f64-4de3-918a-9e510c262890-kube-api-access-txmg5\") pod \"dns-default-qhjd8\" (UID: \"9c528470-2f64-4de3-918a-9e510c262890\") " pod="openshift-dns/dns-default-qhjd8" Jul 17 13:56:56.927218 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.927194 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fckd2\" (UniqueName: \"kubernetes.io/projected/418f4e52-7ba5-475c-83a7-f23adbfd0f21-kube-api-access-fckd2\") pod \"cluster-monitoring-operator-76cf8966f8-kjqdb\" (UID: \"418f4e52-7ba5-475c-83a7-f23adbfd0f21\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kjqdb" Jul 17 13:56:56.944872 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:56.944851 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-j9zpm" Jul 17 13:56:57.015023 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:57.014934 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c4b20c0f-f85e-488d-aee9-b772cb8738a0-config\") pod \"console-operator-565b7b569d-86jkr\" (UID: \"c4b20c0f-f85e-488d-aee9-b772cb8738a0\") " pod="openshift-console-operator/console-operator-565b7b569d-86jkr" Jul 17 13:56:57.015023 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:57.015000 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfkw6\" (UniqueName: \"kubernetes.io/projected/a6a77fbc-7a50-43ba-9c98-3655564837f6-kube-api-access-dfkw6\") pod \"ingress-canary-47dp7\" (UID: \"a6a77fbc-7a50-43ba-9c98-3655564837f6\") " pod="openshift-ingress-canary/ingress-canary-47dp7" Jul 17 13:56:57.015305 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:57.015088 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c4b20c0f-f85e-488d-aee9-b772cb8738a0-trusted-ca\") pod \"console-operator-565b7b569d-86jkr\" (UID: \"c4b20c0f-f85e-488d-aee9-b772cb8738a0\") " pod="openshift-console-operator/console-operator-565b7b569d-86jkr" Jul 17 13:56:57.015305 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:57.015171 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c4b20c0f-f85e-488d-aee9-b772cb8738a0-serving-cert\") pod \"console-operator-565b7b569d-86jkr\" (UID: \"c4b20c0f-f85e-488d-aee9-b772cb8738a0\") " pod="openshift-console-operator/console-operator-565b7b569d-86jkr" Jul 17 13:56:57.015305 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:57.015236 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brjpt\" (UniqueName: \"kubernetes.io/projected/c4b20c0f-f85e-488d-aee9-b772cb8738a0-kube-api-access-brjpt\") pod \"console-operator-565b7b569d-86jkr\" (UID: \"c4b20c0f-f85e-488d-aee9-b772cb8738a0\") " pod="openshift-console-operator/console-operator-565b7b569d-86jkr" Jul 17 13:56:57.015510 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:57.015309 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6a77fbc-7a50-43ba-9c98-3655564837f6-cert\") pod \"ingress-canary-47dp7\" (UID: \"a6a77fbc-7a50-43ba-9c98-3655564837f6\") " pod="openshift-ingress-canary/ingress-canary-47dp7" Jul 17 13:56:57.015510 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:57.015343 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjbg4\" (UniqueName: \"kubernetes.io/projected/b5f8c02b-c7ab-4e40-9502-0186ac149d3c-kube-api-access-bjbg4\") pod \"network-check-source-7bc5b6bf85-mclw4\" (UID: \"b5f8c02b-c7ab-4e40-9502-0186ac149d3c\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-mclw4" Jul 17 13:56:57.016429 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:57.015859 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c4b20c0f-f85e-488d-aee9-b772cb8738a0-config\") pod \"console-operator-565b7b569d-86jkr\" (UID: \"c4b20c0f-f85e-488d-aee9-b772cb8738a0\") " pod="openshift-console-operator/console-operator-565b7b569d-86jkr" Jul 17 13:56:57.016748 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:57.016719 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c4b20c0f-f85e-488d-aee9-b772cb8738a0-trusted-ca\") pod \"console-operator-565b7b569d-86jkr\" (UID: \"c4b20c0f-f85e-488d-aee9-b772cb8738a0\") " pod="openshift-console-operator/console-operator-565b7b569d-86jkr" Jul 17 13:56:57.020421 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:57.019965 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a6a77fbc-7a50-43ba-9c98-3655564837f6-cert\") pod \"ingress-canary-47dp7\" (UID: \"a6a77fbc-7a50-43ba-9c98-3655564837f6\") " pod="openshift-ingress-canary/ingress-canary-47dp7" Jul 17 13:56:57.020924 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:57.020876 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c4b20c0f-f85e-488d-aee9-b772cb8738a0-serving-cert\") pod \"console-operator-565b7b569d-86jkr\" (UID: \"c4b20c0f-f85e-488d-aee9-b772cb8738a0\") " pod="openshift-console-operator/console-operator-565b7b569d-86jkr" Jul 17 13:56:57.030606 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:57.029239 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjbg4\" (UniqueName: \"kubernetes.io/projected/b5f8c02b-c7ab-4e40-9502-0186ac149d3c-kube-api-access-bjbg4\") pod \"network-check-source-7bc5b6bf85-mclw4\" (UID: \"b5f8c02b-c7ab-4e40-9502-0186ac149d3c\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-mclw4" Jul 17 13:56:57.030606 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:57.030537 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-r6gsw" Jul 17 13:56:57.032097 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:57.031930 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfkw6\" (UniqueName: \"kubernetes.io/projected/a6a77fbc-7a50-43ba-9c98-3655564837f6-kube-api-access-dfkw6\") pod \"ingress-canary-47dp7\" (UID: \"a6a77fbc-7a50-43ba-9c98-3655564837f6\") " pod="openshift-ingress-canary/ingress-canary-47dp7" Jul 17 13:56:57.037962 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:57.037774 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brjpt\" (UniqueName: \"kubernetes.io/projected/c4b20c0f-f85e-488d-aee9-b772cb8738a0-kube-api-access-brjpt\") pod \"console-operator-565b7b569d-86jkr\" (UID: \"c4b20c0f-f85e-488d-aee9-b772cb8738a0\") " pod="openshift-console-operator/console-operator-565b7b569d-86jkr" Jul 17 13:56:57.070616 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:57.070589 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-47dp7" Jul 17 13:56:57.097439 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:57.096579 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-86jkr" Jul 17 13:56:57.133729 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:57.133699 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-9l9rw"] Jul 17 13:56:57.135653 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:57.135631 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-phbnw"] Jul 17 13:56:57.137672 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:57.137656 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-j9zpm"] Jul 17 13:56:57.139688 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:57.139669 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-mclw4" Jul 17 13:56:57.317984 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:57.317949 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-registry-tls\") pod \"image-registry-69588b5c66-jk8qx\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:56:57.318154 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:57.318127 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 13:56:57.318154 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:57.318146 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69588b5c66-jk8qx: secret "image-registry-tls" not found Jul 17 13:56:57.318279 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:57.318231 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-registry-tls podName:abc092dc-0b98-4726-a513-94b21f1a0b26 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:58.318210768 +0000 UTC m=+37.146563096 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-registry-tls") pod "image-registry-69588b5c66-jk8qx" (UID: "abc092dc-0b98-4726-a513-94b21f1a0b26") : secret "image-registry-tls" not found Jul 17 13:56:57.418816 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:57.418777 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/418f4e52-7ba5-475c-83a7-f23adbfd0f21-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-kjqdb\" (UID: \"418f4e52-7ba5-475c-83a7-f23adbfd0f21\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kjqdb" Jul 17 13:56:57.418979 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:57.418901 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82857eb2-5266-41f0-a333-56f15ab82e28-service-ca-bundle\") pod \"router-default-76cc77cc44-b58sp\" (UID: \"82857eb2-5266-41f0-a333-56f15ab82e28\") " pod="openshift-ingress/router-default-76cc77cc44-b58sp" Jul 17 13:56:57.418979 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:57.418946 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 13:56:57.419092 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:57.419017 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/418f4e52-7ba5-475c-83a7-f23adbfd0f21-cluster-monitoring-operator-tls podName:418f4e52-7ba5-475c-83a7-f23adbfd0f21 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:58.418999708 +0000 UTC m=+37.247352033 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/418f4e52-7ba5-475c-83a7-f23adbfd0f21-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-kjqdb" (UID: "418f4e52-7ba5-475c-83a7-f23adbfd0f21") : secret "cluster-monitoring-operator-tls" not found Jul 17 13:56:57.419092 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:57.419029 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 13:56:57.419092 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:57.419036 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/82857eb2-5266-41f0-a333-56f15ab82e28-service-ca-bundle podName:82857eb2-5266-41f0-a333-56f15ab82e28 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:58.419025949 +0000 UTC m=+37.247378274 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/82857eb2-5266-41f0-a333-56f15ab82e28-service-ca-bundle") pod "router-default-76cc77cc44-b58sp" (UID: "82857eb2-5266-41f0-a333-56f15ab82e28") : configmap references non-existent config key: service-ca.crt Jul 17 13:56:57.419092 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:57.418955 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/34186a54-c1f6-42eb-9348-9836c9885642-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nwn9r\" (UID: \"34186a54-c1f6-42eb-9348-9836c9885642\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwn9r" Jul 17 13:56:57.419092 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:57.419077 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34186a54-c1f6-42eb-9348-9836c9885642-samples-operator-tls podName:34186a54-c1f6-42eb-9348-9836c9885642 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:58.419065012 +0000 UTC m=+37.247417358 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/34186a54-c1f6-42eb-9348-9836c9885642-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-nwn9r" (UID: "34186a54-c1f6-42eb-9348-9836c9885642") : secret "samples-operator-tls" not found Jul 17 13:56:57.419341 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:57.419109 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82857eb2-5266-41f0-a333-56f15ab82e28-metrics-certs\") pod \"router-default-76cc77cc44-b58sp\" (UID: \"82857eb2-5266-41f0-a333-56f15ab82e28\") " pod="openshift-ingress/router-default-76cc77cc44-b58sp" Jul 17 13:56:57.419341 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:57.419139 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c528470-2f64-4de3-918a-9e510c262890-metrics-tls\") pod \"dns-default-qhjd8\" (UID: \"9c528470-2f64-4de3-918a-9e510c262890\") " pod="openshift-dns/dns-default-qhjd8" Jul 17 13:56:57.419341 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:57.419202 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 13:56:57.419341 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:57.419240 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82857eb2-5266-41f0-a333-56f15ab82e28-metrics-certs podName:82857eb2-5266-41f0-a333-56f15ab82e28 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:58.419228511 +0000 UTC m=+37.247580835 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82857eb2-5266-41f0-a333-56f15ab82e28-metrics-certs") pod "router-default-76cc77cc44-b58sp" (UID: "82857eb2-5266-41f0-a333-56f15ab82e28") : secret "router-metrics-certs-default" not found Jul 17 13:56:57.419341 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:57.419248 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 13:56:57.419341 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:57.419280 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c528470-2f64-4de3-918a-9e510c262890-metrics-tls podName:9c528470-2f64-4de3-918a-9e510c262890 nodeName:}" failed. No retries permitted until 2026-07-17 13:56:58.419268394 +0000 UTC m=+37.247620735 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c528470-2f64-4de3-918a-9e510c262890-metrics-tls") pod "dns-default-qhjd8" (UID: "9c528470-2f64-4de3-918a-9e510c262890") : secret "dns-default-metrics-tls" not found Jul 17 13:56:58.328886 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:58.328845 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-registry-tls\") pod \"image-registry-69588b5c66-jk8qx\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:56:58.329531 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:58.329021 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 13:56:58.329531 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:58.329044 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69588b5c66-jk8qx: secret "image-registry-tls" not found Jul 17 13:56:58.329531 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:58.329106 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-registry-tls podName:abc092dc-0b98-4726-a513-94b21f1a0b26 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:00.329090902 +0000 UTC m=+39.157443226 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-registry-tls") pod "image-registry-69588b5c66-jk8qx" (UID: "abc092dc-0b98-4726-a513-94b21f1a0b26") : secret "image-registry-tls" not found Jul 17 13:56:58.430024 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:58.429994 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82857eb2-5266-41f0-a333-56f15ab82e28-service-ca-bundle\") pod \"router-default-76cc77cc44-b58sp\" (UID: \"82857eb2-5266-41f0-a333-56f15ab82e28\") " pod="openshift-ingress/router-default-76cc77cc44-b58sp" Jul 17 13:56:58.430216 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:58.430051 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/34186a54-c1f6-42eb-9348-9836c9885642-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nwn9r\" (UID: \"34186a54-c1f6-42eb-9348-9836c9885642\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwn9r" Jul 17 13:56:58.430216 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:58.430102 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82857eb2-5266-41f0-a333-56f15ab82e28-metrics-certs\") pod \"router-default-76cc77cc44-b58sp\" (UID: \"82857eb2-5266-41f0-a333-56f15ab82e28\") " pod="openshift-ingress/router-default-76cc77cc44-b58sp" Jul 17 13:56:58.430216 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:58.430125 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c528470-2f64-4de3-918a-9e510c262890-metrics-tls\") pod \"dns-default-qhjd8\" (UID: \"9c528470-2f64-4de3-918a-9e510c262890\") " pod="openshift-dns/dns-default-qhjd8" Jul 17 13:56:58.430216 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:58.430166 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/418f4e52-7ba5-475c-83a7-f23adbfd0f21-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-kjqdb\" (UID: \"418f4e52-7ba5-475c-83a7-f23adbfd0f21\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kjqdb" Jul 17 13:56:58.430216 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:58.430198 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/82857eb2-5266-41f0-a333-56f15ab82e28-service-ca-bundle podName:82857eb2-5266-41f0-a333-56f15ab82e28 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:00.430162411 +0000 UTC m=+39.258514749 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/82857eb2-5266-41f0-a333-56f15ab82e28-service-ca-bundle") pod "router-default-76cc77cc44-b58sp" (UID: "82857eb2-5266-41f0-a333-56f15ab82e28") : configmap references non-existent config key: service-ca.crt Jul 17 13:56:58.430461 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:58.430254 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 13:56:58.430461 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:58.430290 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 13:56:58.430461 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:58.430312 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 13:56:58.430461 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:58.430312 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 13:56:58.430461 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:58.430297 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/418f4e52-7ba5-475c-83a7-f23adbfd0f21-cluster-monitoring-operator-tls podName:418f4e52-7ba5-475c-83a7-f23adbfd0f21 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:00.430286473 +0000 UTC m=+39.258638798 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/418f4e52-7ba5-475c-83a7-f23adbfd0f21-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-kjqdb" (UID: "418f4e52-7ba5-475c-83a7-f23adbfd0f21") : secret "cluster-monitoring-operator-tls" not found Jul 17 13:56:58.430461 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:58.430350 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82857eb2-5266-41f0-a333-56f15ab82e28-metrics-certs podName:82857eb2-5266-41f0-a333-56f15ab82e28 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:00.430336834 +0000 UTC m=+39.258689161 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82857eb2-5266-41f0-a333-56f15ab82e28-metrics-certs") pod "router-default-76cc77cc44-b58sp" (UID: "82857eb2-5266-41f0-a333-56f15ab82e28") : secret "router-metrics-certs-default" not found Jul 17 13:56:58.430461 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:58.430363 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34186a54-c1f6-42eb-9348-9836c9885642-samples-operator-tls podName:34186a54-c1f6-42eb-9348-9836c9885642 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:00.430357072 +0000 UTC m=+39.258709397 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/34186a54-c1f6-42eb-9348-9836c9885642-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-nwn9r" (UID: "34186a54-c1f6-42eb-9348-9836c9885642") : secret "samples-operator-tls" not found Jul 17 13:56:58.430461 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:56:58.430374 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c528470-2f64-4de3-918a-9e510c262890-metrics-tls podName:9c528470-2f64-4de3-918a-9e510c262890 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:00.430369461 +0000 UTC m=+39.258721784 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c528470-2f64-4de3-918a-9e510c262890-metrics-tls") pod "dns-default-qhjd8" (UID: "9c528470-2f64-4de3-918a-9e510c262890") : secret "dns-default-metrics-tls" not found Jul 17 13:56:58.636975 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:58.636910 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38ccf43f_fbcf_41d3_a0b2_2ba57dd0a94a.slice/crio-47c65e89a0f943b9a55de713f253d7f25a5a76ce2d48d6f24f869474e5395796 WatchSource:0}: Error finding container 47c65e89a0f943b9a55de713f253d7f25a5a76ce2d48d6f24f869474e5395796: Status 404 returned error can't find the container with id 47c65e89a0f943b9a55de713f253d7f25a5a76ce2d48d6f24f869474e5395796 Jul 17 13:56:58.637959 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:58.637832 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45230f7f_2bb9_4737_adf5_e47da33d503c.slice/crio-7c26acebe7f8040c97f12400b07d7d8c1458cb8363657e4eab40d0875f73af7d WatchSource:0}: Error finding container 7c26acebe7f8040c97f12400b07d7d8c1458cb8363657e4eab40d0875f73af7d: Status 404 returned error can't find the container with id 7c26acebe7f8040c97f12400b07d7d8c1458cb8363657e4eab40d0875f73af7d Jul 17 13:56:58.639246 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:56:58.639224 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10b00003_e1e9_41fb_8218_479d03a2c5a9.slice/crio-c0d64ae34ab755f2f64a9eaaed6fbc0a1668399c3299dec18f2eba770235e193 WatchSource:0}: Error finding container c0d64ae34ab755f2f64a9eaaed6fbc0a1668399c3299dec18f2eba770235e193: Status 404 returned error can't find the container with id c0d64ae34ab755f2f64a9eaaed6fbc0a1668399c3299dec18f2eba770235e193 Jul 17 13:56:58.862939 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:58.862908 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-r6gsw"] Jul 17 13:56:58.869767 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:58.869743 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-47dp7"] Jul 17 13:56:58.880258 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:58.880231 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-86jkr"] Jul 17 13:56:58.890165 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:58.886497 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-mclw4"] Jul 17 13:56:58.945013 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:58.944979 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-mclw4" event={"ID":"b5f8c02b-c7ab-4e40-9502-0186ac149d3c","Type":"ContainerStarted","Data":"9a5aa9776555a1fdeb06b989b8ec2f3fed16c84711bd3d79ec0fde3f003f4007"} Jul 17 13:56:58.947766 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:58.947744 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v68k8" event={"ID":"67792ecb-4c2c-4d9d-ae18-fcc9fe824b46","Type":"ContainerStarted","Data":"cda5ff41ffecf027e600d60f167905ab93e4161ed7c6933700ddf98ebe630eac"} Jul 17 13:56:58.948889 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:58.948868 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-47dp7" event={"ID":"a6a77fbc-7a50-43ba-9c98-3655564837f6","Type":"ContainerStarted","Data":"4ea99a132b1dd619554c3b4b0f33fc5d3b2ca961dedc94379a8981a6a05ebeb3"} Jul 17 13:56:58.949920 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:58.949901 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-j9zpm" event={"ID":"38ccf43f-fbcf-41d3-a0b2-2ba57dd0a94a","Type":"ContainerStarted","Data":"47c65e89a0f943b9a55de713f253d7f25a5a76ce2d48d6f24f869474e5395796"} Jul 17 13:56:58.950919 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:58.950902 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-phbnw" event={"ID":"45230f7f-2bb9-4737-adf5-e47da33d503c","Type":"ContainerStarted","Data":"7c26acebe7f8040c97f12400b07d7d8c1458cb8363657e4eab40d0875f73af7d"} Jul 17 13:56:58.951906 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:58.951888 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-r6gsw" event={"ID":"313552d6-2c32-4553-98fc-2a5f01d7722c","Type":"ContainerStarted","Data":"28a9afa43f530c938bb4a482b973a367a05b2894e1b94b9ee7aeb2eb7355cb75"} Jul 17 13:56:58.952984 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:58.952965 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-9l9rw" event={"ID":"10b00003-e1e9-41fb-8218-479d03a2c5a9","Type":"ContainerStarted","Data":"c0d64ae34ab755f2f64a9eaaed6fbc0a1668399c3299dec18f2eba770235e193"} Jul 17 13:56:58.953893 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:58.953875 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-86jkr" event={"ID":"c4b20c0f-f85e-488d-aee9-b772cb8738a0","Type":"ContainerStarted","Data":"39adb162ccf20c80409b8a7d99d6b97a76ab35cdcb9574ab944db7b18df3aea1"} Jul 17 13:56:59.965448 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:59.964294 2565 generic.go:356] "Generic (PLEG): container finished" podID="67792ecb-4c2c-4d9d-ae18-fcc9fe824b46" containerID="cda5ff41ffecf027e600d60f167905ab93e4161ed7c6933700ddf98ebe630eac" exitCode=0 Jul 17 13:56:59.965448 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:59.964544 2565 generic.go:356] "Generic (PLEG): container finished" podID="67792ecb-4c2c-4d9d-ae18-fcc9fe824b46" containerID="a67dfb90bd9c10f95c8b0ee7d98209ca0084ed8fd0d7793bec9c880ce1fb26f1" exitCode=0 Jul 17 13:56:59.965448 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:59.964589 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v68k8" event={"ID":"67792ecb-4c2c-4d9d-ae18-fcc9fe824b46","Type":"ContainerDied","Data":"cda5ff41ffecf027e600d60f167905ab93e4161ed7c6933700ddf98ebe630eac"} Jul 17 13:56:59.965448 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:56:59.964639 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v68k8" event={"ID":"67792ecb-4c2c-4d9d-ae18-fcc9fe824b46","Type":"ContainerDied","Data":"a67dfb90bd9c10f95c8b0ee7d98209ca0084ed8fd0d7793bec9c880ce1fb26f1"} Jul 17 13:57:00.352702 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:00.352664 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-registry-tls\") pod \"image-registry-69588b5c66-jk8qx\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:57:00.352894 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:00.352828 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 13:57:00.352894 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:00.352844 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69588b5c66-jk8qx: secret "image-registry-tls" not found Jul 17 13:57:00.353011 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:00.352902 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-registry-tls podName:abc092dc-0b98-4726-a513-94b21f1a0b26 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:04.352882932 +0000 UTC m=+43.181235258 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-registry-tls") pod "image-registry-69588b5c66-jk8qx" (UID: "abc092dc-0b98-4726-a513-94b21f1a0b26") : secret "image-registry-tls" not found Jul 17 13:57:00.453980 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:00.453938 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/34186a54-c1f6-42eb-9348-9836c9885642-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nwn9r\" (UID: \"34186a54-c1f6-42eb-9348-9836c9885642\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwn9r" Jul 17 13:57:00.454170 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:00.454016 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82857eb2-5266-41f0-a333-56f15ab82e28-metrics-certs\") pod \"router-default-76cc77cc44-b58sp\" (UID: \"82857eb2-5266-41f0-a333-56f15ab82e28\") " pod="openshift-ingress/router-default-76cc77cc44-b58sp" Jul 17 13:57:00.454170 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:00.454049 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c528470-2f64-4de3-918a-9e510c262890-metrics-tls\") pod \"dns-default-qhjd8\" (UID: \"9c528470-2f64-4de3-918a-9e510c262890\") " pod="openshift-dns/dns-default-qhjd8" Jul 17 13:57:00.454170 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:00.454104 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/418f4e52-7ba5-475c-83a7-f23adbfd0f21-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-kjqdb\" (UID: \"418f4e52-7ba5-475c-83a7-f23adbfd0f21\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kjqdb" Jul 17 13:57:00.454422 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:00.454213 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82857eb2-5266-41f0-a333-56f15ab82e28-service-ca-bundle\") pod \"router-default-76cc77cc44-b58sp\" (UID: \"82857eb2-5266-41f0-a333-56f15ab82e28\") " pod="openshift-ingress/router-default-76cc77cc44-b58sp" Jul 17 13:57:00.454422 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:00.454409 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/82857eb2-5266-41f0-a333-56f15ab82e28-service-ca-bundle podName:82857eb2-5266-41f0-a333-56f15ab82e28 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:04.454390636 +0000 UTC m=+43.282742966 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/82857eb2-5266-41f0-a333-56f15ab82e28-service-ca-bundle") pod "router-default-76cc77cc44-b58sp" (UID: "82857eb2-5266-41f0-a333-56f15ab82e28") : configmap references non-existent config key: service-ca.crt Jul 17 13:57:00.454590 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:00.454502 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 13:57:00.454590 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:00.454539 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34186a54-c1f6-42eb-9348-9836c9885642-samples-operator-tls podName:34186a54-c1f6-42eb-9348-9836c9885642 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:04.454527461 +0000 UTC m=+43.282879789 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/34186a54-c1f6-42eb-9348-9836c9885642-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-nwn9r" (UID: "34186a54-c1f6-42eb-9348-9836c9885642") : secret "samples-operator-tls" not found Jul 17 13:57:00.454700 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:00.454602 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 13:57:00.454700 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:00.454632 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82857eb2-5266-41f0-a333-56f15ab82e28-metrics-certs podName:82857eb2-5266-41f0-a333-56f15ab82e28 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:04.454622631 +0000 UTC m=+43.282974958 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82857eb2-5266-41f0-a333-56f15ab82e28-metrics-certs") pod "router-default-76cc77cc44-b58sp" (UID: "82857eb2-5266-41f0-a333-56f15ab82e28") : secret "router-metrics-certs-default" not found Jul 17 13:57:00.454700 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:00.454697 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 13:57:00.454849 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:00.454727 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c528470-2f64-4de3-918a-9e510c262890-metrics-tls podName:9c528470-2f64-4de3-918a-9e510c262890 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:04.454717736 +0000 UTC m=+43.283070066 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c528470-2f64-4de3-918a-9e510c262890-metrics-tls") pod "dns-default-qhjd8" (UID: "9c528470-2f64-4de3-918a-9e510c262890") : secret "dns-default-metrics-tls" not found Jul 17 13:57:00.454849 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:00.454779 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 13:57:00.454849 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:00.454806 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/418f4e52-7ba5-475c-83a7-f23adbfd0f21-cluster-monitoring-operator-tls podName:418f4e52-7ba5-475c-83a7-f23adbfd0f21 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:04.454797579 +0000 UTC m=+43.283149906 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/418f4e52-7ba5-475c-83a7-f23adbfd0f21-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-kjqdb" (UID: "418f4e52-7ba5-475c-83a7-f23adbfd0f21") : secret "cluster-monitoring-operator-tls" not found Jul 17 13:57:00.914437 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:00.914295 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:01.007848 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:01.007815 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:01.342206 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:01.342142 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:01.424614 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:01.424545 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:01.974948 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:01.974902 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v68k8" event={"ID":"67792ecb-4c2c-4d9d-ae18-fcc9fe824b46","Type":"ContainerStarted","Data":"154897c378e2ab484535968a21d63e45ed390f3810f522a967595bf86028fc14"} Jul 17 13:57:01.997564 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:01.997513 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-v68k8" podStartSLOduration=9.289667833 podStartE2EDuration="39.997496598s" totalImagesPullingTime="30.707828765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:56:22 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:01.996364974 +0000 UTC m=+40.824717321" watchObservedRunningTime="2026-07-17 13:57:01.997496598 +0000 UTC m=+40.825848964" Jul 17 13:57:02.129166 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:02.129128 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:02.202647 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:02.202598 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:02.385932 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:02.385836 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:02.484954 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:02.484901 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:04.391095 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:04.391061 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-registry-tls\") pod \"image-registry-69588b5c66-jk8qx\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:57:04.391574 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:04.391228 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 13:57:04.391574 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:04.391242 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69588b5c66-jk8qx: secret "image-registry-tls" not found Jul 17 13:57:04.391574 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:04.391297 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-registry-tls podName:abc092dc-0b98-4726-a513-94b21f1a0b26 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:12.391277495 +0000 UTC m=+51.219629820 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-registry-tls") pod "image-registry-69588b5c66-jk8qx" (UID: "abc092dc-0b98-4726-a513-94b21f1a0b26") : secret "image-registry-tls" not found Jul 17 13:57:04.492036 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:04.491998 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82857eb2-5266-41f0-a333-56f15ab82e28-service-ca-bundle\") pod \"router-default-76cc77cc44-b58sp\" (UID: \"82857eb2-5266-41f0-a333-56f15ab82e28\") " pod="openshift-ingress/router-default-76cc77cc44-b58sp" Jul 17 13:57:04.492259 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:04.492067 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/34186a54-c1f6-42eb-9348-9836c9885642-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nwn9r\" (UID: \"34186a54-c1f6-42eb-9348-9836c9885642\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwn9r" Jul 17 13:57:04.492259 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:04.492117 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82857eb2-5266-41f0-a333-56f15ab82e28-metrics-certs\") pod \"router-default-76cc77cc44-b58sp\" (UID: \"82857eb2-5266-41f0-a333-56f15ab82e28\") " pod="openshift-ingress/router-default-76cc77cc44-b58sp" Jul 17 13:57:04.492259 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:04.492150 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c528470-2f64-4de3-918a-9e510c262890-metrics-tls\") pod \"dns-default-qhjd8\" (UID: \"9c528470-2f64-4de3-918a-9e510c262890\") " pod="openshift-dns/dns-default-qhjd8" Jul 17 13:57:04.492259 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:04.492215 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/82857eb2-5266-41f0-a333-56f15ab82e28-service-ca-bundle podName:82857eb2-5266-41f0-a333-56f15ab82e28 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:12.492170607 +0000 UTC m=+51.320522947 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/82857eb2-5266-41f0-a333-56f15ab82e28-service-ca-bundle") pod "router-default-76cc77cc44-b58sp" (UID: "82857eb2-5266-41f0-a333-56f15ab82e28") : configmap references non-existent config key: service-ca.crt Jul 17 13:57:04.492259 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:04.492250 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 13:57:04.492259 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:04.492250 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 13:57:04.492472 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:04.492271 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/418f4e52-7ba5-475c-83a7-f23adbfd0f21-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-kjqdb\" (UID: \"418f4e52-7ba5-475c-83a7-f23adbfd0f21\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kjqdb" Jul 17 13:57:04.492472 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:04.492302 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82857eb2-5266-41f0-a333-56f15ab82e28-metrics-certs podName:82857eb2-5266-41f0-a333-56f15ab82e28 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:12.492287921 +0000 UTC m=+51.320640311 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82857eb2-5266-41f0-a333-56f15ab82e28-metrics-certs") pod "router-default-76cc77cc44-b58sp" (UID: "82857eb2-5266-41f0-a333-56f15ab82e28") : secret "router-metrics-certs-default" not found Jul 17 13:57:04.492472 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:04.492248 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 13:57:04.492472 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:04.492331 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 13:57:04.492472 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:04.492338 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34186a54-c1f6-42eb-9348-9836c9885642-samples-operator-tls podName:34186a54-c1f6-42eb-9348-9836c9885642 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:12.492329345 +0000 UTC m=+51.320681669 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/34186a54-c1f6-42eb-9348-9836c9885642-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-nwn9r" (UID: "34186a54-c1f6-42eb-9348-9836c9885642") : secret "samples-operator-tls" not found Jul 17 13:57:04.492472 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:04.492357 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c528470-2f64-4de3-918a-9e510c262890-metrics-tls podName:9c528470-2f64-4de3-918a-9e510c262890 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:12.492349002 +0000 UTC m=+51.320701326 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c528470-2f64-4de3-918a-9e510c262890-metrics-tls") pod "dns-default-qhjd8" (UID: "9c528470-2f64-4de3-918a-9e510c262890") : secret "dns-default-metrics-tls" not found Jul 17 13:57:04.492472 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:04.492370 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/418f4e52-7ba5-475c-83a7-f23adbfd0f21-cluster-monitoring-operator-tls podName:418f4e52-7ba5-475c-83a7-f23adbfd0f21 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:12.492365091 +0000 UTC m=+51.320717415 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/418f4e52-7ba5-475c-83a7-f23adbfd0f21-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-kjqdb" (UID: "418f4e52-7ba5-475c-83a7-f23adbfd0f21") : secret "cluster-monitoring-operator-tls" not found Jul 17 13:57:04.911369 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:04.911267 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:05.114130 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:05.114087 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:05.183160 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:05.183069 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:05.558063 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:05.558036 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:05.618003 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:05.617982 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:05.987820 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:05.987679 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-47dp7" event={"ID":"a6a77fbc-7a50-43ba-9c98-3655564837f6","Type":"ContainerStarted","Data":"ccc058fe5ec1d47e9d54c1d4ce346f2ac3af2f051c0213f76a2e8d5abde16023"} Jul 17 13:57:05.989820 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:05.989790 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-j9zpm" event={"ID":"38ccf43f-fbcf-41d3-a0b2-2ba57dd0a94a","Type":"ContainerStarted","Data":"2406e44b672d3d12445224a9a277a5f8ba855ea906f5eec5197f3ed4069f5f4a"} Jul 17 13:57:05.991469 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:05.991443 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-phbnw" event={"ID":"45230f7f-2bb9-4737-adf5-e47da33d503c","Type":"ContainerStarted","Data":"c2ac06eef3e63e78efb94ed450b7a4089cc484009a2c5cb8d99f6ef100b00a59"} Jul 17 13:57:05.993154 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:05.993128 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-r6gsw" event={"ID":"313552d6-2c32-4553-98fc-2a5f01d7722c","Type":"ContainerStarted","Data":"4fb80018dc35db09908459edb7ba18352d22fedec7e7c4bfe829aeae1eebe6de"} Jul 17 13:57:05.994927 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:05.994858 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-9l9rw" event={"ID":"10b00003-e1e9-41fb-8218-479d03a2c5a9","Type":"ContainerStarted","Data":"40e92fbab9ed566add68b70f15a28829ff828dd48ae56aded5b045c58052b47d"} Jul 17 13:57:05.996635 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:05.996616 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-86jkr_c4b20c0f-f85e-488d-aee9-b772cb8738a0/console-operator/0.log" Jul 17 13:57:05.996810 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:05.996651 2565 generic.go:356] "Generic (PLEG): container finished" podID="c4b20c0f-f85e-488d-aee9-b772cb8738a0" containerID="24a066e0408dbae51fec5fab9cd058b979127abbcf0b520d14718133cbaf852f" exitCode=255 Jul 17 13:57:05.996810 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:05.996735 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-86jkr" event={"ID":"c4b20c0f-f85e-488d-aee9-b772cb8738a0","Type":"ContainerDied","Data":"24a066e0408dbae51fec5fab9cd058b979127abbcf0b520d14718133cbaf852f"} Jul 17 13:57:05.997003 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:05.996988 2565 scope.go:117] "RemoveContainer" containerID="24a066e0408dbae51fec5fab9cd058b979127abbcf0b520d14718133cbaf852f" Jul 17 13:57:05.998761 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:05.998741 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-mclw4" event={"ID":"b5f8c02b-c7ab-4e40-9502-0186ac149d3c","Type":"ContainerStarted","Data":"e5754c475a5133ff6f2b5ca5705bdb2d5be6f2df1745373abff17402b2420dcf"} Jul 17 13:57:06.003918 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:06.003875 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-47dp7" podStartSLOduration=3.2840930569999998 podStartE2EDuration="10.003859398s" totalImagesPullingTime="6.719766341s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:56:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:06.003785079 +0000 UTC m=+44.832137426" watchObservedRunningTime="2026-07-17 13:57:06.003859398 +0000 UTC m=+44.832211748" Jul 17 13:57:06.021080 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:06.020128 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-j9zpm" podStartSLOduration=6.049224027 podStartE2EDuration="13.020110923s" totalImagesPullingTime="6.970886896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:56:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:06.019140816 +0000 UTC m=+44.847493163" watchObservedRunningTime="2026-07-17 13:57:06.020110923 +0000 UTC m=+44.848463270" Jul 17 13:57:06.045918 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:06.045827 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-r6gsw" podStartSLOduration=6.327654658 podStartE2EDuration="13.045809251s" totalImagesPullingTime="6.718154593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:56:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:06.043878502 +0000 UTC m=+44.872230849" watchObservedRunningTime="2026-07-17 13:57:06.045809251 +0000 UTC m=+44.874161602" Jul 17 13:57:06.084746 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:06.084455 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-9l9rw" podStartSLOduration=6.258803039 podStartE2EDuration="13.084437323s" totalImagesPullingTime="6.825634284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:56:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:06.063669942 +0000 UTC m=+44.892022287" watchObservedRunningTime="2026-07-17 13:57:06.084437323 +0000 UTC m=+44.912789671" Jul 17 13:57:06.084746 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:06.084551 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-phbnw" podStartSLOduration=6.115865257 podStartE2EDuration="13.084546515s" totalImagesPullingTime="6.968681258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:56:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:06.083764504 +0000 UTC m=+44.912116852" watchObservedRunningTime="2026-07-17 13:57:06.084546515 +0000 UTC m=+44.912898862" Jul 17 13:57:06.140192 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:06.140050 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-mclw4" podStartSLOduration=6.412436577 podStartE2EDuration="13.140033694s" totalImagesPullingTime="6.727597117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:56:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:06.138845443 +0000 UTC m=+44.967197792" watchObservedRunningTime="2026-07-17 13:57:06.140033694 +0000 UTC m=+44.968386080" Jul 17 13:57:06.183794 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:06.183768 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:06.286851 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:06.286814 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:06.919809 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:06.919705 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:06.999876 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:06.999839 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:07.003802 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.003776 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-86jkr_c4b20c0f-f85e-488d-aee9-b772cb8738a0/console-operator/1.log" Jul 17 13:57:07.004274 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.004246 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-86jkr_c4b20c0f-f85e-488d-aee9-b772cb8738a0/console-operator/0.log" Jul 17 13:57:07.004344 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.004290 2565 generic.go:356] "Generic (PLEG): container finished" podID="c4b20c0f-f85e-488d-aee9-b772cb8738a0" containerID="8feb567ba8434c48fa7cb4fc0ee39406a9c54cd2b0227d4bef8d0e400f7354c7" exitCode=255 Jul 17 13:57:07.004417 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.004394 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-86jkr" event={"ID":"c4b20c0f-f85e-488d-aee9-b772cb8738a0","Type":"ContainerDied","Data":"8feb567ba8434c48fa7cb4fc0ee39406a9c54cd2b0227d4bef8d0e400f7354c7"} Jul 17 13:57:07.004476 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.004462 2565 scope.go:117] "RemoveContainer" containerID="24a066e0408dbae51fec5fab9cd058b979127abbcf0b520d14718133cbaf852f" Jul 17 13:57:07.004632 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.004616 2565 scope.go:117] "RemoveContainer" containerID="8feb567ba8434c48fa7cb4fc0ee39406a9c54cd2b0227d4bef8d0e400f7354c7" Jul 17 13:57:07.004849 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:07.004821 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-86jkr_openshift-console-operator(c4b20c0f-f85e-488d-aee9-b772cb8738a0)\"" pod="openshift-console-operator/console-operator-565b7b569d-86jkr" podUID="c4b20c0f-f85e-488d-aee9-b772cb8738a0" Jul 17 13:57:07.097166 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.097136 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-86jkr" Jul 17 13:57:07.097351 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.097243 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-86jkr" Jul 17 13:57:07.164592 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.164560 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:07.166900 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.166883 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5cd8l"] Jul 17 13:57:07.169687 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.169671 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5cd8l" Jul 17 13:57:07.179969 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.179928 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 17 13:57:07.180130 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.180108 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hg4xg\"" Jul 17 13:57:07.191984 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.191964 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 17 13:57:07.201884 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.201833 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5cd8l"] Jul 17 13:57:07.310027 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.309996 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:07.317006 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.316981 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf7nd\" (UniqueName: \"kubernetes.io/projected/3d263a70-7272-470e-b960-382c647f0dd1-kube-api-access-xf7nd\") pod \"insights-runtime-extractor-5cd8l\" (UID: \"3d263a70-7272-470e-b960-382c647f0dd1\") " pod="openshift-insights/insights-runtime-extractor-5cd8l" Jul 17 13:57:07.317100 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.317046 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d263a70-7272-470e-b960-382c647f0dd1-data-volume\") pod \"insights-runtime-extractor-5cd8l\" (UID: \"3d263a70-7272-470e-b960-382c647f0dd1\") " pod="openshift-insights/insights-runtime-extractor-5cd8l" Jul 17 13:57:07.317139 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.317104 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3d263a70-7272-470e-b960-382c647f0dd1-crio-socket\") pod \"insights-runtime-extractor-5cd8l\" (UID: \"3d263a70-7272-470e-b960-382c647f0dd1\") " pod="openshift-insights/insights-runtime-extractor-5cd8l" Jul 17 13:57:07.317200 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.317166 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d263a70-7272-470e-b960-382c647f0dd1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5cd8l\" (UID: \"3d263a70-7272-470e-b960-382c647f0dd1\") " pod="openshift-insights/insights-runtime-extractor-5cd8l" Jul 17 13:57:07.317314 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.317222 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d263a70-7272-470e-b960-382c647f0dd1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5cd8l\" (UID: \"3d263a70-7272-470e-b960-382c647f0dd1\") " pod="openshift-insights/insights-runtime-extractor-5cd8l" Jul 17 13:57:07.417925 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.417897 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf7nd\" (UniqueName: \"kubernetes.io/projected/3d263a70-7272-470e-b960-382c647f0dd1-kube-api-access-xf7nd\") pod \"insights-runtime-extractor-5cd8l\" (UID: \"3d263a70-7272-470e-b960-382c647f0dd1\") " pod="openshift-insights/insights-runtime-extractor-5cd8l" Jul 17 13:57:07.418062 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.417949 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d263a70-7272-470e-b960-382c647f0dd1-data-volume\") pod \"insights-runtime-extractor-5cd8l\" (UID: \"3d263a70-7272-470e-b960-382c647f0dd1\") " pod="openshift-insights/insights-runtime-extractor-5cd8l" Jul 17 13:57:07.418062 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.417970 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3d263a70-7272-470e-b960-382c647f0dd1-crio-socket\") pod \"insights-runtime-extractor-5cd8l\" (UID: \"3d263a70-7272-470e-b960-382c647f0dd1\") " pod="openshift-insights/insights-runtime-extractor-5cd8l" Jul 17 13:57:07.418062 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.418024 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d263a70-7272-470e-b960-382c647f0dd1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5cd8l\" (UID: \"3d263a70-7272-470e-b960-382c647f0dd1\") " pod="openshift-insights/insights-runtime-extractor-5cd8l" Jul 17 13:57:07.418062 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.418044 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d263a70-7272-470e-b960-382c647f0dd1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5cd8l\" (UID: \"3d263a70-7272-470e-b960-382c647f0dd1\") " pod="openshift-insights/insights-runtime-extractor-5cd8l" Jul 17 13:57:07.418258 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.418128 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3d263a70-7272-470e-b960-382c647f0dd1-crio-socket\") pod \"insights-runtime-extractor-5cd8l\" (UID: \"3d263a70-7272-470e-b960-382c647f0dd1\") " pod="openshift-insights/insights-runtime-extractor-5cd8l" Jul 17 13:57:07.418258 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:07.418161 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 13:57:07.418347 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:07.418261 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 13:57:07.418347 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:07.418271 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d263a70-7272-470e-b960-382c647f0dd1-kube-rbac-proxy-cm podName:3d263a70-7272-470e-b960-382c647f0dd1 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:07.918248545 +0000 UTC m=+46.746600871 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3d263a70-7272-470e-b960-382c647f0dd1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5cd8l" (UID: "3d263a70-7272-470e-b960-382c647f0dd1") : configmap "kube-rbac-proxy" not found Jul 17 13:57:07.418347 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:07.418332 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d263a70-7272-470e-b960-382c647f0dd1-insights-runtime-extractor-tls podName:3d263a70-7272-470e-b960-382c647f0dd1 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:07.91831328 +0000 UTC m=+46.746665626 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3d263a70-7272-470e-b960-382c647f0dd1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5cd8l" (UID: "3d263a70-7272-470e-b960-382c647f0dd1") : secret "insights-runtime-extractor-tls" not found Jul 17 13:57:07.418347 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.418335 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d263a70-7272-470e-b960-382c647f0dd1-data-volume\") pod \"insights-runtime-extractor-5cd8l\" (UID: \"3d263a70-7272-470e-b960-382c647f0dd1\") " pod="openshift-insights/insights-runtime-extractor-5cd8l" Jul 17 13:57:07.432540 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.432490 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf7nd\" (UniqueName: \"kubernetes.io/projected/3d263a70-7272-470e-b960-382c647f0dd1-kube-api-access-xf7nd\") pod \"insights-runtime-extractor-5cd8l\" (UID: \"3d263a70-7272-470e-b960-382c647f0dd1\") " pod="openshift-insights/insights-runtime-extractor-5cd8l" Jul 17 13:57:07.522777 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.522735 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:07.587032 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.586998 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:07.780569 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.780538 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:07.885497 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.885462 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:07.923549 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.923520 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d263a70-7272-470e-b960-382c647f0dd1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5cd8l\" (UID: \"3d263a70-7272-470e-b960-382c647f0dd1\") " pod="openshift-insights/insights-runtime-extractor-5cd8l" Jul 17 13:57:07.923886 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:07.923558 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d263a70-7272-470e-b960-382c647f0dd1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5cd8l\" (UID: \"3d263a70-7272-470e-b960-382c647f0dd1\") " pod="openshift-insights/insights-runtime-extractor-5cd8l" Jul 17 13:57:07.923886 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:07.923661 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 13:57:07.923886 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:07.923667 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 13:57:07.923886 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:07.923746 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d263a70-7272-470e-b960-382c647f0dd1-kube-rbac-proxy-cm podName:3d263a70-7272-470e-b960-382c647f0dd1 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:08.923729638 +0000 UTC m=+47.752081962 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3d263a70-7272-470e-b960-382c647f0dd1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5cd8l" (UID: "3d263a70-7272-470e-b960-382c647f0dd1") : configmap "kube-rbac-proxy" not found Jul 17 13:57:07.923886 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:07.923772 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d263a70-7272-470e-b960-382c647f0dd1-insights-runtime-extractor-tls podName:3d263a70-7272-470e-b960-382c647f0dd1 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:08.92376039 +0000 UTC m=+47.752112714 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3d263a70-7272-470e-b960-382c647f0dd1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5cd8l" (UID: "3d263a70-7272-470e-b960-382c647f0dd1") : secret "insights-runtime-extractor-tls" not found Jul 17 13:57:08.008711 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:08.008682 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-86jkr_c4b20c0f-f85e-488d-aee9-b772cb8738a0/console-operator/1.log" Jul 17 13:57:08.009044 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:08.009029 2565 scope.go:117] "RemoveContainer" containerID="8feb567ba8434c48fa7cb4fc0ee39406a9c54cd2b0227d4bef8d0e400f7354c7" Jul 17 13:57:08.009223 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:08.009205 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-86jkr_openshift-console-operator(c4b20c0f-f85e-488d-aee9-b772cb8738a0)\"" pod="openshift-console-operator/console-operator-565b7b569d-86jkr" podUID="c4b20c0f-f85e-488d-aee9-b772cb8738a0" Jul 17 13:57:08.931590 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:08.931556 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d263a70-7272-470e-b960-382c647f0dd1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5cd8l\" (UID: \"3d263a70-7272-470e-b960-382c647f0dd1\") " pod="openshift-insights/insights-runtime-extractor-5cd8l" Jul 17 13:57:08.931590 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:08.931594 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d263a70-7272-470e-b960-382c647f0dd1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5cd8l\" (UID: \"3d263a70-7272-470e-b960-382c647f0dd1\") " pod="openshift-insights/insights-runtime-extractor-5cd8l" Jul 17 13:57:08.931973 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:08.931686 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 13:57:08.931973 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:08.931733 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 13:57:08.931973 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:08.931752 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d263a70-7272-470e-b960-382c647f0dd1-kube-rbac-proxy-cm podName:3d263a70-7272-470e-b960-382c647f0dd1 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:10.931734598 +0000 UTC m=+49.760086923 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3d263a70-7272-470e-b960-382c647f0dd1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5cd8l" (UID: "3d263a70-7272-470e-b960-382c647f0dd1") : configmap "kube-rbac-proxy" not found Jul 17 13:57:08.931973 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:08.931769 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d263a70-7272-470e-b960-382c647f0dd1-insights-runtime-extractor-tls podName:3d263a70-7272-470e-b960-382c647f0dd1 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:10.931759349 +0000 UTC m=+49.760111686 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3d263a70-7272-470e-b960-382c647f0dd1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5cd8l" (UID: "3d263a70-7272-470e-b960-382c647f0dd1") : secret "insights-runtime-extractor-tls" not found Jul 17 13:57:09.012111 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:09.012076 2565 scope.go:117] "RemoveContainer" containerID="8feb567ba8434c48fa7cb4fc0ee39406a9c54cd2b0227d4bef8d0e400f7354c7" Jul 17 13:57:09.012340 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:09.012320 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-86jkr_openshift-console-operator(c4b20c0f-f85e-488d-aee9-b772cb8738a0)\"" pod="openshift-console-operator/console-operator-565b7b569d-86jkr" podUID="c4b20c0f-f85e-488d-aee9-b772cb8738a0" Jul 17 13:57:09.421298 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:09.421265 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:09.502111 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:09.502071 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:09.604101 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:09.604067 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:09.723469 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:09.723395 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7vl2s_a89f466c-3e1d-436f-a747-eb674d94e1ad/dns-node-resolver/0.log" Jul 17 13:57:10.360410 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:10.360353 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:10.528333 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:10.528300 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:10.599523 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:10.599488 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:10.923877 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:10.923853 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h5vnp_0f760d5c-f6ca-406b-bc61-b18d9d6182fb/node-ca/0.log" Jul 17 13:57:10.950265 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:10.950236 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d263a70-7272-470e-b960-382c647f0dd1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5cd8l\" (UID: \"3d263a70-7272-470e-b960-382c647f0dd1\") " pod="openshift-insights/insights-runtime-extractor-5cd8l" Jul 17 13:57:10.950403 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:10.950271 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d263a70-7272-470e-b960-382c647f0dd1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5cd8l\" (UID: \"3d263a70-7272-470e-b960-382c647f0dd1\") " pod="openshift-insights/insights-runtime-extractor-5cd8l" Jul 17 13:57:10.950403 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:10.950356 2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 17 13:57:10.950478 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:10.950414 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d263a70-7272-470e-b960-382c647f0dd1-kube-rbac-proxy-cm podName:3d263a70-7272-470e-b960-382c647f0dd1 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:14.950400083 +0000 UTC m=+53.778752411 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3d263a70-7272-470e-b960-382c647f0dd1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-5cd8l" (UID: "3d263a70-7272-470e-b960-382c647f0dd1") : configmap "kube-rbac-proxy" not found Jul 17 13:57:10.950478 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:10.950441 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 13:57:10.950544 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:10.950487 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d263a70-7272-470e-b960-382c647f0dd1-insights-runtime-extractor-tls podName:3d263a70-7272-470e-b960-382c647f0dd1 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:14.950475878 +0000 UTC m=+53.778828202 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3d263a70-7272-470e-b960-382c647f0dd1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5cd8l" (UID: "3d263a70-7272-470e-b960-382c647f0dd1") : secret "insights-runtime-extractor-tls" not found Jul 17 13:57:11.525130 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:11.525097 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-47dp7_a6a77fbc-7a50-43ba-9c98-3655564837f6/serve-healthcheck-canary/0.log" Jul 17 13:57:12.459979 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:12.459945 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-registry-tls\") pod \"image-registry-69588b5c66-jk8qx\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:57:12.460144 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:12.460063 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 17 13:57:12.460144 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:12.460076 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-69588b5c66-jk8qx: secret "image-registry-tls" not found Jul 17 13:57:12.460144 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:12.460135 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-registry-tls podName:abc092dc-0b98-4726-a513-94b21f1a0b26 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:28.46011716 +0000 UTC m=+67.288469504 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-registry-tls") pod "image-registry-69588b5c66-jk8qx" (UID: "abc092dc-0b98-4726-a513-94b21f1a0b26") : secret "image-registry-tls" not found Jul 17 13:57:12.524569 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:12.524536 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-phbnw_45230f7f-2bb9-4737-adf5-e47da33d503c/kube-storage-version-migrator-operator/0.log" Jul 17 13:57:12.561143 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:12.561108 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82857eb2-5266-41f0-a333-56f15ab82e28-service-ca-bundle\") pod \"router-default-76cc77cc44-b58sp\" (UID: \"82857eb2-5266-41f0-a333-56f15ab82e28\") " pod="openshift-ingress/router-default-76cc77cc44-b58sp" Jul 17 13:57:12.561569 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:12.561156 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/34186a54-c1f6-42eb-9348-9836c9885642-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nwn9r\" (UID: \"34186a54-c1f6-42eb-9348-9836c9885642\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwn9r" Jul 17 13:57:12.561569 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:12.561204 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82857eb2-5266-41f0-a333-56f15ab82e28-metrics-certs\") pod \"router-default-76cc77cc44-b58sp\" (UID: \"82857eb2-5266-41f0-a333-56f15ab82e28\") " pod="openshift-ingress/router-default-76cc77cc44-b58sp" Jul 17 13:57:12.561569 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:12.561232 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c528470-2f64-4de3-918a-9e510c262890-metrics-tls\") pod \"dns-default-qhjd8\" (UID: \"9c528470-2f64-4de3-918a-9e510c262890\") " pod="openshift-dns/dns-default-qhjd8" Jul 17 13:57:12.561569 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:12.561274 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/418f4e52-7ba5-475c-83a7-f23adbfd0f21-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-kjqdb\" (UID: \"418f4e52-7ba5-475c-83a7-f23adbfd0f21\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kjqdb" Jul 17 13:57:12.561569 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:12.561296 2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 17 13:57:12.561569 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:12.561327 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/82857eb2-5266-41f0-a333-56f15ab82e28-service-ca-bundle podName:82857eb2-5266-41f0-a333-56f15ab82e28 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:28.561306519 +0000 UTC m=+67.389658860 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/82857eb2-5266-41f0-a333-56f15ab82e28-service-ca-bundle") pod "router-default-76cc77cc44-b58sp" (UID: "82857eb2-5266-41f0-a333-56f15ab82e28") : configmap references non-existent config key: service-ca.crt Jul 17 13:57:12.561569 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:12.561332 2565 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 17 13:57:12.561569 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:12.561355 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34186a54-c1f6-42eb-9348-9836c9885642-samples-operator-tls podName:34186a54-c1f6-42eb-9348-9836c9885642 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:28.561345186 +0000 UTC m=+67.389697510 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/34186a54-c1f6-42eb-9348-9836c9885642-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-nwn9r" (UID: "34186a54-c1f6-42eb-9348-9836c9885642") : secret "samples-operator-tls" not found Jul 17 13:57:12.561569 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:12.561359 2565 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 17 13:57:12.561569 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:12.561385 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 17 13:57:12.561569 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:12.561390 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/82857eb2-5266-41f0-a333-56f15ab82e28-metrics-certs podName:82857eb2-5266-41f0-a333-56f15ab82e28 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:28.561370118 +0000 UTC m=+67.389722448 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/82857eb2-5266-41f0-a333-56f15ab82e28-metrics-certs") pod "router-default-76cc77cc44-b58sp" (UID: "82857eb2-5266-41f0-a333-56f15ab82e28") : secret "router-metrics-certs-default" not found Jul 17 13:57:12.561569 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:12.561500 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/418f4e52-7ba5-475c-83a7-f23adbfd0f21-cluster-monitoring-operator-tls podName:418f4e52-7ba5-475c-83a7-f23adbfd0f21 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:28.561489291 +0000 UTC m=+67.389841615 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/418f4e52-7ba5-475c-83a7-f23adbfd0f21-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-kjqdb" (UID: "418f4e52-7ba5-475c-83a7-f23adbfd0f21") : secret "cluster-monitoring-operator-tls" not found Jul 17 13:57:12.561569 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:12.561512 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c528470-2f64-4de3-918a-9e510c262890-metrics-tls podName:9c528470-2f64-4de3-918a-9e510c262890 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:28.561506098 +0000 UTC m=+67.389858422 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c528470-2f64-4de3-918a-9e510c262890-metrics-tls") pod "dns-default-qhjd8" (UID: "9c528470-2f64-4de3-918a-9e510c262890") : secret "dns-default-metrics-tls" not found Jul 17 13:57:12.622388 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:12.622337 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:13.400162 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:13.400120 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:13.610799 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:13.610762 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:13.711115 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:13.711035 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:13.811197 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:13.811152 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:13.919073 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:13.919036 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:13.982872 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:13.982790 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:14.509557 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:14.509526 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:14.983145 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:14.983108 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d263a70-7272-470e-b960-382c647f0dd1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5cd8l\" (UID: \"3d263a70-7272-470e-b960-382c647f0dd1\") " pod="openshift-insights/insights-runtime-extractor-5cd8l" Jul 17 13:57:14.983145 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:14.983149 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d263a70-7272-470e-b960-382c647f0dd1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5cd8l\" (UID: \"3d263a70-7272-470e-b960-382c647f0dd1\") " pod="openshift-insights/insights-runtime-extractor-5cd8l" Jul 17 13:57:14.983574 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:14.983351 2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 17 13:57:14.983574 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:14.983411 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d263a70-7272-470e-b960-382c647f0dd1-insights-runtime-extractor-tls podName:3d263a70-7272-470e-b960-382c647f0dd1 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:22.983396538 +0000 UTC m=+61.811748865 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3d263a70-7272-470e-b960-382c647f0dd1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-5cd8l" (UID: "3d263a70-7272-470e-b960-382c647f0dd1") : secret "insights-runtime-extractor-tls" not found Jul 17 13:57:14.983659 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:14.983608 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d263a70-7272-470e-b960-382c647f0dd1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5cd8l\" (UID: \"3d263a70-7272-470e-b960-382c647f0dd1\") " pod="openshift-insights/insights-runtime-extractor-5cd8l" Jul 17 13:57:15.102285 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:15.102247 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:15.709496 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:15.709463 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:15.916383 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:15.916352 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:16.118389 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:16.118351 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:16.509946 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:16.509867 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:16.799452 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:16.799418 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:17.457441 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:17.457404 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:17.730727 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:17.730639 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:17.829501 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:17.829465 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:17.929222 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:17.929166 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:18.118810 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:18.118773 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:18.227552 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:18.227495 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:18.330293 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:18.330262 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:19.515567 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:19.515532 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:19.695743 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:19.695721 2565 scope.go:117] "RemoveContainer" containerID="8feb567ba8434c48fa7cb4fc0ee39406a9c54cd2b0227d4bef8d0e400f7354c7" Jul 17 13:57:19.746583 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:19.746548 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:19.910771 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:19.910727 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:19.969029 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:19.968991 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:20.046885 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:20.046820 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-86jkr_c4b20c0f-f85e-488d-aee9-b772cb8738a0/console-operator/1.log" Jul 17 13:57:20.047009 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:20.046899 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-86jkr" event={"ID":"c4b20c0f-f85e-488d-aee9-b772cb8738a0","Type":"ContainerStarted","Data":"e6180a6826cecf875ed821610fe434efafc586031c0eca509c78c511a34d7d3e"} Jul 17 13:57:20.047202 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:20.047169 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-86jkr" Jul 17 13:57:20.066219 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:20.066156 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-86jkr" podStartSLOduration=20.343474912 podStartE2EDuration="27.066138526s" totalImagesPullingTime="6.722663614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:56:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:20.064550566 +0000 UTC m=+58.892902912" watchObservedRunningTime="2026-07-17 13:57:20.066138526 +0000 UTC m=+58.894490851" Jul 17 13:57:20.106411 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:20.106377 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:20.316788 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:20.316704 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:20.439492 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:20.439466 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-86jkr" Jul 17 13:57:20.649646 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:20.649560 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:20.765931 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:20.765895 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:20.873160 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:20.873127 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:20.943966 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:20.943898 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:21.320248 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:21.320214 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:21.390791 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:21.390762 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:21.531190 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:21.531137 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:21.603211 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:21.603116 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:21.716379 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:21.716350 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:21.805384 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:21.805350 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:21.905196 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:21.905097 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:21.943365 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:21.943343 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5rgk4" Jul 17 13:57:21.966243 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:21.966217 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:22.113630 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:22.113595 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:22.321944 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:22.321913 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:22.408228 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:22.408194 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:22.518077 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:22.518042 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:23.056295 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:23.056271 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d263a70-7272-470e-b960-382c647f0dd1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5cd8l\" (UID: \"3d263a70-7272-470e-b960-382c647f0dd1\") " pod="openshift-insights/insights-runtime-extractor-5cd8l" Jul 17 13:57:23.060530 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:23.059689 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d263a70-7272-470e-b960-382c647f0dd1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5cd8l\" (UID: \"3d263a70-7272-470e-b960-382c647f0dd1\") " pod="openshift-insights/insights-runtime-extractor-5cd8l" Jul 17 13:57:23.086213 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:23.086170 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hg4xg\"" Jul 17 13:57:23.094737 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:23.094716 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5cd8l" Jul 17 13:57:23.143172 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:23.143143 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:23.240737 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:23.240705 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:23.249247 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:23.249222 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5cd8l"] Jul 17 13:57:23.252205 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:57:23.252166 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d263a70_7272_470e_b960_382c647f0dd1.slice/crio-f9a2c3f55b5cd82992c3591460b6799462d8b48f6ebf588a243eb157d5055d5c WatchSource:0}: Error finding container f9a2c3f55b5cd82992c3591460b6799462d8b48f6ebf588a243eb157d5055d5c: Status 404 returned error can't find the container with id f9a2c3f55b5cd82992c3591460b6799462d8b48f6ebf588a243eb157d5055d5c Jul 17 13:57:23.340990 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:23.340914 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:23.736390 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:23.736314 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:23.916121 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:23.916082 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:24.063323 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:24.063276 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5cd8l" event={"ID":"3d263a70-7272-470e-b960-382c647f0dd1","Type":"ContainerStarted","Data":"f9a2c3f55b5cd82992c3591460b6799462d8b48f6ebf588a243eb157d5055d5c"} Jul 17 13:57:24.113098 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:24.113051 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:24.511055 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:24.510956 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:24.710878 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:24.710845 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:25.525247 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:25.525213 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:25.625966 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:25.625916 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:27.396342 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:27.396304 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbf9af62-a8f3-4f20-829d-6b23e69b412e-metrics-certs\") pod \"network-metrics-daemon-kbq75\" (UID: \"cbf9af62-a8f3-4f20-829d-6b23e69b412e\") " pod="openshift-multus/network-metrics-daemon-kbq75" Jul 17 13:57:27.396848 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:27.396371 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a493036-14a3-45e6-b0ac-db183e813fc8-original-pull-secret\") pod \"global-pull-secret-syncer-zjn62\" (UID: \"6a493036-14a3-45e6-b0ac-db183e813fc8\") " pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:57:27.398960 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:27.398932 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 17 13:57:27.399099 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:27.398974 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 17 13:57:27.410169 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:27.410137 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6a493036-14a3-45e6-b0ac-db183e813fc8-original-pull-secret\") pod \"global-pull-secret-syncer-zjn62\" (UID: \"6a493036-14a3-45e6-b0ac-db183e813fc8\") " pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:57:27.410639 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:27.410620 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbf9af62-a8f3-4f20-829d-6b23e69b412e-metrics-certs\") pod \"network-metrics-daemon-kbq75\" (UID: \"cbf9af62-a8f3-4f20-829d-6b23e69b412e\") " pod="openshift-multus/network-metrics-daemon-kbq75" Jul 17 13:57:27.598073 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:27.598035 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zss5k\" (UniqueName: \"kubernetes.io/projected/cd745e32-d2eb-4680-b42d-65a7410a8669-kube-api-access-zss5k\") pod \"network-check-target-g6tlt\" (UID: \"cd745e32-d2eb-4680-b42d-65a7410a8669\") " pod="openshift-network-diagnostics/network-check-target-g6tlt" Jul 17 13:57:27.600841 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:27.600815 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zss5k\" (UniqueName: \"kubernetes.io/projected/cd745e32-d2eb-4680-b42d-65a7410a8669-kube-api-access-zss5k\") pod \"network-check-target-g6tlt\" (UID: \"cd745e32-d2eb-4680-b42d-65a7410a8669\") " pod="openshift-network-diagnostics/network-check-target-g6tlt" Jul 17 13:57:27.608490 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:27.608469 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zjn62" Jul 17 13:57:27.617690 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:27.617654 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ctrdf\"" Jul 17 13:57:27.624551 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:27.624530 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hnkr8\"" Jul 17 13:57:27.625534 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:27.625519 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kbq75" Jul 17 13:57:27.633438 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:27.633410 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-g6tlt" Jul 17 13:57:28.346637 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:28.346616 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zjn62"] Jul 17 13:57:28.348911 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:57:28.348883 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a493036_14a3_45e6_b0ac_db183e813fc8.slice/crio-032cb31cee96ef3a642018ec6f6d495c89e7bae6f50aed7883e498bf05d58568 WatchSource:0}: Error finding container 032cb31cee96ef3a642018ec6f6d495c89e7bae6f50aed7883e498bf05d58568: Status 404 returned error can't find the container with id 032cb31cee96ef3a642018ec6f6d495c89e7bae6f50aed7883e498bf05d58568 Jul 17 13:57:28.508144 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:28.508067 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-registry-tls\") pod \"image-registry-69588b5c66-jk8qx\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:57:28.510519 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:28.510495 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-registry-tls\") pod \"image-registry-69588b5c66-jk8qx\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:57:28.575520 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:28.575492 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-g6tlt"] Jul 17 13:57:28.578357 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:28.578333 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kbq75"] Jul 17 13:57:28.578823 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:57:28.578774 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd745e32_d2eb_4680_b42d_65a7410a8669.slice/crio-b7891a0276f39822bc71da03ae1679a7f8cd28b207b9020901798f6fffd27a09 WatchSource:0}: Error finding container b7891a0276f39822bc71da03ae1679a7f8cd28b207b9020901798f6fffd27a09: Status 404 returned error can't find the container with id b7891a0276f39822bc71da03ae1679a7f8cd28b207b9020901798f6fffd27a09 Jul 17 13:57:28.581152 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:57:28.581130 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbf9af62_a8f3_4f20_829d_6b23e69b412e.slice/crio-ea896f085c8729e8811912cfa026e8da594d01314e71bf264531db3f5fe62c12 WatchSource:0}: Error finding container ea896f085c8729e8811912cfa026e8da594d01314e71bf264531db3f5fe62c12: Status 404 returned error can't find the container with id ea896f085c8729e8811912cfa026e8da594d01314e71bf264531db3f5fe62c12 Jul 17 13:57:28.609014 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:28.608994 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82857eb2-5266-41f0-a333-56f15ab82e28-service-ca-bundle\") pod \"router-default-76cc77cc44-b58sp\" (UID: \"82857eb2-5266-41f0-a333-56f15ab82e28\") " pod="openshift-ingress/router-default-76cc77cc44-b58sp" Jul 17 13:57:28.609110 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:28.609027 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/34186a54-c1f6-42eb-9348-9836c9885642-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nwn9r\" (UID: \"34186a54-c1f6-42eb-9348-9836c9885642\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwn9r" Jul 17 13:57:28.609110 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:28.609051 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82857eb2-5266-41f0-a333-56f15ab82e28-metrics-certs\") pod \"router-default-76cc77cc44-b58sp\" (UID: \"82857eb2-5266-41f0-a333-56f15ab82e28\") " pod="openshift-ingress/router-default-76cc77cc44-b58sp" Jul 17 13:57:28.609110 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:28.609067 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c528470-2f64-4de3-918a-9e510c262890-metrics-tls\") pod \"dns-default-qhjd8\" (UID: \"9c528470-2f64-4de3-918a-9e510c262890\") " pod="openshift-dns/dns-default-qhjd8" Jul 17 13:57:28.609110 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:28.609091 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/418f4e52-7ba5-475c-83a7-f23adbfd0f21-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-kjqdb\" (UID: \"418f4e52-7ba5-475c-83a7-f23adbfd0f21\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kjqdb" Jul 17 13:57:28.611244 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:28.611216 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/82857eb2-5266-41f0-a333-56f15ab82e28-service-ca-bundle\") pod \"router-default-76cc77cc44-b58sp\" (UID: \"82857eb2-5266-41f0-a333-56f15ab82e28\") " pod="openshift-ingress/router-default-76cc77cc44-b58sp" Jul 17 13:57:28.611912 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:28.611878 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/82857eb2-5266-41f0-a333-56f15ab82e28-metrics-certs\") pod \"router-default-76cc77cc44-b58sp\" (UID: \"82857eb2-5266-41f0-a333-56f15ab82e28\") " pod="openshift-ingress/router-default-76cc77cc44-b58sp" Jul 17 13:57:28.612382 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:28.612361 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/418f4e52-7ba5-475c-83a7-f23adbfd0f21-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-kjqdb\" (UID: \"418f4e52-7ba5-475c-83a7-f23adbfd0f21\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kjqdb" Jul 17 13:57:28.615783 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:28.615763 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/34186a54-c1f6-42eb-9348-9836c9885642-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-nwn9r\" (UID: \"34186a54-c1f6-42eb-9348-9836c9885642\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwn9r" Jul 17 13:57:28.615997 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:28.615978 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c528470-2f64-4de3-918a-9e510c262890-metrics-tls\") pod \"dns-default-qhjd8\" (UID: \"9c528470-2f64-4de3-918a-9e510c262890\") " pod="openshift-dns/dns-default-qhjd8" Jul 17 13:57:28.728202 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:28.728160 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8dzmb\"" Jul 17 13:57:28.736804 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:28.736785 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:57:28.776152 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:28.776065 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-rshch\"" Jul 17 13:57:28.782433 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:28.781375 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwn9r" Jul 17 13:57:28.787109 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:28.787088 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rt4d9\"" Jul 17 13:57:28.795326 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:28.795303 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kjqdb" Jul 17 13:57:28.839753 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:28.839518 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8sdnt\"" Jul 17 13:57:28.848685 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:28.848449 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-76cc77cc44-b58sp" Jul 17 13:57:28.854125 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:28.853915 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zf4sj\"" Jul 17 13:57:28.862619 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:28.862398 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qhjd8" Jul 17 13:57:28.924557 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:28.923849 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69588b5c66-jk8qx"] Jul 17 13:57:28.983203 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:28.983114 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwn9r"] Jul 17 13:57:29.021839 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:29.021769 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kjqdb"] Jul 17 13:57:29.044557 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:57:29.030765 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod418f4e52_7ba5_475c_83a7_f23adbfd0f21.slice/crio-711a1e6d3132d4d17e22e335c0f93ada8dab0754192a75f1161d5de77b50405c WatchSource:0}: Error finding container 711a1e6d3132d4d17e22e335c0f93ada8dab0754192a75f1161d5de77b50405c: Status 404 returned error can't find the container with id 711a1e6d3132d4d17e22e335c0f93ada8dab0754192a75f1161d5de77b50405c Jul 17 13:57:29.091676 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:29.091619 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwn9r" event={"ID":"34186a54-c1f6-42eb-9348-9836c9885642","Type":"ContainerStarted","Data":"d9bde92d5639ad05808e2593e2c6ba7ead11124f5d19e4d0c066cb92986efff4"} Jul 17 13:57:29.094803 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:29.094613 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" event={"ID":"abc092dc-0b98-4726-a513-94b21f1a0b26","Type":"ContainerStarted","Data":"a7a8f6e8e85beab74bdb5bf05b5e8e23485b022a16a1ad589db9e25da74e7e1f"} Jul 17 13:57:29.094803 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:29.094664 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" event={"ID":"abc092dc-0b98-4726-a513-94b21f1a0b26","Type":"ContainerStarted","Data":"ce6d7ebc0af327b1d4f057213ff63aa58aa3f07c79210ddd0c89a7ab99f4191e"} Jul 17 13:57:29.094803 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:29.094710 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:57:29.096962 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:29.096821 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zjn62" event={"ID":"6a493036-14a3-45e6-b0ac-db183e813fc8","Type":"ContainerStarted","Data":"032cb31cee96ef3a642018ec6f6d495c89e7bae6f50aed7883e498bf05d58568"} Jul 17 13:57:29.100810 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:29.100740 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5cd8l" event={"ID":"3d263a70-7272-470e-b960-382c647f0dd1","Type":"ContainerStarted","Data":"c92eec027c7cb188d8b9702872de08bc60dc2e6eec5dfa38e80e9d7db8714cf4"} Jul 17 13:57:29.104051 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:29.104000 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qhjd8"] Jul 17 13:57:29.105912 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:29.105849 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kjqdb" event={"ID":"418f4e52-7ba5-475c-83a7-f23adbfd0f21","Type":"ContainerStarted","Data":"711a1e6d3132d4d17e22e335c0f93ada8dab0754192a75f1161d5de77b50405c"} Jul 17 13:57:29.110112 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:29.109434 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-g6tlt" event={"ID":"cd745e32-d2eb-4680-b42d-65a7410a8669","Type":"ContainerStarted","Data":"0cc2f5f5154efb03598be3936af9ae73ba76c5c2d96b40c773179c0df7293a4e"} Jul 17 13:57:29.110112 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:29.109474 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-g6tlt" event={"ID":"cd745e32-d2eb-4680-b42d-65a7410a8669","Type":"ContainerStarted","Data":"b7891a0276f39822bc71da03ae1679a7f8cd28b207b9020901798f6fffd27a09"} Jul 17 13:57:29.110112 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:29.110012 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-g6tlt" Jul 17 13:57:29.111501 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:57:29.111329 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c528470_2f64_4de3_918a_9e510c262890.slice/crio-50a734f532283b9546b296314a98853f1a6f5ad7e59e167fe9bc277ea64966a7 WatchSource:0}: Error finding container 50a734f532283b9546b296314a98853f1a6f5ad7e59e167fe9bc277ea64966a7: Status 404 returned error can't find the container with id 50a734f532283b9546b296314a98853f1a6f5ad7e59e167fe9bc277ea64966a7 Jul 17 13:57:29.113922 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:29.113753 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kbq75" event={"ID":"cbf9af62-a8f3-4f20-829d-6b23e69b412e","Type":"ContainerStarted","Data":"ea896f085c8729e8811912cfa026e8da594d01314e71bf264531db3f5fe62c12"} Jul 17 13:57:29.120640 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:29.119868 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" podStartSLOduration=45.119850642 podStartE2EDuration="45.119850642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:56:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:29.118771589 +0000 UTC m=+67.947123936" watchObservedRunningTime="2026-07-17 13:57:29.119850642 +0000 UTC m=+67.948202994" Jul 17 13:57:29.131716 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:29.131668 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-76cc77cc44-b58sp"] Jul 17 13:57:29.135398 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:57:29.135374 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82857eb2_5266_41f0_a333_56f15ab82e28.slice/crio-471959f044f366bd624610eef398ba6854bd344fc0a6d2bd532fd3d262c1a166 WatchSource:0}: Error finding container 471959f044f366bd624610eef398ba6854bd344fc0a6d2bd532fd3d262c1a166: Status 404 returned error can't find the container with id 471959f044f366bd624610eef398ba6854bd344fc0a6d2bd532fd3d262c1a166 Jul 17 13:57:29.142436 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:29.141162 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-g6tlt" podStartSLOduration=67.141143307 podStartE2EDuration="1m7.141143307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:56:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:29.140754444 +0000 UTC m=+67.969106792" watchObservedRunningTime="2026-07-17 13:57:29.141143307 +0000 UTC m=+67.969495650" Jul 17 13:57:29.354843 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:29.354764 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:30.121490 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:30.121453 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-76cc77cc44-b58sp" event={"ID":"82857eb2-5266-41f0-a333-56f15ab82e28","Type":"ContainerStarted","Data":"8509ff367b709b4f11b93af6ab2fa8fa6e1b3c13c2c7183969163199121d8f8e"} Jul 17 13:57:30.121938 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:30.121517 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-76cc77cc44-b58sp" event={"ID":"82857eb2-5266-41f0-a333-56f15ab82e28","Type":"ContainerStarted","Data":"471959f044f366bd624610eef398ba6854bd344fc0a6d2bd532fd3d262c1a166"} Jul 17 13:57:30.124448 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:30.124420 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qhjd8" event={"ID":"9c528470-2f64-4de3-918a-9e510c262890","Type":"ContainerStarted","Data":"50a734f532283b9546b296314a98853f1a6f5ad7e59e167fe9bc277ea64966a7"} Jul 17 13:57:30.143916 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:30.143869 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-76cc77cc44-b58sp" podStartSLOduration=37.143848775 podStartE2EDuration="37.143848775s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:56:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:30.142923325 +0000 UTC m=+68.971275671" watchObservedRunningTime="2026-07-17 13:57:30.143848775 +0000 UTC m=+68.972201123" Jul 17 13:57:30.270016 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:30.269966 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:30.372880 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:30.372676 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:30.476742 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:30.476688 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:30.734684 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:30.734527 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:30.795387 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:30.795352 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:30.849912 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:30.849879 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-76cc77cc44-b58sp" Jul 17 13:57:30.853617 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:30.853393 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-76cc77cc44-b58sp" Jul 17 13:57:31.129900 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:31.129865 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kbq75" event={"ID":"cbf9af62-a8f3-4f20-829d-6b23e69b412e","Type":"ContainerStarted","Data":"a27ec38127827dd88dde6ad3bceac29ff8b1876e50a5f495ccf55128f1bf1a3c"} Jul 17 13:57:31.130357 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:31.129941 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kbq75" event={"ID":"cbf9af62-a8f3-4f20-829d-6b23e69b412e","Type":"ContainerStarted","Data":"a172af4e1cfe4c8ff0527e2e15d9296c4612419164135af88c9d24a3105c2b79"} Jul 17 13:57:31.130429 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:31.130412 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-76cc77cc44-b58sp" Jul 17 13:57:31.131650 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:31.131631 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-76cc77cc44-b58sp" Jul 17 13:57:31.150546 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:31.150484 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kbq75" podStartSLOduration=67.602041256 podStartE2EDuration="1m9.150471307s" totalImagesPullingTime="1.548430051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:56:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:31.149137264 +0000 UTC m=+69.977489610" watchObservedRunningTime="2026-07-17 13:57:31.150471307 +0000 UTC m=+69.978823652" Jul 17 13:57:31.279259 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:31.279216 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:31.377448 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:31.377415 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:35.142462 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:35.142423 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:35.205741 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:35.205706 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:35.669489 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:35.669448 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:35.768884 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:35.768829 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:35.871481 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:35.871447 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:36.152456 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:36.152319 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwn9r" event={"ID":"34186a54-c1f6-42eb-9348-9836c9885642","Type":"ContainerStarted","Data":"be2eb05552bd1724d35b99e8883bd43e4aa13b0f052eb8f3376dc50f72dea608"} Jul 17 13:57:36.152456 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:36.152420 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwn9r" event={"ID":"34186a54-c1f6-42eb-9348-9836c9885642","Type":"ContainerStarted","Data":"fe58e4ab9bd527e0cf7cb2de7e7159b7a3f316b7eefe47c74f686cb11c9886d9"} Jul 17 13:57:36.155916 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:36.154671 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zjn62" event={"ID":"6a493036-14a3-45e6-b0ac-db183e813fc8","Type":"ContainerStarted","Data":"a1eb0987521862c5c46c36f8b418b7985c18b8107eeb010f5aa3816edfb8c5a5"} Jul 17 13:57:36.157918 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:36.157700 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qhjd8" event={"ID":"9c528470-2f64-4de3-918a-9e510c262890","Type":"ContainerStarted","Data":"f33c1df34316741de17d961fa0833c0a1e4c4923f7cc595ed44a010682d0eb92"} Jul 17 13:57:36.157918 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:36.157746 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qhjd8" event={"ID":"9c528470-2f64-4de3-918a-9e510c262890","Type":"ContainerStarted","Data":"673d085600cf1dc61d26c2d851d9a2ed319567e67447cdab615829bbb7c7e1de"} Jul 17 13:57:36.157918 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:36.157806 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qhjd8" Jul 17 13:57:36.159768 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:36.159747 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5cd8l" event={"ID":"3d263a70-7272-470e-b960-382c647f0dd1","Type":"ContainerStarted","Data":"303ad91f5b1cbfac9f12d0c9e6003c071116a08ffbf38e12d0d8ee0124dae2be"} Jul 17 13:57:36.161323 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:36.161295 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kjqdb" event={"ID":"418f4e52-7ba5-475c-83a7-f23adbfd0f21","Type":"ContainerStarted","Data":"75534ca3fdebb8fd10cc54540f646e40790588633b3d6e313d0359684d18becd"} Jul 17 13:57:36.175759 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:36.175652 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-nwn9r" podStartSLOduration=36.440742254 podStartE2EDuration="43.175635021s" totalImagesPullingTime="6.734892767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:56:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:36.174424507 +0000 UTC m=+75.002776868" watchObservedRunningTime="2026-07-17 13:57:36.175635021 +0000 UTC m=+75.003987367" Jul 17 13:57:36.198917 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:36.198861 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-kjqdb" podStartSLOduration=36.433885916 podStartE2EDuration="43.198841588s" totalImagesPullingTime="6.764955672s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:56:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:36.197904796 +0000 UTC m=+75.026257145" watchObservedRunningTime="2026-07-17 13:57:36.198841588 +0000 UTC m=+75.027193935" Jul 17 13:57:36.220045 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:36.219961 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qhjd8" podStartSLOduration=33.537092268 podStartE2EDuration="40.219941801s" totalImagesPullingTime="6.682849533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:56:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:36.219309541 +0000 UTC m=+75.047661887" watchObservedRunningTime="2026-07-17 13:57:36.219941801 +0000 UTC m=+75.048294148" Jul 17 13:57:36.240266 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:36.240204 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zjn62" podStartSLOduration=66.770678918 podStartE2EDuration="1m14.240168044s" totalImagesPullingTime="7.469489126s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:56:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:36.239485761 +0000 UTC m=+75.067838109" watchObservedRunningTime="2026-07-17 13:57:36.240168044 +0000 UTC m=+75.068520383" Jul 17 13:57:36.268606 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:36.268578 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:36.441851 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:36.441745 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:36.641522 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:36.641489 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:38.547747 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:38.547703 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:38.627511 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:38.627472 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:39.352467 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:39.352434 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:39.412121 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:39.412090 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:40.181170 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:40.181135 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5cd8l" event={"ID":"3d263a70-7272-470e-b960-382c647f0dd1","Type":"ContainerStarted","Data":"d6b16f811b2527cd5b76073aa2b730498dc89173a3de746c7a54c85bba4a25e2"} Jul 17 13:57:40.206957 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:40.206909 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5cd8l" podStartSLOduration=17.176100822 podStartE2EDuration="33.206891776s" totalImagesPullingTime="16.030790954s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 13:57:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:40.20645946 +0000 UTC m=+79.034811842" watchObservedRunningTime="2026-07-17 13:57:40.206891776 +0000 UTC m=+79.035244122" Jul 17 13:57:40.564853 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:40.564799 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:40.637937 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:40.637897 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:43.433496 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:43.433375 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:43.585949 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:43.585907 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:45.482762 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:45.482717 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:45.556129 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:45.556103 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:45.635423 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:45.635396 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:46.168431 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:46.168401 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qhjd8" Jul 17 13:57:46.660240 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:46.660198 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:46.771956 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:46.771923 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:48.427360 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:48.427323 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:48.529244 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:48.529199 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:48.992332 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:48.992300 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:49.081779 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:49.081742 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:49.176227 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:49.176170 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:49.363244 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:49.363166 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:49.464306 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:49.464273 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:50.128203 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:50.128163 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:57:50.336173 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:50.336137 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:50.399325 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:50.399244 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:51.371426 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:51.371394 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:51.435537 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:51.435502 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:51.597578 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:51.597547 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:51.700016 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:51.699931 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:52.596971 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:52.596932 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:52.688467 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:52.688431 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:53.087499 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:53.087466 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-69588b5c66-jk8qx"] Jul 17 13:57:53.255954 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:53.255921 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:53.396453 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:53.396374 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:53.565486 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:53.565446 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:55.313662 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:55.313630 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:55.388056 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:55.388019 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:55.617954 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:55.617869 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:55.783335 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:55.783301 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:55.874275 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:55.874202 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-djf6w"] Jul 17 13:57:55.877769 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:55.877742 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:55.878741 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:55.878722 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djf6w" Jul 17 13:57:55.880889 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:55.880864 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 17 13:57:55.881014 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:55.880904 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 17 13:57:55.881213 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:55.881194 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 17 13:57:55.881315 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:55.881216 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-hdbc9\"" Jul 17 13:57:55.890880 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:55.890862 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-djf6w"] Jul 17 13:57:55.913100 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:55.913078 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nn6ks"] Jul 17 13:57:55.918443 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:55.918423 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nn6ks" Jul 17 13:57:55.920412 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:55.920372 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 17 13:57:55.920521 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:55.920413 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2dlxn\"" Jul 17 13:57:55.920521 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:55.920425 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 17 13:57:55.920660 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:55.920642 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 17 13:57:55.958293 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:55.958262 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:56.033526 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.033495 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c2a3578-fd94-493b-9e16-2f4c957213e0-sys\") pod \"node-exporter-nn6ks\" (UID: \"6c2a3578-fd94-493b-9e16-2f4c957213e0\") " pod="openshift-monitoring/node-exporter-nn6ks" Jul 17 13:57:56.033690 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.033540 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c2a3578-fd94-493b-9e16-2f4c957213e0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nn6ks\" (UID: \"6c2a3578-fd94-493b-9e16-2f4c957213e0\") " pod="openshift-monitoring/node-exporter-nn6ks" Jul 17 13:57:56.033690 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.033568 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6c2a3578-fd94-493b-9e16-2f4c957213e0-node-exporter-accelerators-collector-config\") pod \"node-exporter-nn6ks\" (UID: \"6c2a3578-fd94-493b-9e16-2f4c957213e0\") " pod="openshift-monitoring/node-exporter-nn6ks" Jul 17 13:57:56.033690 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.033620 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6c2a3578-fd94-493b-9e16-2f4c957213e0-node-exporter-wtmp\") pod \"node-exporter-nn6ks\" (UID: \"6c2a3578-fd94-493b-9e16-2f4c957213e0\") " pod="openshift-monitoring/node-exporter-nn6ks" Jul 17 13:57:56.033690 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.033643 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6c2a3578-fd94-493b-9e16-2f4c957213e0-node-exporter-textfile\") pod \"node-exporter-nn6ks\" (UID: \"6c2a3578-fd94-493b-9e16-2f4c957213e0\") " pod="openshift-monitoring/node-exporter-nn6ks" Jul 17 13:57:56.033690 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.033664 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x894r\" (UniqueName: \"kubernetes.io/projected/80a082ab-8450-4eb7-b646-1692ce6e24d1-kube-api-access-x894r\") pod \"openshift-state-metrics-79f6958cdf-djf6w\" (UID: \"80a082ab-8450-4eb7-b646-1692ce6e24d1\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djf6w" Jul 17 13:57:56.033690 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.033680 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c2a3578-fd94-493b-9e16-2f4c957213e0-metrics-client-ca\") pod \"node-exporter-nn6ks\" (UID: \"6c2a3578-fd94-493b-9e16-2f4c957213e0\") " pod="openshift-monitoring/node-exporter-nn6ks" Jul 17 13:57:56.033903 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.033711 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80a082ab-8450-4eb7-b646-1692ce6e24d1-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-djf6w\" (UID: \"80a082ab-8450-4eb7-b646-1692ce6e24d1\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djf6w" Jul 17 13:57:56.033903 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.033736 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6c2a3578-fd94-493b-9e16-2f4c957213e0-root\") pod \"node-exporter-nn6ks\" (UID: \"6c2a3578-fd94-493b-9e16-2f4c957213e0\") " pod="openshift-monitoring/node-exporter-nn6ks" Jul 17 13:57:56.033903 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.033757 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6c2a3578-fd94-493b-9e16-2f4c957213e0-node-exporter-tls\") pod \"node-exporter-nn6ks\" (UID: \"6c2a3578-fd94-493b-9e16-2f4c957213e0\") " pod="openshift-monitoring/node-exporter-nn6ks" Jul 17 13:57:56.033903 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.033778 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/80a082ab-8450-4eb7-b646-1692ce6e24d1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-djf6w\" (UID: \"80a082ab-8450-4eb7-b646-1692ce6e24d1\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djf6w" Jul 17 13:57:56.033903 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.033829 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlkjr\" (UniqueName: \"kubernetes.io/projected/6c2a3578-fd94-493b-9e16-2f4c957213e0-kube-api-access-tlkjr\") pod \"node-exporter-nn6ks\" (UID: \"6c2a3578-fd94-493b-9e16-2f4c957213e0\") " pod="openshift-monitoring/node-exporter-nn6ks" Jul 17 13:57:56.034072 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.033909 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80a082ab-8450-4eb7-b646-1692ce6e24d1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-djf6w\" (UID: \"80a082ab-8450-4eb7-b646-1692ce6e24d1\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djf6w" Jul 17 13:57:56.050667 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.050637 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:56.134411 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.134330 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6c2a3578-fd94-493b-9e16-2f4c957213e0-node-exporter-tls\") pod \"node-exporter-nn6ks\" (UID: \"6c2a3578-fd94-493b-9e16-2f4c957213e0\") " pod="openshift-monitoring/node-exporter-nn6ks" Jul 17 13:57:56.134411 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.134367 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/80a082ab-8450-4eb7-b646-1692ce6e24d1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-djf6w\" (UID: \"80a082ab-8450-4eb7-b646-1692ce6e24d1\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djf6w" Jul 17 13:57:56.134411 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.134388 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlkjr\" (UniqueName: \"kubernetes.io/projected/6c2a3578-fd94-493b-9e16-2f4c957213e0-kube-api-access-tlkjr\") pod \"node-exporter-nn6ks\" (UID: \"6c2a3578-fd94-493b-9e16-2f4c957213e0\") " pod="openshift-monitoring/node-exporter-nn6ks" Jul 17 13:57:56.134690 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.134419 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80a082ab-8450-4eb7-b646-1692ce6e24d1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-djf6w\" (UID: \"80a082ab-8450-4eb7-b646-1692ce6e24d1\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djf6w" Jul 17 13:57:56.134690 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.134445 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c2a3578-fd94-493b-9e16-2f4c957213e0-sys\") pod \"node-exporter-nn6ks\" (UID: \"6c2a3578-fd94-493b-9e16-2f4c957213e0\") " pod="openshift-monitoring/node-exporter-nn6ks" Jul 17 13:57:56.134690 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.134477 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c2a3578-fd94-493b-9e16-2f4c957213e0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nn6ks\" (UID: \"6c2a3578-fd94-493b-9e16-2f4c957213e0\") " pod="openshift-monitoring/node-exporter-nn6ks" Jul 17 13:57:56.134690 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.134493 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6c2a3578-fd94-493b-9e16-2f4c957213e0-node-exporter-accelerators-collector-config\") pod \"node-exporter-nn6ks\" (UID: \"6c2a3578-fd94-493b-9e16-2f4c957213e0\") " pod="openshift-monitoring/node-exporter-nn6ks" Jul 17 13:57:56.134690 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:56.134500 2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 17 13:57:56.134690 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.134553 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6c2a3578-fd94-493b-9e16-2f4c957213e0-sys\") pod \"node-exporter-nn6ks\" (UID: \"6c2a3578-fd94-493b-9e16-2f4c957213e0\") " pod="openshift-monitoring/node-exporter-nn6ks" Jul 17 13:57:56.134690 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:56.134572 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c2a3578-fd94-493b-9e16-2f4c957213e0-node-exporter-tls podName:6c2a3578-fd94-493b-9e16-2f4c957213e0 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:56.634551085 +0000 UTC m=+95.462903422 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/6c2a3578-fd94-493b-9e16-2f4c957213e0-node-exporter-tls") pod "node-exporter-nn6ks" (UID: "6c2a3578-fd94-493b-9e16-2f4c957213e0") : secret "node-exporter-tls" not found Jul 17 13:57:56.134690 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.134636 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6c2a3578-fd94-493b-9e16-2f4c957213e0-node-exporter-wtmp\") pod \"node-exporter-nn6ks\" (UID: \"6c2a3578-fd94-493b-9e16-2f4c957213e0\") " pod="openshift-monitoring/node-exporter-nn6ks" Jul 17 13:57:56.134690 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:56.134664 2565 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 17 13:57:56.134690 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.134672 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6c2a3578-fd94-493b-9e16-2f4c957213e0-node-exporter-textfile\") pod \"node-exporter-nn6ks\" (UID: \"6c2a3578-fd94-493b-9e16-2f4c957213e0\") " pod="openshift-monitoring/node-exporter-nn6ks" Jul 17 13:57:56.135155 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:57:56.134752 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/80a082ab-8450-4eb7-b646-1692ce6e24d1-openshift-state-metrics-tls podName:80a082ab-8450-4eb7-b646-1692ce6e24d1 nodeName:}" failed. No retries permitted until 2026-07-17 13:57:56.634726752 +0000 UTC m=+95.463079093 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/80a082ab-8450-4eb7-b646-1692ce6e24d1-openshift-state-metrics-tls") pod "openshift-state-metrics-79f6958cdf-djf6w" (UID: "80a082ab-8450-4eb7-b646-1692ce6e24d1") : secret "openshift-state-metrics-tls" not found Jul 17 13:57:56.135155 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.134810 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6c2a3578-fd94-493b-9e16-2f4c957213e0-node-exporter-wtmp\") pod \"node-exporter-nn6ks\" (UID: \"6c2a3578-fd94-493b-9e16-2f4c957213e0\") " pod="openshift-monitoring/node-exporter-nn6ks" Jul 17 13:57:56.135155 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.134800 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x894r\" (UniqueName: \"kubernetes.io/projected/80a082ab-8450-4eb7-b646-1692ce6e24d1-kube-api-access-x894r\") pod \"openshift-state-metrics-79f6958cdf-djf6w\" (UID: \"80a082ab-8450-4eb7-b646-1692ce6e24d1\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djf6w" Jul 17 13:57:56.135155 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.134864 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c2a3578-fd94-493b-9e16-2f4c957213e0-metrics-client-ca\") pod \"node-exporter-nn6ks\" (UID: \"6c2a3578-fd94-493b-9e16-2f4c957213e0\") " pod="openshift-monitoring/node-exporter-nn6ks" Jul 17 13:57:56.135155 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.134901 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80a082ab-8450-4eb7-b646-1692ce6e24d1-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-djf6w\" (UID: \"80a082ab-8450-4eb7-b646-1692ce6e24d1\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djf6w" Jul 17 13:57:56.135155 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.134930 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6c2a3578-fd94-493b-9e16-2f4c957213e0-root\") pod \"node-exporter-nn6ks\" (UID: \"6c2a3578-fd94-493b-9e16-2f4c957213e0\") " pod="openshift-monitoring/node-exporter-nn6ks" Jul 17 13:57:56.135155 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.135011 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6c2a3578-fd94-493b-9e16-2f4c957213e0-root\") pod \"node-exporter-nn6ks\" (UID: \"6c2a3578-fd94-493b-9e16-2f4c957213e0\") " pod="openshift-monitoring/node-exporter-nn6ks" Jul 17 13:57:56.135155 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.135124 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6c2a3578-fd94-493b-9e16-2f4c957213e0-node-exporter-textfile\") pod \"node-exporter-nn6ks\" (UID: \"6c2a3578-fd94-493b-9e16-2f4c957213e0\") " pod="openshift-monitoring/node-exporter-nn6ks" Jul 17 13:57:56.135529 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.135214 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6c2a3578-fd94-493b-9e16-2f4c957213e0-node-exporter-accelerators-collector-config\") pod \"node-exporter-nn6ks\" (UID: \"6c2a3578-fd94-493b-9e16-2f4c957213e0\") " pod="openshift-monitoring/node-exporter-nn6ks" Jul 17 13:57:56.135529 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.135394 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6c2a3578-fd94-493b-9e16-2f4c957213e0-metrics-client-ca\") pod \"node-exporter-nn6ks\" (UID: \"6c2a3578-fd94-493b-9e16-2f4c957213e0\") " pod="openshift-monitoring/node-exporter-nn6ks" Jul 17 13:57:56.135878 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.135857 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80a082ab-8450-4eb7-b646-1692ce6e24d1-metrics-client-ca\") pod \"openshift-state-metrics-79f6958cdf-djf6w\" (UID: \"80a082ab-8450-4eb7-b646-1692ce6e24d1\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djf6w" Jul 17 13:57:56.137112 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.137083 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/80a082ab-8450-4eb7-b646-1692ce6e24d1-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-79f6958cdf-djf6w\" (UID: \"80a082ab-8450-4eb7-b646-1692ce6e24d1\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djf6w" Jul 17 13:57:56.137259 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.137219 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6c2a3578-fd94-493b-9e16-2f4c957213e0-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nn6ks\" (UID: \"6c2a3578-fd94-493b-9e16-2f4c957213e0\") " pod="openshift-monitoring/node-exporter-nn6ks" Jul 17 13:57:56.143612 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.143589 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlkjr\" (UniqueName: \"kubernetes.io/projected/6c2a3578-fd94-493b-9e16-2f4c957213e0-kube-api-access-tlkjr\") pod \"node-exporter-nn6ks\" (UID: \"6c2a3578-fd94-493b-9e16-2f4c957213e0\") " pod="openshift-monitoring/node-exporter-nn6ks" Jul 17 13:57:56.143779 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.143692 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x894r\" (UniqueName: \"kubernetes.io/projected/80a082ab-8450-4eb7-b646-1692ce6e24d1-kube-api-access-x894r\") pod \"openshift-state-metrics-79f6958cdf-djf6w\" (UID: \"80a082ab-8450-4eb7-b646-1692ce6e24d1\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djf6w" Jul 17 13:57:56.256679 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.256629 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:56.355042 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.355005 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:56.454942 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.454860 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:56.639234 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.639205 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6c2a3578-fd94-493b-9e16-2f4c957213e0-node-exporter-tls\") pod \"node-exporter-nn6ks\" (UID: \"6c2a3578-fd94-493b-9e16-2f4c957213e0\") " pod="openshift-monitoring/node-exporter-nn6ks" Jul 17 13:57:56.639416 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.639248 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/80a082ab-8450-4eb7-b646-1692ce6e24d1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-djf6w\" (UID: \"80a082ab-8450-4eb7-b646-1692ce6e24d1\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djf6w" Jul 17 13:57:56.641763 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.641742 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6c2a3578-fd94-493b-9e16-2f4c957213e0-node-exporter-tls\") pod \"node-exporter-nn6ks\" (UID: \"6c2a3578-fd94-493b-9e16-2f4c957213e0\") " pod="openshift-monitoring/node-exporter-nn6ks" Jul 17 13:57:56.641887 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.641869 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/80a082ab-8450-4eb7-b646-1692ce6e24d1-openshift-state-metrics-tls\") pod \"openshift-state-metrics-79f6958cdf-djf6w\" (UID: \"80a082ab-8450-4eb7-b646-1692ce6e24d1\") " pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djf6w" Jul 17 13:57:56.787310 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.787280 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djf6w" Jul 17 13:57:56.827429 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.827395 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nn6ks" Jul 17 13:57:56.839875 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:57:56.839830 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c2a3578_fd94_493b_9e16_2f4c957213e0.slice/crio-0d6be8a062a7df7f8823ee8da15c59ed21eddaef7465661919f59ddcab6b9b6f WatchSource:0}: Error finding container 0d6be8a062a7df7f8823ee8da15c59ed21eddaef7465661919f59ddcab6b9b6f: Status 404 returned error can't find the container with id 0d6be8a062a7df7f8823ee8da15c59ed21eddaef7465661919f59ddcab6b9b6f Jul 17 13:57:56.863571 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.863532 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:56.934192 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.934142 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-79f6958cdf-djf6w"] Jul 17 13:57:56.937358 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:57:56.937333 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80a082ab_8450_4eb7_b646_1692ce6e24d1.slice/crio-f3cfbd4c43bcec7044a5cfdd79e7b9cbcbcb1b4849cae52e5b945eb122cec205 WatchSource:0}: Error finding container f3cfbd4c43bcec7044a5cfdd79e7b9cbcbcb1b4849cae52e5b945eb122cec205: Status 404 returned error can't find the container with id f3cfbd4c43bcec7044a5cfdd79e7b9cbcbcb1b4849cae52e5b945eb122cec205 Jul 17 13:57:56.966086 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:56.966057 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:57.074026 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:57.073992 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:57.245550 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:57.245512 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djf6w" event={"ID":"80a082ab-8450-4eb7-b646-1692ce6e24d1","Type":"ContainerStarted","Data":"75fc8b014e6d98596d6c8920222a173d3eaa32b78e9e9f994656b4d12362d19b"} Jul 17 13:57:57.245729 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:57.245580 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djf6w" event={"ID":"80a082ab-8450-4eb7-b646-1692ce6e24d1","Type":"ContainerStarted","Data":"3bce68f99708a85f83d94eda512cdf38f1d26714b08084b4e7ac1b934f3b078b"} Jul 17 13:57:57.245729 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:57.245602 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djf6w" event={"ID":"80a082ab-8450-4eb7-b646-1692ce6e24d1","Type":"ContainerStarted","Data":"f3cfbd4c43bcec7044a5cfdd79e7b9cbcbcb1b4849cae52e5b945eb122cec205"} Jul 17 13:57:57.247073 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:57.247042 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nn6ks" event={"ID":"6c2a3578-fd94-493b-9e16-2f4c957213e0","Type":"ContainerStarted","Data":"0d6be8a062a7df7f8823ee8da15c59ed21eddaef7465661919f59ddcab6b9b6f"} Jul 17 13:57:57.779446 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:57.779413 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:58.254040 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:58.254002 2565 generic.go:356] "Generic (PLEG): container finished" podID="6c2a3578-fd94-493b-9e16-2f4c957213e0" containerID="4acffa1cac43c2053c739e0ef78042fce3f067fbf1dc7514fcebc1d9c2e859bc" exitCode=0 Jul 17 13:57:58.254253 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:58.254094 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nn6ks" event={"ID":"6c2a3578-fd94-493b-9e16-2f4c957213e0","Type":"ContainerDied","Data":"4acffa1cac43c2053c739e0ef78042fce3f067fbf1dc7514fcebc1d9c2e859bc"} Jul 17 13:57:58.920805 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:58.920770 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:58.963835 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:58.963806 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6f6b675695-l9d94"] Jul 17 13:57:58.967388 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:58.967373 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" Jul 17 13:57:58.973010 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:58.972981 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 17 13:57:58.973010 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:58.972999 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 17 13:57:58.973227 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:58.973003 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 17 13:57:58.973227 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:58.973084 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 17 13:57:58.973323 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:58.973298 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-cml9k7egoqdvi\"" Jul 17 13:57:58.973580 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:58.973562 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 17 13:57:58.973691 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:58.973675 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wphrl\"" Jul 17 13:57:58.982911 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:58.982889 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6f6b675695-l9d94"] Jul 17 13:57:59.020577 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.020540 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:59.057074 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.057046 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3810dd92-7808-4834-9140-7bff1ea942a1-secret-thanos-querier-tls\") pod \"thanos-querier-6f6b675695-l9d94\" (UID: \"3810dd92-7808-4834-9140-7bff1ea942a1\") " pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" Jul 17 13:57:59.057223 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.057082 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3810dd92-7808-4834-9140-7bff1ea942a1-metrics-client-ca\") pod \"thanos-querier-6f6b675695-l9d94\" (UID: \"3810dd92-7808-4834-9140-7bff1ea942a1\") " pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" Jul 17 13:57:59.057223 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.057109 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3810dd92-7808-4834-9140-7bff1ea942a1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6f6b675695-l9d94\" (UID: \"3810dd92-7808-4834-9140-7bff1ea942a1\") " pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" Jul 17 13:57:59.057223 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.057129 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3810dd92-7808-4834-9140-7bff1ea942a1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6f6b675695-l9d94\" (UID: \"3810dd92-7808-4834-9140-7bff1ea942a1\") " pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" Jul 17 13:57:59.057223 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.057201 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3810dd92-7808-4834-9140-7bff1ea942a1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6f6b675695-l9d94\" (UID: \"3810dd92-7808-4834-9140-7bff1ea942a1\") " pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" Jul 17 13:57:59.057377 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.057234 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3810dd92-7808-4834-9140-7bff1ea942a1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6f6b675695-l9d94\" (UID: \"3810dd92-7808-4834-9140-7bff1ea942a1\") " pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" Jul 17 13:57:59.057377 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.057268 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3810dd92-7808-4834-9140-7bff1ea942a1-secret-grpc-tls\") pod \"thanos-querier-6f6b675695-l9d94\" (UID: \"3810dd92-7808-4834-9140-7bff1ea942a1\") " pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" Jul 17 13:57:59.057377 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.057300 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgz64\" (UniqueName: \"kubernetes.io/projected/3810dd92-7808-4834-9140-7bff1ea942a1-kube-api-access-mgz64\") pod \"thanos-querier-6f6b675695-l9d94\" (UID: \"3810dd92-7808-4834-9140-7bff1ea942a1\") " pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" Jul 17 13:57:59.145562 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.145526 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:59.157616 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.157593 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3810dd92-7808-4834-9140-7bff1ea942a1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6f6b675695-l9d94\" (UID: \"3810dd92-7808-4834-9140-7bff1ea942a1\") " pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" Jul 17 13:57:59.157687 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.157624 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3810dd92-7808-4834-9140-7bff1ea942a1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6f6b675695-l9d94\" (UID: \"3810dd92-7808-4834-9140-7bff1ea942a1\") " pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" Jul 17 13:57:59.157687 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.157645 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3810dd92-7808-4834-9140-7bff1ea942a1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6f6b675695-l9d94\" (UID: \"3810dd92-7808-4834-9140-7bff1ea942a1\") " pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" Jul 17 13:57:59.157687 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.157668 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3810dd92-7808-4834-9140-7bff1ea942a1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6f6b675695-l9d94\" (UID: \"3810dd92-7808-4834-9140-7bff1ea942a1\") " pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" Jul 17 13:57:59.157813 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.157701 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3810dd92-7808-4834-9140-7bff1ea942a1-secret-grpc-tls\") pod \"thanos-querier-6f6b675695-l9d94\" (UID: \"3810dd92-7808-4834-9140-7bff1ea942a1\") " pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" Jul 17 13:57:59.157813 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.157791 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgz64\" (UniqueName: \"kubernetes.io/projected/3810dd92-7808-4834-9140-7bff1ea942a1-kube-api-access-mgz64\") pod \"thanos-querier-6f6b675695-l9d94\" (UID: \"3810dd92-7808-4834-9140-7bff1ea942a1\") " pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" Jul 17 13:57:59.157904 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.157881 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3810dd92-7808-4834-9140-7bff1ea942a1-secret-thanos-querier-tls\") pod \"thanos-querier-6f6b675695-l9d94\" (UID: \"3810dd92-7808-4834-9140-7bff1ea942a1\") " pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" Jul 17 13:57:59.157954 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.157909 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3810dd92-7808-4834-9140-7bff1ea942a1-metrics-client-ca\") pod \"thanos-querier-6f6b675695-l9d94\" (UID: \"3810dd92-7808-4834-9140-7bff1ea942a1\") " pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" Jul 17 13:57:59.158850 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.158823 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3810dd92-7808-4834-9140-7bff1ea942a1-metrics-client-ca\") pod \"thanos-querier-6f6b675695-l9d94\" (UID: \"3810dd92-7808-4834-9140-7bff1ea942a1\") " pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" Jul 17 13:57:59.160443 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.160410 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3810dd92-7808-4834-9140-7bff1ea942a1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6f6b675695-l9d94\" (UID: \"3810dd92-7808-4834-9140-7bff1ea942a1\") " pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" Jul 17 13:57:59.160550 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.160479 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3810dd92-7808-4834-9140-7bff1ea942a1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6f6b675695-l9d94\" (UID: \"3810dd92-7808-4834-9140-7bff1ea942a1\") " pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" Jul 17 13:57:59.160757 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.160735 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3810dd92-7808-4834-9140-7bff1ea942a1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6f6b675695-l9d94\" (UID: \"3810dd92-7808-4834-9140-7bff1ea942a1\") " pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" Jul 17 13:57:59.160816 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.160802 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3810dd92-7808-4834-9140-7bff1ea942a1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6f6b675695-l9d94\" (UID: \"3810dd92-7808-4834-9140-7bff1ea942a1\") " pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" Jul 17 13:57:59.160973 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.160957 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3810dd92-7808-4834-9140-7bff1ea942a1-secret-grpc-tls\") pod \"thanos-querier-6f6b675695-l9d94\" (UID: \"3810dd92-7808-4834-9140-7bff1ea942a1\") " pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" Jul 17 13:57:59.161221 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.161201 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3810dd92-7808-4834-9140-7bff1ea942a1-secret-thanos-querier-tls\") pod \"thanos-querier-6f6b675695-l9d94\" (UID: \"3810dd92-7808-4834-9140-7bff1ea942a1\") " pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" Jul 17 13:57:59.170751 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.170733 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgz64\" (UniqueName: \"kubernetes.io/projected/3810dd92-7808-4834-9140-7bff1ea942a1-kube-api-access-mgz64\") pod \"thanos-querier-6f6b675695-l9d94\" (UID: \"3810dd92-7808-4834-9140-7bff1ea942a1\") " pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" Jul 17 13:57:59.228248 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.228166 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:57:59.259823 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.259797 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nn6ks" event={"ID":"6c2a3578-fd94-493b-9e16-2f4c957213e0","Type":"ContainerStarted","Data":"4ae2f17778bbf22a6e8119e71abca381552f15f4b454df25a830b271616fb675"} Jul 17 13:57:59.259936 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.259845 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nn6ks" event={"ID":"6c2a3578-fd94-493b-9e16-2f4c957213e0","Type":"ContainerStarted","Data":"8730767b4140c08b7be7abfd6651802e8a3d169bc5c4c5367f615b02d45f9e79"} Jul 17 13:57:59.261886 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.261857 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djf6w" event={"ID":"80a082ab-8450-4eb7-b646-1692ce6e24d1","Type":"ContainerStarted","Data":"41c3bf699238d4ae75587127626a41254b99f822323d84d27484113b49152a11"} Jul 17 13:57:59.280491 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.280448 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" Jul 17 13:57:59.280627 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.280591 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nn6ks" podStartSLOduration=3.37893428 podStartE2EDuration="4.280578836s" totalImagesPullingTime="830.181886ms" totalInitContainerRuntime="71.46267ms" isStatefulPod=true podCreationTimestamp="2026-07-17 13:57:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:59.279526794 +0000 UTC m=+98.107879140" watchObservedRunningTime="2026-07-17 13:57:59.280578836 +0000 UTC m=+98.108931181" Jul 17 13:57:59.301837 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.301796 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-79f6958cdf-djf6w" podStartSLOduration=3.024195297 podStartE2EDuration="4.301781352s" totalImagesPullingTime="1.277586055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:57:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:57:59.300575346 +0000 UTC m=+98.128927685" watchObservedRunningTime="2026-07-17 13:57:59.301781352 +0000 UTC m=+98.130133698" Jul 17 13:57:59.422334 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.422303 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6f6b675695-l9d94"] Jul 17 13:57:59.425757 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:57:59.425726 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3810dd92_7808_4834_9140_7bff1ea942a1.slice/crio-1bdb657cfd5acf62fabb706d87cd820dc6a31774c104badc8c0c987ca7d0abe6 WatchSource:0}: Error finding container 1bdb657cfd5acf62fabb706d87cd820dc6a31774c104badc8c0c987ca7d0abe6: Status 404 returned error can't find the container with id 1bdb657cfd5acf62fabb706d87cd820dc6a31774c104badc8c0c987ca7d0abe6 Jul 17 13:57:59.692589 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:57:59.692556 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:58:00.268771 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:00.268728 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" event={"ID":"3810dd92-7808-4834-9140-7bff1ea942a1","Type":"ContainerStarted","Data":"1bdb657cfd5acf62fabb706d87cd820dc6a31774c104badc8c0c987ca7d0abe6"} Jul 17 13:58:00.684774 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:00.684724 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:58:00.765463 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:00.765431 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:58:00.861808 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:00.861754 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:58:00.936944 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:00.936867 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:58:01.108196 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.108153 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-ccbf95c6c-bnmzs"] Jul 17 13:58:01.131531 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.131497 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-ccbf95c6c-bnmzs"] Jul 17 13:58:01.131713 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.131639 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-ccbf95c6c-bnmzs" Jul 17 13:58:01.132983 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.132961 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-g6tlt" Jul 17 13:58:01.136427 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.136407 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 17 13:58:01.136560 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.136545 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-zl9h5\"" Jul 17 13:58:01.136947 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.136929 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 17 13:58:01.137455 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.137172 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 17 13:58:01.137455 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.137406 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 17 13:58:01.140932 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.140909 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 17 13:58:01.144150 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.144132 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 17 13:58:01.173864 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.173831 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9fc89814-a55f-4311-86ae-c79d44efe0bb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-ccbf95c6c-bnmzs\" (UID: \"9fc89814-a55f-4311-86ae-c79d44efe0bb\") " pod="openshift-monitoring/telemeter-client-ccbf95c6c-bnmzs" Jul 17 13:58:01.174045 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.173945 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fc89814-a55f-4311-86ae-c79d44efe0bb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-ccbf95c6c-bnmzs\" (UID: \"9fc89814-a55f-4311-86ae-c79d44efe0bb\") " pod="openshift-monitoring/telemeter-client-ccbf95c6c-bnmzs" Jul 17 13:58:01.174045 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.174018 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fc89814-a55f-4311-86ae-c79d44efe0bb-metrics-client-ca\") pod \"telemeter-client-ccbf95c6c-bnmzs\" (UID: \"9fc89814-a55f-4311-86ae-c79d44efe0bb\") " pod="openshift-monitoring/telemeter-client-ccbf95c6c-bnmzs" Jul 17 13:58:01.174168 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.174054 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fc89814-a55f-4311-86ae-c79d44efe0bb-serving-certs-ca-bundle\") pod \"telemeter-client-ccbf95c6c-bnmzs\" (UID: \"9fc89814-a55f-4311-86ae-c79d44efe0bb\") " pod="openshift-monitoring/telemeter-client-ccbf95c6c-bnmzs" Jul 17 13:58:01.174168 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.174120 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54ffv\" (UniqueName: \"kubernetes.io/projected/9fc89814-a55f-4311-86ae-c79d44efe0bb-kube-api-access-54ffv\") pod \"telemeter-client-ccbf95c6c-bnmzs\" (UID: \"9fc89814-a55f-4311-86ae-c79d44efe0bb\") " pod="openshift-monitoring/telemeter-client-ccbf95c6c-bnmzs" Jul 17 13:58:01.174289 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.174206 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9fc89814-a55f-4311-86ae-c79d44efe0bb-secret-telemeter-client\") pod \"telemeter-client-ccbf95c6c-bnmzs\" (UID: \"9fc89814-a55f-4311-86ae-c79d44efe0bb\") " pod="openshift-monitoring/telemeter-client-ccbf95c6c-bnmzs" Jul 17 13:58:01.174289 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.174233 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9fc89814-a55f-4311-86ae-c79d44efe0bb-federate-client-tls\") pod \"telemeter-client-ccbf95c6c-bnmzs\" (UID: \"9fc89814-a55f-4311-86ae-c79d44efe0bb\") " pod="openshift-monitoring/telemeter-client-ccbf95c6c-bnmzs" Jul 17 13:58:01.174383 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.174302 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9fc89814-a55f-4311-86ae-c79d44efe0bb-telemeter-client-tls\") pod \"telemeter-client-ccbf95c6c-bnmzs\" (UID: \"9fc89814-a55f-4311-86ae-c79d44efe0bb\") " pod="openshift-monitoring/telemeter-client-ccbf95c6c-bnmzs" Jul 17 13:58:01.214744 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.214660 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:58:01.275123 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.275086 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9fc89814-a55f-4311-86ae-c79d44efe0bb-telemeter-client-tls\") pod \"telemeter-client-ccbf95c6c-bnmzs\" (UID: \"9fc89814-a55f-4311-86ae-c79d44efe0bb\") " pod="openshift-monitoring/telemeter-client-ccbf95c6c-bnmzs" Jul 17 13:58:01.275123 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.275130 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9fc89814-a55f-4311-86ae-c79d44efe0bb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-ccbf95c6c-bnmzs\" (UID: \"9fc89814-a55f-4311-86ae-c79d44efe0bb\") " pod="openshift-monitoring/telemeter-client-ccbf95c6c-bnmzs" Jul 17 13:58:01.275537 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.275201 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fc89814-a55f-4311-86ae-c79d44efe0bb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-ccbf95c6c-bnmzs\" (UID: \"9fc89814-a55f-4311-86ae-c79d44efe0bb\") " pod="openshift-monitoring/telemeter-client-ccbf95c6c-bnmzs" Jul 17 13:58:01.275537 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.275256 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fc89814-a55f-4311-86ae-c79d44efe0bb-metrics-client-ca\") pod \"telemeter-client-ccbf95c6c-bnmzs\" (UID: \"9fc89814-a55f-4311-86ae-c79d44efe0bb\") " pod="openshift-monitoring/telemeter-client-ccbf95c6c-bnmzs" Jul 17 13:58:01.275537 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.275285 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fc89814-a55f-4311-86ae-c79d44efe0bb-serving-certs-ca-bundle\") pod \"telemeter-client-ccbf95c6c-bnmzs\" (UID: \"9fc89814-a55f-4311-86ae-c79d44efe0bb\") " pod="openshift-monitoring/telemeter-client-ccbf95c6c-bnmzs" Jul 17 13:58:01.275537 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.275310 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54ffv\" (UniqueName: \"kubernetes.io/projected/9fc89814-a55f-4311-86ae-c79d44efe0bb-kube-api-access-54ffv\") pod \"telemeter-client-ccbf95c6c-bnmzs\" (UID: \"9fc89814-a55f-4311-86ae-c79d44efe0bb\") " pod="openshift-monitoring/telemeter-client-ccbf95c6c-bnmzs" Jul 17 13:58:01.275537 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.275339 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9fc89814-a55f-4311-86ae-c79d44efe0bb-secret-telemeter-client\") pod \"telemeter-client-ccbf95c6c-bnmzs\" (UID: \"9fc89814-a55f-4311-86ae-c79d44efe0bb\") " pod="openshift-monitoring/telemeter-client-ccbf95c6c-bnmzs" Jul 17 13:58:01.275537 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.275358 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9fc89814-a55f-4311-86ae-c79d44efe0bb-federate-client-tls\") pod \"telemeter-client-ccbf95c6c-bnmzs\" (UID: \"9fc89814-a55f-4311-86ae-c79d44efe0bb\") " pod="openshift-monitoring/telemeter-client-ccbf95c6c-bnmzs" Jul 17 13:58:01.276423 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.276102 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fc89814-a55f-4311-86ae-c79d44efe0bb-serving-certs-ca-bundle\") pod \"telemeter-client-ccbf95c6c-bnmzs\" (UID: \"9fc89814-a55f-4311-86ae-c79d44efe0bb\") " pod="openshift-monitoring/telemeter-client-ccbf95c6c-bnmzs" Jul 17 13:58:01.276423 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.276124 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fc89814-a55f-4311-86ae-c79d44efe0bb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-ccbf95c6c-bnmzs\" (UID: \"9fc89814-a55f-4311-86ae-c79d44efe0bb\") " pod="openshift-monitoring/telemeter-client-ccbf95c6c-bnmzs" Jul 17 13:58:01.276993 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.276886 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fc89814-a55f-4311-86ae-c79d44efe0bb-metrics-client-ca\") pod \"telemeter-client-ccbf95c6c-bnmzs\" (UID: \"9fc89814-a55f-4311-86ae-c79d44efe0bb\") " pod="openshift-monitoring/telemeter-client-ccbf95c6c-bnmzs" Jul 17 13:58:01.278347 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.278324 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/9fc89814-a55f-4311-86ae-c79d44efe0bb-telemeter-client-tls\") pod \"telemeter-client-ccbf95c6c-bnmzs\" (UID: \"9fc89814-a55f-4311-86ae-c79d44efe0bb\") " pod="openshift-monitoring/telemeter-client-ccbf95c6c-bnmzs" Jul 17 13:58:01.278449 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.278371 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/9fc89814-a55f-4311-86ae-c79d44efe0bb-federate-client-tls\") pod \"telemeter-client-ccbf95c6c-bnmzs\" (UID: \"9fc89814-a55f-4311-86ae-c79d44efe0bb\") " pod="openshift-monitoring/telemeter-client-ccbf95c6c-bnmzs" Jul 17 13:58:01.278667 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.278649 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9fc89814-a55f-4311-86ae-c79d44efe0bb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-ccbf95c6c-bnmzs\" (UID: \"9fc89814-a55f-4311-86ae-c79d44efe0bb\") " pod="openshift-monitoring/telemeter-client-ccbf95c6c-bnmzs" Jul 17 13:58:01.279243 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.279219 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/9fc89814-a55f-4311-86ae-c79d44efe0bb-secret-telemeter-client\") pod \"telemeter-client-ccbf95c6c-bnmzs\" (UID: \"9fc89814-a55f-4311-86ae-c79d44efe0bb\") " pod="openshift-monitoring/telemeter-client-ccbf95c6c-bnmzs" Jul 17 13:58:01.283902 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.283865 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54ffv\" (UniqueName: \"kubernetes.io/projected/9fc89814-a55f-4311-86ae-c79d44efe0bb-kube-api-access-54ffv\") pod \"telemeter-client-ccbf95c6c-bnmzs\" (UID: \"9fc89814-a55f-4311-86ae-c79d44efe0bb\") " pod="openshift-monitoring/telemeter-client-ccbf95c6c-bnmzs" Jul 17 13:58:01.298926 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.298896 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:58:01.445058 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.445026 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-ccbf95c6c-bnmzs" Jul 17 13:58:01.599597 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:01.599575 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-ccbf95c6c-bnmzs"] Jul 17 13:58:01.711937 ip-10-0-138-92 kubenswrapper[2565]: W0717 13:58:01.711908 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fc89814_a55f_4311_86ae_c79d44efe0bb.slice/crio-8fa3eeb701c0aa2d4c20c4d029a2451abc5401e2a618c35d262748b21af5aa8f WatchSource:0}: Error finding container 8fa3eeb701c0aa2d4c20c4d029a2451abc5401e2a618c35d262748b21af5aa8f: Status 404 returned error can't find the container with id 8fa3eeb701c0aa2d4c20c4d029a2451abc5401e2a618c35d262748b21af5aa8f Jul 17 13:58:02.249517 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:02.249401 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:58:02.278491 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:02.278466 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-ccbf95c6c-bnmzs" event={"ID":"9fc89814-a55f-4311-86ae-c79d44efe0bb","Type":"ContainerStarted","Data":"8fa3eeb701c0aa2d4c20c4d029a2451abc5401e2a618c35d262748b21af5aa8f"} Jul 17 13:58:02.280686 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:02.280664 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" event={"ID":"3810dd92-7808-4834-9140-7bff1ea942a1","Type":"ContainerStarted","Data":"62724a430342c51856e1c87c3ae3ef4f4c72c1fc28bf864c9eacb2c32224f003"} Jul 17 13:58:02.280805 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:02.280719 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" event={"ID":"3810dd92-7808-4834-9140-7bff1ea942a1","Type":"ContainerStarted","Data":"e369b7a8c20e0c0ab53a3018fe91eaed19cbeca2020ad0d49f3fca7733324edf"} Jul 17 13:58:02.280805 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:02.280743 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" event={"ID":"3810dd92-7808-4834-9140-7bff1ea942a1","Type":"ContainerStarted","Data":"af6c2900ff1f90ed4a1eb317553b3a90b699d1fe29e4febfc8d18579dc3ff98e"} Jul 17 13:58:04.290528 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:04.290491 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-ccbf95c6c-bnmzs" event={"ID":"9fc89814-a55f-4311-86ae-c79d44efe0bb","Type":"ContainerStarted","Data":"a5fce3a99f439ddd603bda7091480b63e230e928096c3883a19688e75cc9c7dd"} Jul 17 13:58:04.292997 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:04.292970 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" event={"ID":"3810dd92-7808-4834-9140-7bff1ea942a1","Type":"ContainerStarted","Data":"98ed10a284838b9fe20ff668187a3b954e8608befa5e3be8b3f6c98dfd939b27"} Jul 17 13:58:04.293101 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:04.293031 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" event={"ID":"3810dd92-7808-4834-9140-7bff1ea942a1","Type":"ContainerStarted","Data":"3fc12399317a6bec5c771e17389ab1f916802d74ff740c52aa0f80959c7c16e7"} Jul 17 13:58:04.324800 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:04.324775 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:58:04.425203 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:04.425152 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:58:05.300261 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:05.300226 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" event={"ID":"3810dd92-7808-4834-9140-7bff1ea942a1","Type":"ContainerStarted","Data":"2324c1ae685fe0efec6e793426129f39be36ae43c548621df6825ab9e09aee0f"} Jul 17 13:58:05.300611 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:05.300341 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" Jul 17 13:58:05.325060 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:05.325011 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" podStartSLOduration=3.074391002 podStartE2EDuration="7.324997077s" totalImagesPullingTime="4.250606075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:57:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:58:05.323642711 +0000 UTC m=+104.151995059" watchObservedRunningTime="2026-07-17 13:58:05.324997077 +0000 UTC m=+104.153349469" Jul 17 13:58:06.306613 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:06.306576 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-ccbf95c6c-bnmzs" event={"ID":"9fc89814-a55f-4311-86ae-c79d44efe0bb","Type":"ContainerStarted","Data":"354ed900ca1bd8521a549bff38ba5cd31df70d0bcf826e41f7a6098cb42fddd1"} Jul 17 13:58:06.306987 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:06.306638 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-ccbf95c6c-bnmzs" event={"ID":"9fc89814-a55f-4311-86ae-c79d44efe0bb","Type":"ContainerStarted","Data":"a3936f8549dc70623b0dae7080eddaa2455784217f3e23e0e5200314188166bb"} Jul 17 13:58:06.313556 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:06.313535 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6f6b675695-l9d94" Jul 17 13:58:06.352256 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:06.352198 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-ccbf95c6c-bnmzs" podStartSLOduration=1.694309842 podStartE2EDuration="5.352159737s" totalImagesPullingTime="3.657849895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 13:58:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 13:58:06.350876289 +0000 UTC m=+105.179228651" watchObservedRunningTime="2026-07-17 13:58:06.352159737 +0000 UTC m=+105.180512086" Jul 17 13:58:10.522192 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:10.522139 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:58:10.580224 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:10.580191 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:58:16.346908 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:16.346879 2565 generic.go:356] "Generic (PLEG): container finished" podID="45230f7f-2bb9-4737-adf5-e47da33d503c" containerID="c2ac06eef3e63e78efb94ed450b7a4089cc484009a2c5cb8d99f6ef100b00a59" exitCode=0 Jul 17 13:58:16.347353 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:16.346956 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-phbnw" event={"ID":"45230f7f-2bb9-4737-adf5-e47da33d503c","Type":"ContainerDied","Data":"c2ac06eef3e63e78efb94ed450b7a4089cc484009a2c5cb8d99f6ef100b00a59"} Jul 17 13:58:16.347353 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:16.347284 2565 scope.go:117] "RemoveContainer" containerID="c2ac06eef3e63e78efb94ed450b7a4089cc484009a2c5cb8d99f6ef100b00a59" Jul 17 13:58:16.348517 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:16.348492 2565 generic.go:356] "Generic (PLEG): container finished" podID="38ccf43f-fbcf-41d3-a0b2-2ba57dd0a94a" containerID="2406e44b672d3d12445224a9a277a5f8ba855ea906f5eec5197f3ed4069f5f4a" exitCode=0 Jul 17 13:58:16.348622 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:16.348553 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-j9zpm" event={"ID":"38ccf43f-fbcf-41d3-a0b2-2ba57dd0a94a","Type":"ContainerDied","Data":"2406e44b672d3d12445224a9a277a5f8ba855ea906f5eec5197f3ed4069f5f4a"} Jul 17 13:58:16.348891 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:16.348873 2565 scope.go:117] "RemoveContainer" containerID="2406e44b672d3d12445224a9a277a5f8ba855ea906f5eec5197f3ed4069f5f4a" Jul 17 13:58:17.353891 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:17.353856 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-phbnw" event={"ID":"45230f7f-2bb9-4737-adf5-e47da33d503c","Type":"ContainerStarted","Data":"fe0e35909ba90ee48859bfe961d0a704e658fb879b9bd0f9c50900188f889a59"} Jul 17 13:58:17.355544 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:17.355522 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-j9zpm" event={"ID":"38ccf43f-fbcf-41d3-a0b2-2ba57dd0a94a","Type":"ContainerStarted","Data":"f7c64d7ee77ad96b16fca363eabebc0f6f8051d5ba182c8e26c03dad11394fa6"} Jul 17 13:58:18.108499 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.108447 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" podUID="abc092dc-0b98-4726-a513-94b21f1a0b26" containerName="registry" containerID="cri-o://a7a8f6e8e85beab74bdb5bf05b5e8e23485b022a16a1ad589db9e25da74e7e1f" gracePeriod=30 Jul 17 13:58:18.347305 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.347278 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:58:18.363000 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.362924 2565 generic.go:356] "Generic (PLEG): container finished" podID="abc092dc-0b98-4726-a513-94b21f1a0b26" containerID="a7a8f6e8e85beab74bdb5bf05b5e8e23485b022a16a1ad589db9e25da74e7e1f" exitCode=0 Jul 17 13:58:18.363422 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.363005 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" event={"ID":"abc092dc-0b98-4726-a513-94b21f1a0b26","Type":"ContainerDied","Data":"a7a8f6e8e85beab74bdb5bf05b5e8e23485b022a16a1ad589db9e25da74e7e1f"} Jul 17 13:58:18.363422 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.363024 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" Jul 17 13:58:18.363422 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.363061 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69588b5c66-jk8qx" event={"ID":"abc092dc-0b98-4726-a513-94b21f1a0b26","Type":"ContainerDied","Data":"ce6d7ebc0af327b1d4f057213ff63aa58aa3f07c79210ddd0c89a7ab99f4191e"} Jul 17 13:58:18.363422 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.363089 2565 scope.go:117] "RemoveContainer" containerID="a7a8f6e8e85beab74bdb5bf05b5e8e23485b022a16a1ad589db9e25da74e7e1f" Jul 17 13:58:18.372985 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.372966 2565 scope.go:117] "RemoveContainer" containerID="a7a8f6e8e85beab74bdb5bf05b5e8e23485b022a16a1ad589db9e25da74e7e1f" Jul 17 13:58:18.373306 ip-10-0-138-92 kubenswrapper[2565]: E0717 13:58:18.373279 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7a8f6e8e85beab74bdb5bf05b5e8e23485b022a16a1ad589db9e25da74e7e1f\": container with ID starting with a7a8f6e8e85beab74bdb5bf05b5e8e23485b022a16a1ad589db9e25da74e7e1f not found: ID does not exist" containerID="a7a8f6e8e85beab74bdb5bf05b5e8e23485b022a16a1ad589db9e25da74e7e1f" Jul 17 13:58:18.373439 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.373310 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7a8f6e8e85beab74bdb5bf05b5e8e23485b022a16a1ad589db9e25da74e7e1f"} err="failed to get container status \"a7a8f6e8e85beab74bdb5bf05b5e8e23485b022a16a1ad589db9e25da74e7e1f\": rpc error: code = NotFound desc = could not find container \"a7a8f6e8e85beab74bdb5bf05b5e8e23485b022a16a1ad589db9e25da74e7e1f\": container with ID starting with a7a8f6e8e85beab74bdb5bf05b5e8e23485b022a16a1ad589db9e25da74e7e1f not found: ID does not exist" Jul 17 13:58:18.415297 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.415274 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/abc092dc-0b98-4726-a513-94b21f1a0b26-registry-certificates\") pod \"abc092dc-0b98-4726-a513-94b21f1a0b26\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " Jul 17 13:58:18.415417 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.415318 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnf4j\" (UniqueName: \"kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-kube-api-access-jnf4j\") pod \"abc092dc-0b98-4726-a513-94b21f1a0b26\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " Jul 17 13:58:18.415417 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.415362 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/abc092dc-0b98-4726-a513-94b21f1a0b26-image-registry-private-configuration\") pod \"abc092dc-0b98-4726-a513-94b21f1a0b26\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " Jul 17 13:58:18.415417 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.415381 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/abc092dc-0b98-4726-a513-94b21f1a0b26-installation-pull-secrets\") pod \"abc092dc-0b98-4726-a513-94b21f1a0b26\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " Jul 17 13:58:18.415417 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.415407 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-registry-tls\") pod \"abc092dc-0b98-4726-a513-94b21f1a0b26\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " Jul 17 13:58:18.415620 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.415458 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-bound-sa-token\") pod \"abc092dc-0b98-4726-a513-94b21f1a0b26\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " Jul 17 13:58:18.415620 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.415573 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/abc092dc-0b98-4726-a513-94b21f1a0b26-trusted-ca\") pod \"abc092dc-0b98-4726-a513-94b21f1a0b26\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " Jul 17 13:58:18.415724 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.415619 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/abc092dc-0b98-4726-a513-94b21f1a0b26-ca-trust-extracted\") pod \"abc092dc-0b98-4726-a513-94b21f1a0b26\" (UID: \"abc092dc-0b98-4726-a513-94b21f1a0b26\") " Jul 17 13:58:18.415724 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.415681 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abc092dc-0b98-4726-a513-94b21f1a0b26-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "abc092dc-0b98-4726-a513-94b21f1a0b26" (UID: "abc092dc-0b98-4726-a513-94b21f1a0b26"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 13:58:18.415914 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.415882 2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/abc092dc-0b98-4726-a513-94b21f1a0b26-registry-certificates\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 13:58:18.416344 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.416289 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/abc092dc-0b98-4726-a513-94b21f1a0b26-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "abc092dc-0b98-4726-a513-94b21f1a0b26" (UID: "abc092dc-0b98-4726-a513-94b21f1a0b26"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 13:58:18.419233 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.419207 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "abc092dc-0b98-4726-a513-94b21f1a0b26" (UID: "abc092dc-0b98-4726-a513-94b21f1a0b26"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 13:58:18.419468 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.419430 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abc092dc-0b98-4726-a513-94b21f1a0b26-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "abc092dc-0b98-4726-a513-94b21f1a0b26" (UID: "abc092dc-0b98-4726-a513-94b21f1a0b26"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:58:18.419727 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.419698 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-kube-api-access-jnf4j" (OuterVolumeSpecName: "kube-api-access-jnf4j") pod "abc092dc-0b98-4726-a513-94b21f1a0b26" (UID: "abc092dc-0b98-4726-a513-94b21f1a0b26"). InnerVolumeSpecName "kube-api-access-jnf4j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 13:58:18.419816 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.419759 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abc092dc-0b98-4726-a513-94b21f1a0b26-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "abc092dc-0b98-4726-a513-94b21f1a0b26" (UID: "abc092dc-0b98-4726-a513-94b21f1a0b26"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 13:58:18.419858 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.419817 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "abc092dc-0b98-4726-a513-94b21f1a0b26" (UID: "abc092dc-0b98-4726-a513-94b21f1a0b26"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 13:58:18.427049 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.427023 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abc092dc-0b98-4726-a513-94b21f1a0b26-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "abc092dc-0b98-4726-a513-94b21f1a0b26" (UID: "abc092dc-0b98-4726-a513-94b21f1a0b26"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 13:58:18.462493 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.462466 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:58:18.516862 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.516836 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnf4j\" (UniqueName: \"kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-kube-api-access-jnf4j\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 13:58:18.516862 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.516859 2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/abc092dc-0b98-4726-a513-94b21f1a0b26-image-registry-private-configuration\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 13:58:18.517002 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.516871 2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/abc092dc-0b98-4726-a513-94b21f1a0b26-installation-pull-secrets\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 13:58:18.517002 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.516881 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-registry-tls\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 13:58:18.517002 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.516889 2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/abc092dc-0b98-4726-a513-94b21f1a0b26-bound-sa-token\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 13:58:18.517002 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.516896 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/abc092dc-0b98-4726-a513-94b21f1a0b26-trusted-ca\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 13:58:18.517002 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.516903 2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/abc092dc-0b98-4726-a513-94b21f1a0b26-ca-trust-extracted\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 13:58:18.563689 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.563655 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:58:18.633805 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.633722 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:58:18.684227 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.684172 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-69588b5c66-jk8qx"] Jul 17 13:58:18.687759 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:18.687738 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-69588b5c66-jk8qx"] Jul 17 13:58:19.696662 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:19.696634 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abc092dc-0b98-4726-a513-94b21f1a0b26" path="/var/lib/kubelet/pods/abc092dc-0b98-4726-a513-94b21f1a0b26/volumes" Jul 17 13:58:25.527854 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:25.527810 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:58:25.588736 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:25.588687 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:58:32.418670 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:32.418635 2565 generic.go:356] "Generic (PLEG): container finished" podID="313552d6-2c32-4553-98fc-2a5f01d7722c" containerID="4fb80018dc35db09908459edb7ba18352d22fedec7e7c4bfe829aeae1eebe6de" exitCode=0 Jul 17 13:58:32.419057 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:32.418693 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-r6gsw" event={"ID":"313552d6-2c32-4553-98fc-2a5f01d7722c","Type":"ContainerDied","Data":"4fb80018dc35db09908459edb7ba18352d22fedec7e7c4bfe829aeae1eebe6de"} Jul 17 13:58:32.419099 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:32.419065 2565 scope.go:117] "RemoveContainer" containerID="4fb80018dc35db09908459edb7ba18352d22fedec7e7c4bfe829aeae1eebe6de" Jul 17 13:58:33.423816 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:58:33.423782 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-r6gsw" event={"ID":"313552d6-2c32-4553-98fc-2a5f01d7722c","Type":"ContainerStarted","Data":"15dae13f8d60454f2e45065bf67abbe5e6608ab70ca6f3adeac126a8df4e34bb"} Jul 17 13:59:12.102422 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:59:12.102342 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:59:12.195055 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:59:12.195024 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:59:20.727953 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:59:20.727915 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:59:20.786926 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:59:20.786895 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:59:20.845138 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:59:20.845109 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:59:21.657483 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:59:21.657454 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:59:21.719622 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:59:21.719593 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:59:24.086008 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:59:24.085974 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:59:24.187013 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:59:24.186980 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:59:31.841199 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:59:31.841120 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:59:31.945908 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:59:31.945873 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:59:32.032743 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:59:32.032711 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:59:40.531967 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:59:40.531924 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:59:40.633839 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:59:40.633797 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:59:50.568292 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:59:50.568255 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:59:50.619982 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:59:50.619950 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 13:59:56.917350 ip-10-0-138-92 kubenswrapper[2565]: I0717 13:59:56.917309 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:00:42.060600 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:00:42.060522 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:00:42.125810 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:00:42.125779 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:00:45.135125 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:00:45.135092 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:01:02.246664 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:02.246628 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:01:16.694729 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:16.694679 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:01:16.801974 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:16.801945 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:01:17.737530 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:17.737501 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:01:17.749129 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:17.749099 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-f9887f865-z9j72"] Jul 17 14:01:17.749476 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:17.749462 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abc092dc-0b98-4726-a513-94b21f1a0b26" containerName="registry" Jul 17 14:01:17.749518 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:17.749479 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="abc092dc-0b98-4726-a513-94b21f1a0b26" containerName="registry" Jul 17 14:01:17.749554 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:17.749536 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="abc092dc-0b98-4726-a513-94b21f1a0b26" containerName="registry" Jul 17 14:01:17.752437 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:17.752422 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-f9887f865-z9j72" Jul 17 14:01:17.754618 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:17.754596 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-kshxv\"" Jul 17 14:01:17.755317 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:17.755299 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" Jul 17 14:01:17.755408 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:17.755351 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" Jul 17 14:01:17.762949 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:17.762928 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-f9887f865-z9j72"] Jul 17 14:01:17.820020 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:17.819992 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lhhh\" (UniqueName: \"kubernetes.io/projected/6bd66966-3d6c-4338-9c13-b9bd0fa4acc1-kube-api-access-8lhhh\") pod \"feast-operator-controller-manager-f9887f865-z9j72\" (UID: \"6bd66966-3d6c-4338-9c13-b9bd0fa4acc1\") " pod="feast-operator-system/feast-operator-controller-manager-f9887f865-z9j72" Jul 17 14:01:17.921315 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:17.921287 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lhhh\" (UniqueName: \"kubernetes.io/projected/6bd66966-3d6c-4338-9c13-b9bd0fa4acc1-kube-api-access-8lhhh\") pod \"feast-operator-controller-manager-f9887f865-z9j72\" (UID: \"6bd66966-3d6c-4338-9c13-b9bd0fa4acc1\") " pod="feast-operator-system/feast-operator-controller-manager-f9887f865-z9j72" Jul 17 14:01:17.929977 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:17.929955 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lhhh\" (UniqueName: \"kubernetes.io/projected/6bd66966-3d6c-4338-9c13-b9bd0fa4acc1-kube-api-access-8lhhh\") pod \"feast-operator-controller-manager-f9887f865-z9j72\" (UID: \"6bd66966-3d6c-4338-9c13-b9bd0fa4acc1\") " pod="feast-operator-system/feast-operator-controller-manager-f9887f865-z9j72" Jul 17 14:01:18.062410 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:18.062380 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-f9887f865-z9j72" Jul 17 14:01:18.192119 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:18.192090 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-f9887f865-z9j72"] Jul 17 14:01:18.195287 ip-10-0-138-92 kubenswrapper[2565]: W0717 14:01:18.195244 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bd66966_3d6c_4338_9c13_b9bd0fa4acc1.slice/crio-d55c286b8591abbcc9228e58818e0333c2cdd36702f43201c8baf94f72191e44 WatchSource:0}: Error finding container d55c286b8591abbcc9228e58818e0333c2cdd36702f43201c8baf94f72191e44: Status 404 returned error can't find the container with id d55c286b8591abbcc9228e58818e0333c2cdd36702f43201c8baf94f72191e44 Jul 17 14:01:19.052333 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:19.052294 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-f9887f865-z9j72" event={"ID":"6bd66966-3d6c-4338-9c13-b9bd0fa4acc1","Type":"ContainerStarted","Data":"d55c286b8591abbcc9228e58818e0333c2cdd36702f43201c8baf94f72191e44"} Jul 17 14:01:21.060694 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:21.060655 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-f9887f865-z9j72" event={"ID":"6bd66966-3d6c-4338-9c13-b9bd0fa4acc1","Type":"ContainerStarted","Data":"ebf36699ab211f118a969a35e99dcf17b5f94fea23babfe9677e5dc41d0b1ef7"} Jul 17 14:01:21.061133 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:21.060729 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-f9887f865-z9j72" Jul 17 14:01:21.076488 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:21.076438 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-f9887f865-z9j72" podStartSLOduration=1.793595021 podStartE2EDuration="4.076423221s" totalImagesPullingTime="2.2828282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:01:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:01:21.075044711 +0000 UTC m=+299.903397059" watchObservedRunningTime="2026-07-17 14:01:21.076423221 +0000 UTC m=+299.904775563" Jul 17 14:01:21.547655 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:21.547616 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-86jkr_c4b20c0f-f85e-488d-aee9-b772cb8738a0/console-operator/1.log" Jul 17 14:01:21.549922 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:21.549889 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-86jkr_c4b20c0f-f85e-488d-aee9-b772cb8738a0/console-operator/1.log" Jul 17 14:01:21.559465 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:21.559443 2565 kubelet.go:1648] "Image garbage collection succeeded" Jul 17 14:01:32.067335 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:32.067301 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-f9887f865-z9j72" Jul 17 14:01:59.330664 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:59.330629 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:01:59.735209 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:59.735119 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb"] Jul 17 14:01:59.742011 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:59.741992 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:01:59.744319 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:59.744298 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-nrdr2\"" Jul 17 14:01:59.744597 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:59.744556 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\"" Jul 17 14:01:59.744597 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:59.744597 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\"" Jul 17 14:01:59.744789 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:59.744764 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\"" Jul 17 14:01:59.744870 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:59.744801 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jul 17 14:01:59.745084 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:59.745070 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\"" Jul 17 14:01:59.745141 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:59.745089 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\"" Jul 17 14:01:59.745141 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:59.745110 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jul 17 14:01:59.751469 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:59.751449 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb"] Jul 17 14:01:59.843565 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:59.843540 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-ui-tls\") pod \"feast-simple-feast-setup-54c65966b6-n6wfb\" (UID: \"2e7b18f0-29ad-4288-9501-91c5cfb5c16c\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:01:59.843709 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:59.843580 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-registry-tls\") pod \"feast-simple-feast-setup-54c65966b6-n6wfb\" (UID: \"2e7b18f0-29ad-4288-9501-91c5cfb5c16c\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:01:59.843709 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:59.843612 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-feast-data\") pod \"feast-simple-feast-setup-54c65966b6-n6wfb\" (UID: \"2e7b18f0-29ad-4288-9501-91c5cfb5c16c\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:01:59.843709 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:59.843639 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-offline-tls\") pod \"feast-simple-feast-setup-54c65966b6-n6wfb\" (UID: \"2e7b18f0-29ad-4288-9501-91c5cfb5c16c\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:01:59.843709 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:59.843676 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-online-tls\") pod \"feast-simple-feast-setup-54c65966b6-n6wfb\" (UID: \"2e7b18f0-29ad-4288-9501-91c5cfb5c16c\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:01:59.843709 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:59.843702 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77dv5\" (UniqueName: \"kubernetes.io/projected/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-kube-api-access-77dv5\") pod \"feast-simple-feast-setup-54c65966b6-n6wfb\" (UID: \"2e7b18f0-29ad-4288-9501-91c5cfb5c16c\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:01:59.944995 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:59.944967 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-offline-tls\") pod \"feast-simple-feast-setup-54c65966b6-n6wfb\" (UID: \"2e7b18f0-29ad-4288-9501-91c5cfb5c16c\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:01:59.945163 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:59.945010 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-online-tls\") pod \"feast-simple-feast-setup-54c65966b6-n6wfb\" (UID: \"2e7b18f0-29ad-4288-9501-91c5cfb5c16c\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:01:59.945163 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:59.945037 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77dv5\" (UniqueName: \"kubernetes.io/projected/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-kube-api-access-77dv5\") pod \"feast-simple-feast-setup-54c65966b6-n6wfb\" (UID: \"2e7b18f0-29ad-4288-9501-91c5cfb5c16c\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:01:59.945163 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:59.945082 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-ui-tls\") pod \"feast-simple-feast-setup-54c65966b6-n6wfb\" (UID: \"2e7b18f0-29ad-4288-9501-91c5cfb5c16c\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:01:59.945163 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:01:59.945119 2565 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found Jul 17 14:01:59.945416 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:59.945118 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-registry-tls\") pod \"feast-simple-feast-setup-54c65966b6-n6wfb\" (UID: \"2e7b18f0-29ad-4288-9501-91c5cfb5c16c\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:01:59.945416 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:01:59.945211 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-offline-tls podName:2e7b18f0-29ad-4288-9501-91c5cfb5c16c nodeName:}" failed. No retries permitted until 2026-07-17 14:02:00.445169922 +0000 UTC m=+339.273522245 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-offline-tls") pod "feast-simple-feast-setup-54c65966b6-n6wfb" (UID: "2e7b18f0-29ad-4288-9501-91c5cfb5c16c") : secret "feast-simple-feast-setup-offline-tls" not found Jul 17 14:01:59.945416 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:01:59.945224 2565 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Jul 17 14:01:59.945416 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:59.945260 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-feast-data\") pod \"feast-simple-feast-setup-54c65966b6-n6wfb\" (UID: \"2e7b18f0-29ad-4288-9501-91c5cfb5c16c\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:01:59.945416 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:01:59.945287 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-ui-tls podName:2e7b18f0-29ad-4288-9501-91c5cfb5c16c nodeName:}" failed. No retries permitted until 2026-07-17 14:02:00.445269442 +0000 UTC m=+339.273621787 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-ui-tls") pod "feast-simple-feast-setup-54c65966b6-n6wfb" (UID: "2e7b18f0-29ad-4288-9501-91c5cfb5c16c") : secret "feast-simple-feast-setup-ui-tls" not found Jul 17 14:01:59.945611 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:59.945556 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-feast-data\") pod \"feast-simple-feast-setup-54c65966b6-n6wfb\" (UID: \"2e7b18f0-29ad-4288-9501-91c5cfb5c16c\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:01:59.947431 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:59.947410 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-registry-tls\") pod \"feast-simple-feast-setup-54c65966b6-n6wfb\" (UID: \"2e7b18f0-29ad-4288-9501-91c5cfb5c16c\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:01:59.947552 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:59.947535 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-online-tls\") pod \"feast-simple-feast-setup-54c65966b6-n6wfb\" (UID: \"2e7b18f0-29ad-4288-9501-91c5cfb5c16c\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:01:59.955326 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:01:59.955304 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77dv5\" (UniqueName: \"kubernetes.io/projected/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-kube-api-access-77dv5\") pod \"feast-simple-feast-setup-54c65966b6-n6wfb\" (UID: \"2e7b18f0-29ad-4288-9501-91c5cfb5c16c\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:02:00.433770 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:00.433733 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:02:00.450810 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:00.450780 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-ui-tls\") pod \"feast-simple-feast-setup-54c65966b6-n6wfb\" (UID: \"2e7b18f0-29ad-4288-9501-91c5cfb5c16c\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:02:00.450939 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:00.450845 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-offline-tls\") pod \"feast-simple-feast-setup-54c65966b6-n6wfb\" (UID: \"2e7b18f0-29ad-4288-9501-91c5cfb5c16c\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:02:00.453337 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:00.453304 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-ui-tls\") pod \"feast-simple-feast-setup-54c65966b6-n6wfb\" (UID: \"2e7b18f0-29ad-4288-9501-91c5cfb5c16c\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:02:00.453446 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:00.453385 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-offline-tls\") pod \"feast-simple-feast-setup-54c65966b6-n6wfb\" (UID: \"2e7b18f0-29ad-4288-9501-91c5cfb5c16c\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:02:00.663595 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:00.663571 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:02:00.798305 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:00.798271 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb"] Jul 17 14:02:00.801593 ip-10-0-138-92 kubenswrapper[2565]: W0717 14:02:00.801567 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e7b18f0_29ad_4288_9501_91c5cfb5c16c.slice/crio-666781447fc83a4577156497d5235f5345cc420c0336ad12b48778a9e53f3e1a WatchSource:0}: Error finding container 666781447fc83a4577156497d5235f5345cc420c0336ad12b48778a9e53f3e1a: Status 404 returned error can't find the container with id 666781447fc83a4577156497d5235f5345cc420c0336ad12b48778a9e53f3e1a Jul 17 14:02:00.803372 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:00.803357 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 14:02:01.216566 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:01.216523 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" event={"ID":"2e7b18f0-29ad-4288-9501-91c5cfb5c16c","Type":"ContainerStarted","Data":"666781447fc83a4577156497d5235f5345cc420c0336ad12b48778a9e53f3e1a"} Jul 17 14:02:28.335353 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:28.335313 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" event={"ID":"2e7b18f0-29ad-4288-9501-91c5cfb5c16c","Type":"ContainerStarted","Data":"93fb9391a31ddc4c4e3437f86542cf71bc74328e6c53b0fc4b2a818db0721c5d"} Jul 17 14:02:33.358168 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:33.358130 2565 generic.go:356] "Generic (PLEG): container finished" podID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerID="93fb9391a31ddc4c4e3437f86542cf71bc74328e6c53b0fc4b2a818db0721c5d" exitCode=0 Jul 17 14:02:33.358607 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:33.358214 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" event={"ID":"2e7b18f0-29ad-4288-9501-91c5cfb5c16c","Type":"ContainerDied","Data":"93fb9391a31ddc4c4e3437f86542cf71bc74328e6c53b0fc4b2a818db0721c5d"} Jul 17 14:02:34.364319 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:34.364281 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" event={"ID":"2e7b18f0-29ad-4288-9501-91c5cfb5c16c","Type":"ContainerStarted","Data":"bc93f362eb090f8cfa5a064f1faf2b9ba5c6b7a34c3e378a332dd5072b4c6b85"} Jul 17 14:02:39.385965 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:39.385931 2565 generic.go:356] "Generic (PLEG): container finished" podID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerID="bc93f362eb090f8cfa5a064f1faf2b9ba5c6b7a34c3e378a332dd5072b4c6b85" exitCode=0 Jul 17 14:02:39.386348 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:39.386009 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" event={"ID":"2e7b18f0-29ad-4288-9501-91c5cfb5c16c","Type":"ContainerDied","Data":"bc93f362eb090f8cfa5a064f1faf2b9ba5c6b7a34c3e378a332dd5072b4c6b85"} Jul 17 14:02:39.395459 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:39.395436 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\"" Jul 17 14:02:40.397099 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:40.397059 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" event={"ID":"2e7b18f0-29ad-4288-9501-91c5cfb5c16c","Type":"ContainerStarted","Data":"afa07030156c0cb726e5ada324128952b46d8fa0a14f58acbdd0f390d9ae6394"} Jul 17 14:02:40.397619 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:40.397124 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" event={"ID":"2e7b18f0-29ad-4288-9501-91c5cfb5c16c","Type":"ContainerStarted","Data":"bcd9d0c89d3329cea4fa7d2283f92750c35db83f41b4368ac05a60d2d7654395"} Jul 17 14:02:40.397619 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:40.397144 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" event={"ID":"2e7b18f0-29ad-4288-9501-91c5cfb5c16c","Type":"ContainerStarted","Data":"bfebedce3869c8497d3f5e013aa3905f0497731e82b8592fbf9034572e410ee8"} Jul 17 14:02:40.397619 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:40.397160 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" event={"ID":"2e7b18f0-29ad-4288-9501-91c5cfb5c16c","Type":"ContainerStarted","Data":"a74f2c9540969ee53a0d624582d8498172fc25d23635b07fe6d25195560560f2"} Jul 17 14:02:40.428087 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:40.428020 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" podStartSLOduration=14.585411378 podStartE2EDuration="41.427999161s" totalImagesPullingTime="26.842587783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:01:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:02:40.427246501 +0000 UTC m=+379.255598840" watchObservedRunningTime="2026-07-17 14:02:40.427999161 +0000 UTC m=+379.256351508" Jul 17 14:02:40.664652 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:40.664553 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:02:40.664652 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:40.664633 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:02:40.664652 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:40.664657 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:02:40.664936 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:40.664676 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:02:42.667824 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:42.667769 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:02:42.669263 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:42.669232 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:02:42.669399 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:42.669298 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:02:42.669399 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:42.669321 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:02:42.671970 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:42.671923 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" podUID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused" Jul 17 14:02:42.672078 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:42.671940 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" podUID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused" Jul 17 14:02:42.672254 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:42.671930 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" podUID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.23:8816: connect: connection refused" Jul 17 14:02:42.672480 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:42.672444 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" podUID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.23:6571: connect: connection refused" Jul 17 14:02:45.664299 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:45.664250 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" podUID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused" Jul 17 14:02:45.665261 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:45.665239 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:02:45.665375 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:45.665335 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:02:45.666142 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:45.666122 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:02:45.666247 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:45.666221 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:02:45.671196 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:45.671160 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:02:46.433457 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:46.433428 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:02:48.665314 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:48.665287 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:02:49.444107 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:49.444076 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:02:49.770400 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:02:49.770310 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:03:10.641845 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:10.641815 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:03:10.701131 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:10.701087 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:03:10.773434 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:10.773406 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:03:10.889633 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:10.889599 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:03:11.394468 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:11.394429 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:03:11.455366 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:11.455332 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:03:21.736932 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:21.736897 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:03:21.836561 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:21.836525 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:03:21.901314 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:21.901282 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:03:26.383658 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:26.383619 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:03:26.450811 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:26.450775 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:03:28.328400 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:28.328366 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:03:28.387248 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:28.387216 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:03:51.138934 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:51.138716 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:03:51.156570 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:51.156536 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb"] Jul 17 14:03:51.156828 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:51.156778 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" podUID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerName="registry" containerID="cri-o://a74f2c9540969ee53a0d624582d8498172fc25d23635b07fe6d25195560560f2" gracePeriod=30 Jul 17 14:03:51.156921 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:51.156826 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" podUID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerName="offline" containerID="cri-o://bcd9d0c89d3329cea4fa7d2283f92750c35db83f41b4368ac05a60d2d7654395" gracePeriod=30 Jul 17 14:03:51.156999 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:51.156927 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" podUID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerName="ui" containerID="cri-o://afa07030156c0cb726e5ada324128952b46d8fa0a14f58acbdd0f390d9ae6394" gracePeriod=30 Jul 17 14:03:51.156999 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:51.156841 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" podUID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerName="online" containerID="cri-o://bfebedce3869c8497d3f5e013aa3905f0497731e82b8592fbf9034572e410ee8" gracePeriod=30 Jul 17 14:03:51.235116 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:51.235085 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:03:51.336623 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:51.336537 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:03:51.434065 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:51.433976 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:03:51.437523 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:51.437485 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl"] Jul 17 14:03:51.441300 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:51.441283 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:03:51.443006 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:51.442987 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-js5lc\"" Jul 17 14:03:51.453616 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:51.453593 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl"] Jul 17 14:03:51.495455 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:51.495418 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:03:51.503109 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:51.503082 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whpwb\" (UniqueName: \"kubernetes.io/projected/b295a6f2-9669-4c56-978a-6ea9a292b8d4-kube-api-access-whpwb\") pod \"feast-simple-feast-setup-54c65966b6-4tbrl\" (UID: \"b295a6f2-9669-4c56-978a-6ea9a292b8d4\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:03:51.503257 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:51.503123 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b295a6f2-9669-4c56-978a-6ea9a292b8d4-registry-tls\") pod \"feast-simple-feast-setup-54c65966b6-4tbrl\" (UID: \"b295a6f2-9669-4c56-978a-6ea9a292b8d4\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:03:51.503257 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:51.503238 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b295a6f2-9669-4c56-978a-6ea9a292b8d4-feast-data\") pod \"feast-simple-feast-setup-54c65966b6-4tbrl\" (UID: \"b295a6f2-9669-4c56-978a-6ea9a292b8d4\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:03:51.503341 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:51.503303 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b295a6f2-9669-4c56-978a-6ea9a292b8d4-online-tls\") pod \"feast-simple-feast-setup-54c65966b6-4tbrl\" (UID: \"b295a6f2-9669-4c56-978a-6ea9a292b8d4\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:03:51.503341 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:51.503330 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b295a6f2-9669-4c56-978a-6ea9a292b8d4-offline-tls\") pod \"feast-simple-feast-setup-54c65966b6-4tbrl\" (UID: \"b295a6f2-9669-4c56-978a-6ea9a292b8d4\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:03:51.503408 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:51.503351 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b295a6f2-9669-4c56-978a-6ea9a292b8d4-ui-tls\") pod \"feast-simple-feast-setup-54c65966b6-4tbrl\" (UID: \"b295a6f2-9669-4c56-978a-6ea9a292b8d4\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:03:51.604513 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:51.604471 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b295a6f2-9669-4c56-978a-6ea9a292b8d4-online-tls\") pod \"feast-simple-feast-setup-54c65966b6-4tbrl\" (UID: \"b295a6f2-9669-4c56-978a-6ea9a292b8d4\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:03:51.604694 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:51.604531 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b295a6f2-9669-4c56-978a-6ea9a292b8d4-offline-tls\") pod \"feast-simple-feast-setup-54c65966b6-4tbrl\" (UID: \"b295a6f2-9669-4c56-978a-6ea9a292b8d4\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:03:51.604694 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:51.604565 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b295a6f2-9669-4c56-978a-6ea9a292b8d4-ui-tls\") pod \"feast-simple-feast-setup-54c65966b6-4tbrl\" (UID: \"b295a6f2-9669-4c56-978a-6ea9a292b8d4\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:03:51.604694 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:51.604592 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whpwb\" (UniqueName: \"kubernetes.io/projected/b295a6f2-9669-4c56-978a-6ea9a292b8d4-kube-api-access-whpwb\") pod \"feast-simple-feast-setup-54c65966b6-4tbrl\" (UID: \"b295a6f2-9669-4c56-978a-6ea9a292b8d4\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:03:51.604694 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:51.604617 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b295a6f2-9669-4c56-978a-6ea9a292b8d4-registry-tls\") pod \"feast-simple-feast-setup-54c65966b6-4tbrl\" (UID: \"b295a6f2-9669-4c56-978a-6ea9a292b8d4\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:03:51.604694 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:51.604665 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b295a6f2-9669-4c56-978a-6ea9a292b8d4-feast-data\") pod \"feast-simple-feast-setup-54c65966b6-4tbrl\" (UID: \"b295a6f2-9669-4c56-978a-6ea9a292b8d4\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:03:51.605033 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:03:51.604829 2565 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found Jul 17 14:03:51.605087 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:51.605069 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b295a6f2-9669-4c56-978a-6ea9a292b8d4-feast-data\") pod \"feast-simple-feast-setup-54c65966b6-4tbrl\" (UID: \"b295a6f2-9669-4c56-978a-6ea9a292b8d4\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:03:51.605140 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:03:51.605101 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b295a6f2-9669-4c56-978a-6ea9a292b8d4-ui-tls podName:b295a6f2-9669-4c56-978a-6ea9a292b8d4 nodeName:}" failed. No retries permitted until 2026-07-17 14:03:52.105075158 +0000 UTC m=+450.933427489 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/b295a6f2-9669-4c56-978a-6ea9a292b8d4-ui-tls") pod "feast-simple-feast-setup-54c65966b6-4tbrl" (UID: "b295a6f2-9669-4c56-978a-6ea9a292b8d4") : secret "feast-simple-feast-setup-ui-tls" not found Jul 17 14:03:51.607397 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:51.607369 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b295a6f2-9669-4c56-978a-6ea9a292b8d4-online-tls\") pod \"feast-simple-feast-setup-54c65966b6-4tbrl\" (UID: \"b295a6f2-9669-4c56-978a-6ea9a292b8d4\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:03:51.607538 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:51.607466 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b295a6f2-9669-4c56-978a-6ea9a292b8d4-offline-tls\") pod \"feast-simple-feast-setup-54c65966b6-4tbrl\" (UID: \"b295a6f2-9669-4c56-978a-6ea9a292b8d4\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:03:51.607643 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:51.607618 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b295a6f2-9669-4c56-978a-6ea9a292b8d4-registry-tls\") pod \"feast-simple-feast-setup-54c65966b6-4tbrl\" (UID: \"b295a6f2-9669-4c56-978a-6ea9a292b8d4\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:03:51.613694 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:51.613669 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whpwb\" (UniqueName: \"kubernetes.io/projected/b295a6f2-9669-4c56-978a-6ea9a292b8d4-kube-api-access-whpwb\") pod \"feast-simple-feast-setup-54c65966b6-4tbrl\" (UID: \"b295a6f2-9669-4c56-978a-6ea9a292b8d4\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:03:51.620529 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:51.620501 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:03:51.721021 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:51.720932 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:03:51.794510 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:51.794477 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:03:52.107990 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:52.107957 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b295a6f2-9669-4c56-978a-6ea9a292b8d4-ui-tls\") pod \"feast-simple-feast-setup-54c65966b6-4tbrl\" (UID: \"b295a6f2-9669-4c56-978a-6ea9a292b8d4\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:03:52.110459 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:52.110438 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b295a6f2-9669-4c56-978a-6ea9a292b8d4-ui-tls\") pod \"feast-simple-feast-setup-54c65966b6-4tbrl\" (UID: \"b295a6f2-9669-4c56-978a-6ea9a292b8d4\") " pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:03:52.350582 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:52.350542 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:03:52.488141 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:52.488112 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl"] Jul 17 14:03:52.489546 ip-10-0-138-92 kubenswrapper[2565]: W0717 14:03:52.489521 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb295a6f2_9669_4c56_978a_6ea9a292b8d4.slice/crio-e9db6591cee37b474dca4a9e2c491cf97215d2c8e3f78d910c8647099ac8cb51 WatchSource:0}: Error finding container e9db6591cee37b474dca4a9e2c491cf97215d2c8e3f78d910c8647099ac8cb51: Status 404 returned error can't find the container with id e9db6591cee37b474dca4a9e2c491cf97215d2c8e3f78d910c8647099ac8cb51 Jul 17 14:03:52.703318 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:52.703226 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" event={"ID":"b295a6f2-9669-4c56-978a-6ea9a292b8d4","Type":"ContainerStarted","Data":"e9453a7ccb7a7473cf145618e2334d1a1d28cf5d961fef813a34f6a7b9cc1974"} Jul 17 14:03:52.703318 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:52.703277 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" event={"ID":"b295a6f2-9669-4c56-978a-6ea9a292b8d4","Type":"ContainerStarted","Data":"e9db6591cee37b474dca4a9e2c491cf97215d2c8e3f78d910c8647099ac8cb51"} Jul 17 14:03:52.706544 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:52.706517 2565 generic.go:356] "Generic (PLEG): container finished" podID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerID="afa07030156c0cb726e5ada324128952b46d8fa0a14f58acbdd0f390d9ae6394" exitCode=0 Jul 17 14:03:52.706544 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:52.706538 2565 generic.go:356] "Generic (PLEG): container finished" podID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerID="bfebedce3869c8497d3f5e013aa3905f0497731e82b8592fbf9034572e410ee8" exitCode=0 Jul 17 14:03:52.706795 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:52.706590 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" event={"ID":"2e7b18f0-29ad-4288-9501-91c5cfb5c16c","Type":"ContainerDied","Data":"afa07030156c0cb726e5ada324128952b46d8fa0a14f58acbdd0f390d9ae6394"} Jul 17 14:03:52.706795 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:52.706636 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" event={"ID":"2e7b18f0-29ad-4288-9501-91c5cfb5c16c","Type":"ContainerDied","Data":"bfebedce3869c8497d3f5e013aa3905f0497731e82b8592fbf9034572e410ee8"} Jul 17 14:03:56.430629 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:56.430585 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" podUID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused" Jul 17 14:03:57.728427 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:57.728390 2565 generic.go:356] "Generic (PLEG): container finished" podID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerID="e9453a7ccb7a7473cf145618e2334d1a1d28cf5d961fef813a34f6a7b9cc1974" exitCode=0 Jul 17 14:03:57.728780 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:57.728463 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" event={"ID":"b295a6f2-9669-4c56-978a-6ea9a292b8d4","Type":"ContainerDied","Data":"e9453a7ccb7a7473cf145618e2334d1a1d28cf5d961fef813a34f6a7b9cc1974"} Jul 17 14:03:58.735126 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:58.735091 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" event={"ID":"b295a6f2-9669-4c56-978a-6ea9a292b8d4","Type":"ContainerStarted","Data":"fe87c9d545b09fa32560c40ee1a4284145ba1c768cc6ae9505549b79c01f4c9d"} Jul 17 14:03:59.443465 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:03:59.443425 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" podUID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused" Jul 17 14:04:03.756095 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:03.756013 2565 generic.go:356] "Generic (PLEG): container finished" podID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerID="fe87c9d545b09fa32560c40ee1a4284145ba1c768cc6ae9505549b79c01f4c9d" exitCode=0 Jul 17 14:04:03.756095 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:03.756072 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" event={"ID":"b295a6f2-9669-4c56-978a-6ea9a292b8d4","Type":"ContainerDied","Data":"fe87c9d545b09fa32560c40ee1a4284145ba1c768cc6ae9505549b79c01f4c9d"} Jul 17 14:04:04.766435 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:04.766393 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" event={"ID":"b295a6f2-9669-4c56-978a-6ea9a292b8d4","Type":"ContainerStarted","Data":"9defe2a47359790e491a5473450cb528835fdeaa3c70583c98a180bb26226cb9"} Jul 17 14:04:04.766974 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:04.766463 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" event={"ID":"b295a6f2-9669-4c56-978a-6ea9a292b8d4","Type":"ContainerStarted","Data":"980e4ecddfc379a94abfe8bc58a0c6dc6f4743662aff8683e6fe958a006e3a10"} Jul 17 14:04:04.766974 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:04.766489 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" event={"ID":"b295a6f2-9669-4c56-978a-6ea9a292b8d4","Type":"ContainerStarted","Data":"0a3a1919b8c46f7c2346810641245b375cf4d5e0609abe31d3b12552c408652e"} Jul 17 14:04:04.766974 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:04.766505 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" event={"ID":"b295a6f2-9669-4c56-978a-6ea9a292b8d4","Type":"ContainerStarted","Data":"26af6c4ccd0cd9aa3706e6213184342350b3b0d1a0c799876267c5cf656ed05b"} Jul 17 14:04:04.795555 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:04.795485 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" podStartSLOduration=13.795462831 podStartE2EDuration="13.795462831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:03:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:04:04.793065765 +0000 UTC m=+463.621418111" watchObservedRunningTime="2026-07-17 14:04:04.795462831 +0000 UTC m=+463.623815180" Jul 17 14:04:06.430507 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:06.430462 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" podUID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused" Jul 17 14:04:07.351000 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:07.350965 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:04:07.351294 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:07.351273 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:04:07.351438 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:07.351301 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:04:07.351438 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:07.351319 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:04:07.353356 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:07.353324 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" podUID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.24:8816: connect: connection refused" Jul 17 14:04:07.353563 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:07.353394 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" podUID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused" Jul 17 14:04:07.353648 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:07.353405 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" podUID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.24:6571: connect: connection refused" Jul 17 14:04:07.353648 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:07.353416 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" podUID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused" Jul 17 14:04:09.444380 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:09.444327 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" podUID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused" Jul 17 14:04:10.351597 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:10.351568 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:04:10.352136 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:10.352112 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:04:10.352287 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:10.352148 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:04:10.352356 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:10.352335 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:04:10.352411 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:10.352393 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:04:10.357230 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:10.357209 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:04:10.811066 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:10.811036 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:04:10.811611 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:10.811591 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:04:10.811704 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:10.811622 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:04:10.811704 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:10.811696 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:04:10.811800 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:10.811747 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:04:10.814418 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:10.814396 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:04:11.103313 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:11.103237 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:04:16.430615 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:16.430574 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" podUID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.23:6567/health\": dial tcp 10.132.0.23:6567: connect: connection refused" Jul 17 14:04:16.431099 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:16.430722 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:04:19.443426 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:19.443377 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" podUID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.23:8443: connect: connection refused" Jul 17 14:04:19.443933 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:19.443525 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:04:21.805540 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.805512 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:04:21.856299 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.856266 2565 generic.go:356] "Generic (PLEG): container finished" podID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerID="bcd9d0c89d3329cea4fa7d2283f92750c35db83f41b4368ac05a60d2d7654395" exitCode=137 Jul 17 14:04:21.856299 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.856289 2565 generic.go:356] "Generic (PLEG): container finished" podID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerID="a74f2c9540969ee53a0d624582d8498172fc25d23635b07fe6d25195560560f2" exitCode=137 Jul 17 14:04:21.856487 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.856322 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" Jul 17 14:04:21.856487 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.856353 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" event={"ID":"2e7b18f0-29ad-4288-9501-91c5cfb5c16c","Type":"ContainerDied","Data":"bcd9d0c89d3329cea4fa7d2283f92750c35db83f41b4368ac05a60d2d7654395"} Jul 17 14:04:21.856487 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.856404 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" event={"ID":"2e7b18f0-29ad-4288-9501-91c5cfb5c16c","Type":"ContainerDied","Data":"a74f2c9540969ee53a0d624582d8498172fc25d23635b07fe6d25195560560f2"} Jul 17 14:04:21.856487 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.856418 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb" event={"ID":"2e7b18f0-29ad-4288-9501-91c5cfb5c16c","Type":"ContainerDied","Data":"666781447fc83a4577156497d5235f5345cc420c0336ad12b48778a9e53f3e1a"} Jul 17 14:04:21.856487 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.856436 2565 scope.go:117] "RemoveContainer" containerID="afa07030156c0cb726e5ada324128952b46d8fa0a14f58acbdd0f390d9ae6394" Jul 17 14:04:21.864620 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.864604 2565 scope.go:117] "RemoveContainer" containerID="bcd9d0c89d3329cea4fa7d2283f92750c35db83f41b4368ac05a60d2d7654395" Jul 17 14:04:21.872122 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.872104 2565 scope.go:117] "RemoveContainer" containerID="bfebedce3869c8497d3f5e013aa3905f0497731e82b8592fbf9034572e410ee8" Jul 17 14:04:21.879561 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.879543 2565 scope.go:117] "RemoveContainer" containerID="a74f2c9540969ee53a0d624582d8498172fc25d23635b07fe6d25195560560f2" Jul 17 14:04:21.886870 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.886843 2565 scope.go:117] "RemoveContainer" containerID="bc93f362eb090f8cfa5a064f1faf2b9ba5c6b7a34c3e378a332dd5072b4c6b85" Jul 17 14:04:21.893740 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.893724 2565 scope.go:117] "RemoveContainer" containerID="93fb9391a31ddc4c4e3437f86542cf71bc74328e6c53b0fc4b2a818db0721c5d" Jul 17 14:04:21.900504 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.900488 2565 scope.go:117] "RemoveContainer" containerID="afa07030156c0cb726e5ada324128952b46d8fa0a14f58acbdd0f390d9ae6394" Jul 17 14:04:21.900749 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:04:21.900732 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afa07030156c0cb726e5ada324128952b46d8fa0a14f58acbdd0f390d9ae6394\": container with ID starting with afa07030156c0cb726e5ada324128952b46d8fa0a14f58acbdd0f390d9ae6394 not found: ID does not exist" containerID="afa07030156c0cb726e5ada324128952b46d8fa0a14f58acbdd0f390d9ae6394" Jul 17 14:04:21.900799 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.900758 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afa07030156c0cb726e5ada324128952b46d8fa0a14f58acbdd0f390d9ae6394"} err="failed to get container status \"afa07030156c0cb726e5ada324128952b46d8fa0a14f58acbdd0f390d9ae6394\": rpc error: code = NotFound desc = could not find container \"afa07030156c0cb726e5ada324128952b46d8fa0a14f58acbdd0f390d9ae6394\": container with ID starting with afa07030156c0cb726e5ada324128952b46d8fa0a14f58acbdd0f390d9ae6394 not found: ID does not exist" Jul 17 14:04:21.900799 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.900776 2565 scope.go:117] "RemoveContainer" containerID="bcd9d0c89d3329cea4fa7d2283f92750c35db83f41b4368ac05a60d2d7654395" Jul 17 14:04:21.900996 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:04:21.900982 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcd9d0c89d3329cea4fa7d2283f92750c35db83f41b4368ac05a60d2d7654395\": container with ID starting with bcd9d0c89d3329cea4fa7d2283f92750c35db83f41b4368ac05a60d2d7654395 not found: ID does not exist" containerID="bcd9d0c89d3329cea4fa7d2283f92750c35db83f41b4368ac05a60d2d7654395" Jul 17 14:04:21.901040 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.901000 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcd9d0c89d3329cea4fa7d2283f92750c35db83f41b4368ac05a60d2d7654395"} err="failed to get container status \"bcd9d0c89d3329cea4fa7d2283f92750c35db83f41b4368ac05a60d2d7654395\": rpc error: code = NotFound desc = could not find container \"bcd9d0c89d3329cea4fa7d2283f92750c35db83f41b4368ac05a60d2d7654395\": container with ID starting with bcd9d0c89d3329cea4fa7d2283f92750c35db83f41b4368ac05a60d2d7654395 not found: ID does not exist" Jul 17 14:04:21.901040 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.901012 2565 scope.go:117] "RemoveContainer" containerID="bfebedce3869c8497d3f5e013aa3905f0497731e82b8592fbf9034572e410ee8" Jul 17 14:04:21.901224 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:04:21.901205 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfebedce3869c8497d3f5e013aa3905f0497731e82b8592fbf9034572e410ee8\": container with ID starting with bfebedce3869c8497d3f5e013aa3905f0497731e82b8592fbf9034572e410ee8 not found: ID does not exist" containerID="bfebedce3869c8497d3f5e013aa3905f0497731e82b8592fbf9034572e410ee8" Jul 17 14:04:21.901323 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.901228 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfebedce3869c8497d3f5e013aa3905f0497731e82b8592fbf9034572e410ee8"} err="failed to get container status \"bfebedce3869c8497d3f5e013aa3905f0497731e82b8592fbf9034572e410ee8\": rpc error: code = NotFound desc = could not find container \"bfebedce3869c8497d3f5e013aa3905f0497731e82b8592fbf9034572e410ee8\": container with ID starting with bfebedce3869c8497d3f5e013aa3905f0497731e82b8592fbf9034572e410ee8 not found: ID does not exist" Jul 17 14:04:21.901323 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.901246 2565 scope.go:117] "RemoveContainer" containerID="a74f2c9540969ee53a0d624582d8498172fc25d23635b07fe6d25195560560f2" Jul 17 14:04:21.901469 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:04:21.901448 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a74f2c9540969ee53a0d624582d8498172fc25d23635b07fe6d25195560560f2\": container with ID starting with a74f2c9540969ee53a0d624582d8498172fc25d23635b07fe6d25195560560f2 not found: ID does not exist" containerID="a74f2c9540969ee53a0d624582d8498172fc25d23635b07fe6d25195560560f2" Jul 17 14:04:21.901508 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.901476 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a74f2c9540969ee53a0d624582d8498172fc25d23635b07fe6d25195560560f2"} err="failed to get container status \"a74f2c9540969ee53a0d624582d8498172fc25d23635b07fe6d25195560560f2\": rpc error: code = NotFound desc = could not find container \"a74f2c9540969ee53a0d624582d8498172fc25d23635b07fe6d25195560560f2\": container with ID starting with a74f2c9540969ee53a0d624582d8498172fc25d23635b07fe6d25195560560f2 not found: ID does not exist" Jul 17 14:04:21.901508 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.901491 2565 scope.go:117] "RemoveContainer" containerID="bc93f362eb090f8cfa5a064f1faf2b9ba5c6b7a34c3e378a332dd5072b4c6b85" Jul 17 14:04:21.901676 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:04:21.901663 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc93f362eb090f8cfa5a064f1faf2b9ba5c6b7a34c3e378a332dd5072b4c6b85\": container with ID starting with bc93f362eb090f8cfa5a064f1faf2b9ba5c6b7a34c3e378a332dd5072b4c6b85 not found: ID does not exist" containerID="bc93f362eb090f8cfa5a064f1faf2b9ba5c6b7a34c3e378a332dd5072b4c6b85" Jul 17 14:04:21.901716 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.901680 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc93f362eb090f8cfa5a064f1faf2b9ba5c6b7a34c3e378a332dd5072b4c6b85"} err="failed to get container status \"bc93f362eb090f8cfa5a064f1faf2b9ba5c6b7a34c3e378a332dd5072b4c6b85\": rpc error: code = NotFound desc = could not find container \"bc93f362eb090f8cfa5a064f1faf2b9ba5c6b7a34c3e378a332dd5072b4c6b85\": container with ID starting with bc93f362eb090f8cfa5a064f1faf2b9ba5c6b7a34c3e378a332dd5072b4c6b85 not found: ID does not exist" Jul 17 14:04:21.901716 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.901697 2565 scope.go:117] "RemoveContainer" containerID="93fb9391a31ddc4c4e3437f86542cf71bc74328e6c53b0fc4b2a818db0721c5d" Jul 17 14:04:21.901868 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:04:21.901852 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93fb9391a31ddc4c4e3437f86542cf71bc74328e6c53b0fc4b2a818db0721c5d\": container with ID starting with 93fb9391a31ddc4c4e3437f86542cf71bc74328e6c53b0fc4b2a818db0721c5d not found: ID does not exist" containerID="93fb9391a31ddc4c4e3437f86542cf71bc74328e6c53b0fc4b2a818db0721c5d" Jul 17 14:04:21.901933 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.901875 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93fb9391a31ddc4c4e3437f86542cf71bc74328e6c53b0fc4b2a818db0721c5d"} err="failed to get container status \"93fb9391a31ddc4c4e3437f86542cf71bc74328e6c53b0fc4b2a818db0721c5d\": rpc error: code = NotFound desc = could not find container \"93fb9391a31ddc4c4e3437f86542cf71bc74328e6c53b0fc4b2a818db0721c5d\": container with ID starting with 93fb9391a31ddc4c4e3437f86542cf71bc74328e6c53b0fc4b2a818db0721c5d not found: ID does not exist" Jul 17 14:04:21.901933 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.901910 2565 scope.go:117] "RemoveContainer" containerID="afa07030156c0cb726e5ada324128952b46d8fa0a14f58acbdd0f390d9ae6394" Jul 17 14:04:21.902121 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.902103 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afa07030156c0cb726e5ada324128952b46d8fa0a14f58acbdd0f390d9ae6394"} err="failed to get container status \"afa07030156c0cb726e5ada324128952b46d8fa0a14f58acbdd0f390d9ae6394\": rpc error: code = NotFound desc = could not find container \"afa07030156c0cb726e5ada324128952b46d8fa0a14f58acbdd0f390d9ae6394\": container with ID starting with afa07030156c0cb726e5ada324128952b46d8fa0a14f58acbdd0f390d9ae6394 not found: ID does not exist" Jul 17 14:04:21.902166 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.902123 2565 scope.go:117] "RemoveContainer" containerID="bcd9d0c89d3329cea4fa7d2283f92750c35db83f41b4368ac05a60d2d7654395" Jul 17 14:04:21.902574 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.902555 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcd9d0c89d3329cea4fa7d2283f92750c35db83f41b4368ac05a60d2d7654395"} err="failed to get container status \"bcd9d0c89d3329cea4fa7d2283f92750c35db83f41b4368ac05a60d2d7654395\": rpc error: code = NotFound desc = could not find container \"bcd9d0c89d3329cea4fa7d2283f92750c35db83f41b4368ac05a60d2d7654395\": container with ID starting with bcd9d0c89d3329cea4fa7d2283f92750c35db83f41b4368ac05a60d2d7654395 not found: ID does not exist" Jul 17 14:04:21.902574 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.902574 2565 scope.go:117] "RemoveContainer" containerID="bfebedce3869c8497d3f5e013aa3905f0497731e82b8592fbf9034572e410ee8" Jul 17 14:04:21.902787 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.902769 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfebedce3869c8497d3f5e013aa3905f0497731e82b8592fbf9034572e410ee8"} err="failed to get container status \"bfebedce3869c8497d3f5e013aa3905f0497731e82b8592fbf9034572e410ee8\": rpc error: code = NotFound desc = could not find container \"bfebedce3869c8497d3f5e013aa3905f0497731e82b8592fbf9034572e410ee8\": container with ID starting with bfebedce3869c8497d3f5e013aa3905f0497731e82b8592fbf9034572e410ee8 not found: ID does not exist" Jul 17 14:04:21.902854 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.902789 2565 scope.go:117] "RemoveContainer" containerID="a74f2c9540969ee53a0d624582d8498172fc25d23635b07fe6d25195560560f2" Jul 17 14:04:21.903031 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.903012 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a74f2c9540969ee53a0d624582d8498172fc25d23635b07fe6d25195560560f2"} err="failed to get container status \"a74f2c9540969ee53a0d624582d8498172fc25d23635b07fe6d25195560560f2\": rpc error: code = NotFound desc = could not find container \"a74f2c9540969ee53a0d624582d8498172fc25d23635b07fe6d25195560560f2\": container with ID starting with a74f2c9540969ee53a0d624582d8498172fc25d23635b07fe6d25195560560f2 not found: ID does not exist" Jul 17 14:04:21.903076 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.903033 2565 scope.go:117] "RemoveContainer" containerID="bc93f362eb090f8cfa5a064f1faf2b9ba5c6b7a34c3e378a332dd5072b4c6b85" Jul 17 14:04:21.903259 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.903241 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc93f362eb090f8cfa5a064f1faf2b9ba5c6b7a34c3e378a332dd5072b4c6b85"} err="failed to get container status \"bc93f362eb090f8cfa5a064f1faf2b9ba5c6b7a34c3e378a332dd5072b4c6b85\": rpc error: code = NotFound desc = could not find container \"bc93f362eb090f8cfa5a064f1faf2b9ba5c6b7a34c3e378a332dd5072b4c6b85\": container with ID starting with bc93f362eb090f8cfa5a064f1faf2b9ba5c6b7a34c3e378a332dd5072b4c6b85 not found: ID does not exist" Jul 17 14:04:21.903308 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.903260 2565 scope.go:117] "RemoveContainer" containerID="93fb9391a31ddc4c4e3437f86542cf71bc74328e6c53b0fc4b2a818db0721c5d" Jul 17 14:04:21.903467 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.903451 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93fb9391a31ddc4c4e3437f86542cf71bc74328e6c53b0fc4b2a818db0721c5d"} err="failed to get container status \"93fb9391a31ddc4c4e3437f86542cf71bc74328e6c53b0fc4b2a818db0721c5d\": rpc error: code = NotFound desc = could not find container \"93fb9391a31ddc4c4e3437f86542cf71bc74328e6c53b0fc4b2a818db0721c5d\": container with ID starting with 93fb9391a31ddc4c4e3437f86542cf71bc74328e6c53b0fc4b2a818db0721c5d not found: ID does not exist" Jul 17 14:04:21.963671 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.963604 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-ui-tls\") pod \"2e7b18f0-29ad-4288-9501-91c5cfb5c16c\" (UID: \"2e7b18f0-29ad-4288-9501-91c5cfb5c16c\") " Jul 17 14:04:21.963671 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.963655 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77dv5\" (UniqueName: \"kubernetes.io/projected/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-kube-api-access-77dv5\") pod \"2e7b18f0-29ad-4288-9501-91c5cfb5c16c\" (UID: \"2e7b18f0-29ad-4288-9501-91c5cfb5c16c\") " Jul 17 14:04:21.963847 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.963707 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-online-tls\") pod \"2e7b18f0-29ad-4288-9501-91c5cfb5c16c\" (UID: \"2e7b18f0-29ad-4288-9501-91c5cfb5c16c\") " Jul 17 14:04:21.963847 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.963738 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-feast-data\") pod \"2e7b18f0-29ad-4288-9501-91c5cfb5c16c\" (UID: \"2e7b18f0-29ad-4288-9501-91c5cfb5c16c\") " Jul 17 14:04:21.963847 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.963769 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-registry-tls\") pod \"2e7b18f0-29ad-4288-9501-91c5cfb5c16c\" (UID: \"2e7b18f0-29ad-4288-9501-91c5cfb5c16c\") " Jul 17 14:04:21.963847 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.963813 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-offline-tls\") pod \"2e7b18f0-29ad-4288-9501-91c5cfb5c16c\" (UID: \"2e7b18f0-29ad-4288-9501-91c5cfb5c16c\") " Jul 17 14:04:21.964976 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.964943 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-feast-data" (OuterVolumeSpecName: "feast-data") pod "2e7b18f0-29ad-4288-9501-91c5cfb5c16c" (UID: "2e7b18f0-29ad-4288-9501-91c5cfb5c16c"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 14:04:21.966688 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.966644 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "2e7b18f0-29ad-4288-9501-91c5cfb5c16c" (UID: "2e7b18f0-29ad-4288-9501-91c5cfb5c16c"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:04:21.967148 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.967119 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-online-tls" (OuterVolumeSpecName: "online-tls") pod "2e7b18f0-29ad-4288-9501-91c5cfb5c16c" (UID: "2e7b18f0-29ad-4288-9501-91c5cfb5c16c"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:04:21.969207 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.968506 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2e7b18f0-29ad-4288-9501-91c5cfb5c16c" (UID: "2e7b18f0-29ad-4288-9501-91c5cfb5c16c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:04:21.969207 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.968799 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-kube-api-access-77dv5" (OuterVolumeSpecName: "kube-api-access-77dv5") pod "2e7b18f0-29ad-4288-9501-91c5cfb5c16c" (UID: "2e7b18f0-29ad-4288-9501-91c5cfb5c16c"). InnerVolumeSpecName "kube-api-access-77dv5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 14:04:21.972520 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:21.972495 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "2e7b18f0-29ad-4288-9501-91c5cfb5c16c" (UID: "2e7b18f0-29ad-4288-9501-91c5cfb5c16c"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:04:22.065492 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:22.065458 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77dv5\" (UniqueName: \"kubernetes.io/projected/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-kube-api-access-77dv5\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:04:22.065492 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:22.065486 2565 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-online-tls\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:04:22.065492 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:22.065496 2565 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-feast-data\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:04:22.065684 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:22.065504 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-registry-tls\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:04:22.065684 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:22.065512 2565 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-offline-tls\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:04:22.065684 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:22.065520 2565 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2e7b18f0-29ad-4288-9501-91c5cfb5c16c-ui-tls\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:04:22.181998 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:22.181952 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb"] Jul 17 14:04:22.188072 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:22.188043 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-54c65966b6-n6wfb"] Jul 17 14:04:23.696595 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:04:23.696563 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" path="/var/lib/kubelet/pods/2e7b18f0-29ad-4288-9501-91c5cfb5c16c/volumes" Jul 17 14:05:12.972303 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:12.972213 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:05:13.073541 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.073508 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:05:13.173889 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.173855 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:05:13.270727 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.270616 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:05:13.271961 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.271940 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz"] Jul 17 14:05:13.272289 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.272276 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerName="ui" Jul 17 14:05:13.272337 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.272291 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerName="ui" Jul 17 14:05:13.272337 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.272308 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerName="offline" Jul 17 14:05:13.272337 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.272313 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerName="offline" Jul 17 14:05:13.272337 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.272322 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerName="feast-apply" Jul 17 14:05:13.272337 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.272327 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerName="feast-apply" Jul 17 14:05:13.272337 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.272334 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerName="online" Jul 17 14:05:13.272521 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.272342 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerName="online" Jul 17 14:05:13.272521 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.272352 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerName="feast-init" Jul 17 14:05:13.272521 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.272357 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerName="feast-init" Jul 17 14:05:13.272521 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.272364 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerName="registry" Jul 17 14:05:13.272521 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.272369 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerName="registry" Jul 17 14:05:13.272521 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.272432 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerName="online" Jul 17 14:05:13.272521 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.272442 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerName="registry" Jul 17 14:05:13.272521 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.272448 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerName="ui" Jul 17 14:05:13.272521 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.272455 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e7b18f0-29ad-4288-9501-91c5cfb5c16c" containerName="offline" Jul 17 14:05:13.275774 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.275758 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:05:13.279067 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.279042 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\"" Jul 17 14:05:13.279210 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.279066 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\"" Jul 17 14:05:13.279210 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.279092 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\"" Jul 17 14:05:13.279638 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.279620 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\"" Jul 17 14:05:13.279909 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.279895 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-zpk4r\"" Jul 17 14:05:13.279965 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.279921 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\"" Jul 17 14:05:13.279965 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.279956 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\"" Jul 17 14:05:13.280363 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.280349 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\"" Jul 17 14:05:13.294830 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.294808 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz"] Jul 17 14:05:13.382588 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.382551 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:05:13.390649 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.390630 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-registry-tls\") pod \"feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz\" (UID: \"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:05:13.390740 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.390658 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-offline-tls\") pod \"feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz\" (UID: \"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:05:13.390788 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.390744 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-feast-data\") pod \"feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz\" (UID: \"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:05:13.390827 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.390788 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgk44\" (UniqueName: \"kubernetes.io/projected/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-kube-api-access-bgk44\") pod \"feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz\" (UID: \"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:05:13.390827 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.390805 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-online-tls\") pod \"feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz\" (UID: \"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:05:13.390827 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.390824 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-ui-tls\") pod \"feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz\" (UID: \"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:05:13.441505 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.441467 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:05:13.491370 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.491338 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-ui-tls\") pod \"feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz\" (UID: \"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:05:13.491532 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.491379 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-registry-tls\") pod \"feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz\" (UID: \"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:05:13.491532 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.491395 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-offline-tls\") pod \"feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz\" (UID: \"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:05:13.491532 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.491443 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-feast-data\") pod \"feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz\" (UID: \"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:05:13.491532 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.491481 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgk44\" (UniqueName: \"kubernetes.io/projected/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-kube-api-access-bgk44\") pod \"feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz\" (UID: \"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:05:13.491532 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.491497 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-online-tls\") pod \"feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz\" (UID: \"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:05:13.491780 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:05:13.491590 2565 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found Jul 17 14:05:13.491780 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:05:13.491663 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-online-tls podName:aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d nodeName:}" failed. No retries permitted until 2026-07-17 14:05:13.991643801 +0000 UTC m=+532.819996126 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-online-tls") pod "feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" (UID: "aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d") : secret "feast-simple-feast-remote-setup-online-tls" not found Jul 17 14:05:13.492000 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.491978 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-feast-data\") pod \"feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz\" (UID: \"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:05:13.492249 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.492231 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-registry-tls\") pod \"feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz\" (UID: \"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:05:13.493902 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.493883 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-ui-tls\") pod \"feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz\" (UID: \"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:05:13.493985 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.493933 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-offline-tls\") pod \"feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz\" (UID: \"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:05:13.499641 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.499619 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgk44\" (UniqueName: \"kubernetes.io/projected/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-kube-api-access-bgk44\") pod \"feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz\" (UID: \"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:05:13.573241 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.573204 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:05:13.994384 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.994309 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-online-tls\") pod \"feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz\" (UID: \"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:05:13.996904 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:13.996871 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-online-tls\") pod \"feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz\" (UID: \"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:05:14.190071 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:14.190023 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:05:14.322387 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:14.322365 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz"] Jul 17 14:05:14.324290 ip-10-0-138-92 kubenswrapper[2565]: W0717 14:05:14.324260 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa4853f9_df8b_4e5f_8f47_e0e506d7fc1d.slice/crio-43eeaf10a49916467699d736d07a6901c4a7d469d40d55648fe709598a0cd9df WatchSource:0}: Error finding container 43eeaf10a49916467699d736d07a6901c4a7d469d40d55648fe709598a0cd9df: Status 404 returned error can't find the container with id 43eeaf10a49916467699d736d07a6901c4a7d469d40d55648fe709598a0cd9df Jul 17 14:05:15.068845 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:15.068805 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" event={"ID":"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d","Type":"ContainerStarted","Data":"508c6f95b755954c2b675d0d01136fa1eb8fa542fe22f8f6ed695c52a1154693"} Jul 17 14:05:15.069292 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:15.068861 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" event={"ID":"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d","Type":"ContainerStarted","Data":"43eeaf10a49916467699d736d07a6901c4a7d469d40d55648fe709598a0cd9df"} Jul 17 14:05:19.086717 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:19.086682 2565 generic.go:356] "Generic (PLEG): container finished" podID="aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" containerID="508c6f95b755954c2b675d0d01136fa1eb8fa542fe22f8f6ed695c52a1154693" exitCode=0 Jul 17 14:05:19.087060 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:19.086759 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" event={"ID":"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d","Type":"ContainerDied","Data":"508c6f95b755954c2b675d0d01136fa1eb8fa542fe22f8f6ed695c52a1154693"} Jul 17 14:05:20.093431 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:20.093387 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" event={"ID":"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d","Type":"ContainerStarted","Data":"0562ad0f05ea4d961cc0be8fc4bcae7d0636ad4b9b502dfa7d70e1f256200012"} Jul 17 14:05:25.116586 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:25.116554 2565 generic.go:356] "Generic (PLEG): container finished" podID="aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" containerID="0562ad0f05ea4d961cc0be8fc4bcae7d0636ad4b9b502dfa7d70e1f256200012" exitCode=0 Jul 17 14:05:25.117033 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:25.116636 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" event={"ID":"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d","Type":"ContainerDied","Data":"0562ad0f05ea4d961cc0be8fc4bcae7d0636ad4b9b502dfa7d70e1f256200012"} Jul 17 14:05:25.119858 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:25.119839 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\"" Jul 17 14:05:26.125429 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:26.125392 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" event={"ID":"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d","Type":"ContainerStarted","Data":"c2ec8fc0fef98fd98c22fdaf4bdcc614080d93312d22a9bc9a0570e65ebb120e"} Jul 17 14:05:26.125896 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:26.125446 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" event={"ID":"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d","Type":"ContainerStarted","Data":"d5a09c7b0c68c89bdb884db4da5a1758e01ed5aa7118404d5e720c7652a1f4f0"} Jul 17 14:05:26.125896 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:26.125462 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" event={"ID":"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d","Type":"ContainerStarted","Data":"e286204920be6bf83bc1436a3c736b5193eef323c6036b67eadd4dc2f8eea911"} Jul 17 14:05:26.147717 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:26.147662 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" podStartSLOduration=13.147641422 podStartE2EDuration="13.147641422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:05:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:05:26.146842288 +0000 UTC m=+544.975194635" watchObservedRunningTime="2026-07-17 14:05:26.147641422 +0000 UTC m=+544.975993769" Jul 17 14:05:26.191039 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:26.191003 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:05:26.191251 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:26.191062 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:05:26.191251 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:26.191082 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:05:26.193249 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:26.193217 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" podUID="aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused" Jul 17 14:05:26.193376 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:26.193254 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" podUID="aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.25:8816: connect: connection refused" Jul 17 14:05:26.193376 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:26.193269 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" podUID="aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused" Jul 17 14:05:29.190858 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:29.190811 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" podUID="aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused" Jul 17 14:05:29.191344 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:29.190811 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" podUID="aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.25:8816: connect: connection refused" Jul 17 14:05:29.191421 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:29.191363 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" podUID="aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused" Jul 17 14:05:32.191630 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:32.191595 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:05:32.192226 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:32.192202 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:05:32.192291 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:32.192250 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:05:32.192338 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:32.192297 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:05:32.197990 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:32.197970 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:05:33.158906 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:33.158879 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:05:33.159102 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:33.158948 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:05:33.159315 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:33.159297 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:05:33.163630 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:33.163608 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:05:33.442616 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:05:33.442530 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:06:03.942291 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:06:03.942252 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:06:03.996540 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:06:03.996481 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:06:21.584596 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:06:21.584570 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-86jkr_c4b20c0f-f85e-488d-aee9-b772cb8738a0/console-operator/1.log" Jul 17 14:06:21.585012 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:06:21.584739 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-86jkr_c4b20c0f-f85e-488d-aee9-b772cb8738a0/console-operator/1.log" Jul 17 14:06:34.601675 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:06:34.601641 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz"] Jul 17 14:06:34.604397 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:06:34.601909 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" podUID="aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" containerName="online" containerID="cri-o://e286204920be6bf83bc1436a3c736b5193eef323c6036b67eadd4dc2f8eea911" gracePeriod=30 Jul 17 14:06:34.604397 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:06:34.601999 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" podUID="aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" containerName="offline" containerID="cri-o://d5a09c7b0c68c89bdb884db4da5a1758e01ed5aa7118404d5e720c7652a1f4f0" gracePeriod=30 Jul 17 14:06:34.604397 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:06:34.602341 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" podUID="aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" containerName="ui" containerID="cri-o://c2ec8fc0fef98fd98c22fdaf4bdcc614080d93312d22a9bc9a0570e65ebb120e" gracePeriod=30 Jul 17 14:06:34.608835 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:06:34.608800 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:06:34.670556 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:06:34.670519 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:06:34.724077 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:06:34.724043 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl"] Jul 17 14:06:34.724380 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:06:34.724348 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" podUID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerName="registry" containerID="cri-o://26af6c4ccd0cd9aa3706e6213184342350b3b0d1a0c799876267c5cf656ed05b" gracePeriod=30 Jul 17 14:06:34.724550 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:06:34.724503 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" podUID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerName="offline" containerID="cri-o://980e4ecddfc379a94abfe8bc58a0c6dc6f4743662aff8683e6fe958a006e3a10" gracePeriod=30 Jul 17 14:06:34.724659 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:06:34.724432 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" podUID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerName="online" containerID="cri-o://0a3a1919b8c46f7c2346810641245b375cf4d5e0609abe31d3b12552c408652e" gracePeriod=30 Jul 17 14:06:34.724741 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:06:34.724377 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" podUID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerName="ui" containerID="cri-o://9defe2a47359790e491a5473450cb528835fdeaa3c70583c98a180bb26226cb9" gracePeriod=30 Jul 17 14:06:34.743230 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:06:34.743157 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:06:35.417125 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:06:35.417093 2565 generic.go:356] "Generic (PLEG): container finished" podID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerID="9defe2a47359790e491a5473450cb528835fdeaa3c70583c98a180bb26226cb9" exitCode=0 Jul 17 14:06:35.417289 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:06:35.417173 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" event={"ID":"b295a6f2-9669-4c56-978a-6ea9a292b8d4","Type":"ContainerDied","Data":"9defe2a47359790e491a5473450cb528835fdeaa3c70583c98a180bb26226cb9"} Jul 17 14:06:35.419639 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:06:35.419618 2565 generic.go:356] "Generic (PLEG): container finished" podID="aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" containerID="c2ec8fc0fef98fd98c22fdaf4bdcc614080d93312d22a9bc9a0570e65ebb120e" exitCode=0 Jul 17 14:06:35.419639 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:06:35.419637 2565 generic.go:356] "Generic (PLEG): container finished" podID="aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" containerID="e286204920be6bf83bc1436a3c736b5193eef323c6036b67eadd4dc2f8eea911" exitCode=0 Jul 17 14:06:35.419768 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:06:35.419670 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" event={"ID":"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d","Type":"ContainerDied","Data":"c2ec8fc0fef98fd98c22fdaf4bdcc614080d93312d22a9bc9a0570e65ebb120e"} Jul 17 14:06:35.419768 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:06:35.419694 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" event={"ID":"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d","Type":"ContainerDied","Data":"e286204920be6bf83bc1436a3c736b5193eef323c6036b67eadd4dc2f8eea911"} Jul 17 14:06:36.425997 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:06:36.425968 2565 generic.go:356] "Generic (PLEG): container finished" podID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerID="0a3a1919b8c46f7c2346810641245b375cf4d5e0609abe31d3b12552c408652e" exitCode=0 Jul 17 14:06:36.426404 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:06:36.426046 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" event={"ID":"b295a6f2-9669-4c56-978a-6ea9a292b8d4","Type":"ContainerDied","Data":"0a3a1919b8c46f7c2346810641245b375cf4d5e0609abe31d3b12552c408652e"} Jul 17 14:06:40.811821 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:06:40.811776 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" podUID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused" Jul 17 14:06:40.812336 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:06:40.811792 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" podUID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused" Jul 17 14:06:43.159704 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:06:43.159620 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" podUID="aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused" Jul 17 14:06:43.159704 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:06:43.159630 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" podUID="aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused" Jul 17 14:06:44.895098 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:06:44.895055 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:06:44.956888 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:06:44.956852 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:06:50.811366 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:06:50.811317 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" podUID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused" Jul 17 14:06:50.811753 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:06:50.811356 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" podUID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused" Jul 17 14:06:53.159846 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:06:53.159804 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" podUID="aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused" Jul 17 14:06:53.160222 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:06:53.159817 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" podUID="aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused" Jul 17 14:07:00.811411 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:00.811372 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" podUID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused" Jul 17 14:07:00.811821 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:00.811366 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" podUID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused" Jul 17 14:07:00.811821 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:00.811522 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:07:00.811821 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:00.811593 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:07:03.159418 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:03.159377 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" podUID="aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused" Jul 17 14:07:03.159850 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:03.159389 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" podUID="aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused" Jul 17 14:07:03.159850 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:03.159536 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:07:03.159850 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:03.159582 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:07:05.257281 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.257255 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:07:05.388286 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.388262 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:07:05.438688 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.438659 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-feast-data\") pod \"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d\" (UID: \"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d\") " Jul 17 14:07:05.438829 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.438699 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-offline-tls\") pod \"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d\" (UID: \"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d\") " Jul 17 14:07:05.438829 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.438727 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-registry-tls\") pod \"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d\" (UID: \"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d\") " Jul 17 14:07:05.438829 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.438774 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-ui-tls\") pod \"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d\" (UID: \"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d\") " Jul 17 14:07:05.438829 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.438801 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-online-tls\") pod \"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d\" (UID: \"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d\") " Jul 17 14:07:05.439030 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.438843 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgk44\" (UniqueName: \"kubernetes.io/projected/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-kube-api-access-bgk44\") pod \"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d\" (UID: \"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d\") " Jul 17 14:07:05.439086 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.439050 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" (UID: "aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 17 14:07:05.439219 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.439167 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-feast-data" (OuterVolumeSpecName: "feast-data") pod "aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" (UID: "aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 14:07:05.441081 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.441053 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" (UID: "aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:07:05.441081 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.441067 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-online-tls" (OuterVolumeSpecName: "online-tls") pod "aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" (UID: "aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:07:05.441475 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.441444 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" (UID: "aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:07:05.441554 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.441450 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-kube-api-access-bgk44" (OuterVolumeSpecName: "kube-api-access-bgk44") pod "aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" (UID: "aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d"). InnerVolumeSpecName "kube-api-access-bgk44". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 14:07:05.539905 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.539876 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b295a6f2-9669-4c56-978a-6ea9a292b8d4-offline-tls\") pod \"b295a6f2-9669-4c56-978a-6ea9a292b8d4\" (UID: \"b295a6f2-9669-4c56-978a-6ea9a292b8d4\") " Jul 17 14:07:05.540061 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.539945 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whpwb\" (UniqueName: \"kubernetes.io/projected/b295a6f2-9669-4c56-978a-6ea9a292b8d4-kube-api-access-whpwb\") pod \"b295a6f2-9669-4c56-978a-6ea9a292b8d4\" (UID: \"b295a6f2-9669-4c56-978a-6ea9a292b8d4\") " Jul 17 14:07:05.540061 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.540001 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b295a6f2-9669-4c56-978a-6ea9a292b8d4-registry-tls\") pod \"b295a6f2-9669-4c56-978a-6ea9a292b8d4\" (UID: \"b295a6f2-9669-4c56-978a-6ea9a292b8d4\") " Jul 17 14:07:05.540061 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.540025 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b295a6f2-9669-4c56-978a-6ea9a292b8d4-online-tls\") pod \"b295a6f2-9669-4c56-978a-6ea9a292b8d4\" (UID: \"b295a6f2-9669-4c56-978a-6ea9a292b8d4\") " Jul 17 14:07:05.540268 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.540134 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b295a6f2-9669-4c56-978a-6ea9a292b8d4-ui-tls\") pod \"b295a6f2-9669-4c56-978a-6ea9a292b8d4\" (UID: \"b295a6f2-9669-4c56-978a-6ea9a292b8d4\") " Jul 17 14:07:05.540268 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.540259 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b295a6f2-9669-4c56-978a-6ea9a292b8d4-feast-data\") pod \"b295a6f2-9669-4c56-978a-6ea9a292b8d4\" (UID: \"b295a6f2-9669-4c56-978a-6ea9a292b8d4\") " Jul 17 14:07:05.540666 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.540505 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgk44\" (UniqueName: \"kubernetes.io/projected/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-kube-api-access-bgk44\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:07:05.540666 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.540532 2565 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-feast-data\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:07:05.540666 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.540545 2565 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-offline-tls\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:07:05.540666 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.540558 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-registry-tls\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:07:05.540666 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.540570 2565 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-ui-tls\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:07:05.540666 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.540582 2565 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d-online-tls\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:07:05.541142 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.541002 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b295a6f2-9669-4c56-978a-6ea9a292b8d4-feast-data" (OuterVolumeSpecName: "feast-data") pod "b295a6f2-9669-4c56-978a-6ea9a292b8d4" (UID: "b295a6f2-9669-4c56-978a-6ea9a292b8d4"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 14:07:05.542335 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.542303 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b295a6f2-9669-4c56-978a-6ea9a292b8d4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b295a6f2-9669-4c56-978a-6ea9a292b8d4" (UID: "b295a6f2-9669-4c56-978a-6ea9a292b8d4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:07:05.542427 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.542371 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b295a6f2-9669-4c56-978a-6ea9a292b8d4-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "b295a6f2-9669-4c56-978a-6ea9a292b8d4" (UID: "b295a6f2-9669-4c56-978a-6ea9a292b8d4"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:07:05.542466 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.542443 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b295a6f2-9669-4c56-978a-6ea9a292b8d4-online-tls" (OuterVolumeSpecName: "online-tls") pod "b295a6f2-9669-4c56-978a-6ea9a292b8d4" (UID: "b295a6f2-9669-4c56-978a-6ea9a292b8d4"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:07:05.542615 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.542598 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b295a6f2-9669-4c56-978a-6ea9a292b8d4-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "b295a6f2-9669-4c56-978a-6ea9a292b8d4" (UID: "b295a6f2-9669-4c56-978a-6ea9a292b8d4"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:07:05.542974 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.542953 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b295a6f2-9669-4c56-978a-6ea9a292b8d4-kube-api-access-whpwb" (OuterVolumeSpecName: "kube-api-access-whpwb") pod "b295a6f2-9669-4c56-978a-6ea9a292b8d4" (UID: "b295a6f2-9669-4c56-978a-6ea9a292b8d4"). InnerVolumeSpecName "kube-api-access-whpwb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 14:07:05.547748 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.547720 2565 generic.go:356] "Generic (PLEG): container finished" podID="aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" containerID="d5a09c7b0c68c89bdb884db4da5a1758e01ed5aa7118404d5e720c7652a1f4f0" exitCode=137 Jul 17 14:07:05.547859 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.547817 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" Jul 17 14:07:05.547859 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.547809 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" event={"ID":"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d","Type":"ContainerDied","Data":"d5a09c7b0c68c89bdb884db4da5a1758e01ed5aa7118404d5e720c7652a1f4f0"} Jul 17 14:07:05.547962 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.547865 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz" event={"ID":"aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d","Type":"ContainerDied","Data":"43eeaf10a49916467699d736d07a6901c4a7d469d40d55648fe709598a0cd9df"} Jul 17 14:07:05.547962 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.547889 2565 scope.go:117] "RemoveContainer" containerID="c2ec8fc0fef98fd98c22fdaf4bdcc614080d93312d22a9bc9a0570e65ebb120e" Jul 17 14:07:05.550802 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.550778 2565 generic.go:356] "Generic (PLEG): container finished" podID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerID="980e4ecddfc379a94abfe8bc58a0c6dc6f4743662aff8683e6fe958a006e3a10" exitCode=137 Jul 17 14:07:05.550894 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.550802 2565 generic.go:356] "Generic (PLEG): container finished" podID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerID="26af6c4ccd0cd9aa3706e6213184342350b3b0d1a0c799876267c5cf656ed05b" exitCode=137 Jul 17 14:07:05.550894 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.550831 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" Jul 17 14:07:05.550894 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.550853 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" event={"ID":"b295a6f2-9669-4c56-978a-6ea9a292b8d4","Type":"ContainerDied","Data":"980e4ecddfc379a94abfe8bc58a0c6dc6f4743662aff8683e6fe958a006e3a10"} Jul 17 14:07:05.550987 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.550927 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" event={"ID":"b295a6f2-9669-4c56-978a-6ea9a292b8d4","Type":"ContainerDied","Data":"26af6c4ccd0cd9aa3706e6213184342350b3b0d1a0c799876267c5cf656ed05b"} Jul 17 14:07:05.551038 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.551022 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl" event={"ID":"b295a6f2-9669-4c56-978a-6ea9a292b8d4","Type":"ContainerDied","Data":"e9db6591cee37b474dca4a9e2c491cf97215d2c8e3f78d910c8647099ac8cb51"} Jul 17 14:07:05.558227 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.558169 2565 scope.go:117] "RemoveContainer" containerID="d5a09c7b0c68c89bdb884db4da5a1758e01ed5aa7118404d5e720c7652a1f4f0" Jul 17 14:07:05.566298 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.566283 2565 scope.go:117] "RemoveContainer" containerID="e286204920be6bf83bc1436a3c736b5193eef323c6036b67eadd4dc2f8eea911" Jul 17 14:07:05.573388 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.573367 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz"] Jul 17 14:07:05.574063 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.574050 2565 scope.go:117] "RemoveContainer" containerID="0562ad0f05ea4d961cc0be8fc4bcae7d0636ad4b9b502dfa7d70e1f256200012" Jul 17 14:07:05.578482 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.578464 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-7dfcf79dfb-q8jdz"] Jul 17 14:07:05.582030 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.582015 2565 scope.go:117] "RemoveContainer" containerID="508c6f95b755954c2b675d0d01136fa1eb8fa542fe22f8f6ed695c52a1154693" Jul 17 14:07:05.588750 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.588730 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl"] Jul 17 14:07:05.589853 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.589824 2565 scope.go:117] "RemoveContainer" containerID="c2ec8fc0fef98fd98c22fdaf4bdcc614080d93312d22a9bc9a0570e65ebb120e" Jul 17 14:07:05.590086 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:07:05.590066 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2ec8fc0fef98fd98c22fdaf4bdcc614080d93312d22a9bc9a0570e65ebb120e\": container with ID starting with c2ec8fc0fef98fd98c22fdaf4bdcc614080d93312d22a9bc9a0570e65ebb120e not found: ID does not exist" containerID="c2ec8fc0fef98fd98c22fdaf4bdcc614080d93312d22a9bc9a0570e65ebb120e" Jul 17 14:07:05.590163 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.590092 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2ec8fc0fef98fd98c22fdaf4bdcc614080d93312d22a9bc9a0570e65ebb120e"} err="failed to get container status \"c2ec8fc0fef98fd98c22fdaf4bdcc614080d93312d22a9bc9a0570e65ebb120e\": rpc error: code = NotFound desc = could not find container \"c2ec8fc0fef98fd98c22fdaf4bdcc614080d93312d22a9bc9a0570e65ebb120e\": container with ID starting with c2ec8fc0fef98fd98c22fdaf4bdcc614080d93312d22a9bc9a0570e65ebb120e not found: ID does not exist" Jul 17 14:07:05.590163 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.590108 2565 scope.go:117] "RemoveContainer" containerID="d5a09c7b0c68c89bdb884db4da5a1758e01ed5aa7118404d5e720c7652a1f4f0" Jul 17 14:07:05.590357 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:07:05.590343 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5a09c7b0c68c89bdb884db4da5a1758e01ed5aa7118404d5e720c7652a1f4f0\": container with ID starting with d5a09c7b0c68c89bdb884db4da5a1758e01ed5aa7118404d5e720c7652a1f4f0 not found: ID does not exist" containerID="d5a09c7b0c68c89bdb884db4da5a1758e01ed5aa7118404d5e720c7652a1f4f0" Jul 17 14:07:05.590399 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.590370 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5a09c7b0c68c89bdb884db4da5a1758e01ed5aa7118404d5e720c7652a1f4f0"} err="failed to get container status \"d5a09c7b0c68c89bdb884db4da5a1758e01ed5aa7118404d5e720c7652a1f4f0\": rpc error: code = NotFound desc = could not find container \"d5a09c7b0c68c89bdb884db4da5a1758e01ed5aa7118404d5e720c7652a1f4f0\": container with ID starting with d5a09c7b0c68c89bdb884db4da5a1758e01ed5aa7118404d5e720c7652a1f4f0 not found: ID does not exist" Jul 17 14:07:05.590399 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.590384 2565 scope.go:117] "RemoveContainer" containerID="e286204920be6bf83bc1436a3c736b5193eef323c6036b67eadd4dc2f8eea911" Jul 17 14:07:05.590568 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:07:05.590551 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e286204920be6bf83bc1436a3c736b5193eef323c6036b67eadd4dc2f8eea911\": container with ID starting with e286204920be6bf83bc1436a3c736b5193eef323c6036b67eadd4dc2f8eea911 not found: ID does not exist" containerID="e286204920be6bf83bc1436a3c736b5193eef323c6036b67eadd4dc2f8eea911" Jul 17 14:07:05.590611 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.590573 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e286204920be6bf83bc1436a3c736b5193eef323c6036b67eadd4dc2f8eea911"} err="failed to get container status \"e286204920be6bf83bc1436a3c736b5193eef323c6036b67eadd4dc2f8eea911\": rpc error: code = NotFound desc = could not find container \"e286204920be6bf83bc1436a3c736b5193eef323c6036b67eadd4dc2f8eea911\": container with ID starting with e286204920be6bf83bc1436a3c736b5193eef323c6036b67eadd4dc2f8eea911 not found: ID does not exist" Jul 17 14:07:05.590611 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.590589 2565 scope.go:117] "RemoveContainer" containerID="0562ad0f05ea4d961cc0be8fc4bcae7d0636ad4b9b502dfa7d70e1f256200012" Jul 17 14:07:05.590885 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:07:05.590858 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0562ad0f05ea4d961cc0be8fc4bcae7d0636ad4b9b502dfa7d70e1f256200012\": container with ID starting with 0562ad0f05ea4d961cc0be8fc4bcae7d0636ad4b9b502dfa7d70e1f256200012 not found: ID does not exist" containerID="0562ad0f05ea4d961cc0be8fc4bcae7d0636ad4b9b502dfa7d70e1f256200012" Jul 17 14:07:05.590959 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.590892 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0562ad0f05ea4d961cc0be8fc4bcae7d0636ad4b9b502dfa7d70e1f256200012"} err="failed to get container status \"0562ad0f05ea4d961cc0be8fc4bcae7d0636ad4b9b502dfa7d70e1f256200012\": rpc error: code = NotFound desc = could not find container \"0562ad0f05ea4d961cc0be8fc4bcae7d0636ad4b9b502dfa7d70e1f256200012\": container with ID starting with 0562ad0f05ea4d961cc0be8fc4bcae7d0636ad4b9b502dfa7d70e1f256200012 not found: ID does not exist" Jul 17 14:07:05.590959 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.590913 2565 scope.go:117] "RemoveContainer" containerID="508c6f95b755954c2b675d0d01136fa1eb8fa542fe22f8f6ed695c52a1154693" Jul 17 14:07:05.591209 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:07:05.591154 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"508c6f95b755954c2b675d0d01136fa1eb8fa542fe22f8f6ed695c52a1154693\": container with ID starting with 508c6f95b755954c2b675d0d01136fa1eb8fa542fe22f8f6ed695c52a1154693 not found: ID does not exist" containerID="508c6f95b755954c2b675d0d01136fa1eb8fa542fe22f8f6ed695c52a1154693" Jul 17 14:07:05.591209 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.591194 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"508c6f95b755954c2b675d0d01136fa1eb8fa542fe22f8f6ed695c52a1154693"} err="failed to get container status \"508c6f95b755954c2b675d0d01136fa1eb8fa542fe22f8f6ed695c52a1154693\": rpc error: code = NotFound desc = could not find container \"508c6f95b755954c2b675d0d01136fa1eb8fa542fe22f8f6ed695c52a1154693\": container with ID starting with 508c6f95b755954c2b675d0d01136fa1eb8fa542fe22f8f6ed695c52a1154693 not found: ID does not exist" Jul 17 14:07:05.591209 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.591208 2565 scope.go:117] "RemoveContainer" containerID="9defe2a47359790e491a5473450cb528835fdeaa3c70583c98a180bb26226cb9" Jul 17 14:07:05.593451 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.593432 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-54c65966b6-4tbrl"] Jul 17 14:07:05.598824 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.598791 2565 scope.go:117] "RemoveContainer" containerID="980e4ecddfc379a94abfe8bc58a0c6dc6f4743662aff8683e6fe958a006e3a10" Jul 17 14:07:05.606006 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.605989 2565 scope.go:117] "RemoveContainer" containerID="0a3a1919b8c46f7c2346810641245b375cf4d5e0609abe31d3b12552c408652e" Jul 17 14:07:05.624542 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.624525 2565 scope.go:117] "RemoveContainer" containerID="26af6c4ccd0cd9aa3706e6213184342350b3b0d1a0c799876267c5cf656ed05b" Jul 17 14:07:05.631968 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.631952 2565 scope.go:117] "RemoveContainer" containerID="fe87c9d545b09fa32560c40ee1a4284145ba1c768cc6ae9505549b79c01f4c9d" Jul 17 14:07:05.639209 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.639192 2565 scope.go:117] "RemoveContainer" containerID="e9453a7ccb7a7473cf145618e2334d1a1d28cf5d961fef813a34f6a7b9cc1974" Jul 17 14:07:05.641528 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.641503 2565 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b295a6f2-9669-4c56-978a-6ea9a292b8d4-feast-data\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:07:05.641604 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.641534 2565 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b295a6f2-9669-4c56-978a-6ea9a292b8d4-offline-tls\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:07:05.641604 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.641549 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whpwb\" (UniqueName: \"kubernetes.io/projected/b295a6f2-9669-4c56-978a-6ea9a292b8d4-kube-api-access-whpwb\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:07:05.641604 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.641562 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b295a6f2-9669-4c56-978a-6ea9a292b8d4-registry-tls\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:07:05.641604 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.641576 2565 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b295a6f2-9669-4c56-978a-6ea9a292b8d4-online-tls\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:07:05.641604 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.641588 2565 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b295a6f2-9669-4c56-978a-6ea9a292b8d4-ui-tls\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:07:05.646536 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.646520 2565 scope.go:117] "RemoveContainer" containerID="9defe2a47359790e491a5473450cb528835fdeaa3c70583c98a180bb26226cb9" Jul 17 14:07:05.646812 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:07:05.646794 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9defe2a47359790e491a5473450cb528835fdeaa3c70583c98a180bb26226cb9\": container with ID starting with 9defe2a47359790e491a5473450cb528835fdeaa3c70583c98a180bb26226cb9 not found: ID does not exist" containerID="9defe2a47359790e491a5473450cb528835fdeaa3c70583c98a180bb26226cb9" Jul 17 14:07:05.646886 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.646818 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9defe2a47359790e491a5473450cb528835fdeaa3c70583c98a180bb26226cb9"} err="failed to get container status \"9defe2a47359790e491a5473450cb528835fdeaa3c70583c98a180bb26226cb9\": rpc error: code = NotFound desc = could not find container \"9defe2a47359790e491a5473450cb528835fdeaa3c70583c98a180bb26226cb9\": container with ID starting with 9defe2a47359790e491a5473450cb528835fdeaa3c70583c98a180bb26226cb9 not found: ID does not exist" Jul 17 14:07:05.646886 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.646836 2565 scope.go:117] "RemoveContainer" containerID="980e4ecddfc379a94abfe8bc58a0c6dc6f4743662aff8683e6fe958a006e3a10" Jul 17 14:07:05.647088 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:07:05.647070 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"980e4ecddfc379a94abfe8bc58a0c6dc6f4743662aff8683e6fe958a006e3a10\": container with ID starting with 980e4ecddfc379a94abfe8bc58a0c6dc6f4743662aff8683e6fe958a006e3a10 not found: ID does not exist" containerID="980e4ecddfc379a94abfe8bc58a0c6dc6f4743662aff8683e6fe958a006e3a10" Jul 17 14:07:05.647154 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.647097 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"980e4ecddfc379a94abfe8bc58a0c6dc6f4743662aff8683e6fe958a006e3a10"} err="failed to get container status \"980e4ecddfc379a94abfe8bc58a0c6dc6f4743662aff8683e6fe958a006e3a10\": rpc error: code = NotFound desc = could not find container \"980e4ecddfc379a94abfe8bc58a0c6dc6f4743662aff8683e6fe958a006e3a10\": container with ID starting with 980e4ecddfc379a94abfe8bc58a0c6dc6f4743662aff8683e6fe958a006e3a10 not found: ID does not exist" Jul 17 14:07:05.647154 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.647120 2565 scope.go:117] "RemoveContainer" containerID="0a3a1919b8c46f7c2346810641245b375cf4d5e0609abe31d3b12552c408652e" Jul 17 14:07:05.647368 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:07:05.647352 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a3a1919b8c46f7c2346810641245b375cf4d5e0609abe31d3b12552c408652e\": container with ID starting with 0a3a1919b8c46f7c2346810641245b375cf4d5e0609abe31d3b12552c408652e not found: ID does not exist" containerID="0a3a1919b8c46f7c2346810641245b375cf4d5e0609abe31d3b12552c408652e" Jul 17 14:07:05.647428 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.647374 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a3a1919b8c46f7c2346810641245b375cf4d5e0609abe31d3b12552c408652e"} err="failed to get container status \"0a3a1919b8c46f7c2346810641245b375cf4d5e0609abe31d3b12552c408652e\": rpc error: code = NotFound desc = could not find container \"0a3a1919b8c46f7c2346810641245b375cf4d5e0609abe31d3b12552c408652e\": container with ID starting with 0a3a1919b8c46f7c2346810641245b375cf4d5e0609abe31d3b12552c408652e not found: ID does not exist" Jul 17 14:07:05.647428 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.647392 2565 scope.go:117] "RemoveContainer" containerID="26af6c4ccd0cd9aa3706e6213184342350b3b0d1a0c799876267c5cf656ed05b" Jul 17 14:07:05.647636 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:07:05.647620 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26af6c4ccd0cd9aa3706e6213184342350b3b0d1a0c799876267c5cf656ed05b\": container with ID starting with 26af6c4ccd0cd9aa3706e6213184342350b3b0d1a0c799876267c5cf656ed05b not found: ID does not exist" containerID="26af6c4ccd0cd9aa3706e6213184342350b3b0d1a0c799876267c5cf656ed05b" Jul 17 14:07:05.647682 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.647641 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26af6c4ccd0cd9aa3706e6213184342350b3b0d1a0c799876267c5cf656ed05b"} err="failed to get container status \"26af6c4ccd0cd9aa3706e6213184342350b3b0d1a0c799876267c5cf656ed05b\": rpc error: code = NotFound desc = could not find container \"26af6c4ccd0cd9aa3706e6213184342350b3b0d1a0c799876267c5cf656ed05b\": container with ID starting with 26af6c4ccd0cd9aa3706e6213184342350b3b0d1a0c799876267c5cf656ed05b not found: ID does not exist" Jul 17 14:07:05.647682 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.647654 2565 scope.go:117] "RemoveContainer" containerID="fe87c9d545b09fa32560c40ee1a4284145ba1c768cc6ae9505549b79c01f4c9d" Jul 17 14:07:05.647849 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:07:05.647835 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe87c9d545b09fa32560c40ee1a4284145ba1c768cc6ae9505549b79c01f4c9d\": container with ID starting with fe87c9d545b09fa32560c40ee1a4284145ba1c768cc6ae9505549b79c01f4c9d not found: ID does not exist" containerID="fe87c9d545b09fa32560c40ee1a4284145ba1c768cc6ae9505549b79c01f4c9d" Jul 17 14:07:05.647888 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.647852 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe87c9d545b09fa32560c40ee1a4284145ba1c768cc6ae9505549b79c01f4c9d"} err="failed to get container status \"fe87c9d545b09fa32560c40ee1a4284145ba1c768cc6ae9505549b79c01f4c9d\": rpc error: code = NotFound desc = could not find container \"fe87c9d545b09fa32560c40ee1a4284145ba1c768cc6ae9505549b79c01f4c9d\": container with ID starting with fe87c9d545b09fa32560c40ee1a4284145ba1c768cc6ae9505549b79c01f4c9d not found: ID does not exist" Jul 17 14:07:05.647888 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.647865 2565 scope.go:117] "RemoveContainer" containerID="e9453a7ccb7a7473cf145618e2334d1a1d28cf5d961fef813a34f6a7b9cc1974" Jul 17 14:07:05.648112 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:07:05.648086 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9453a7ccb7a7473cf145618e2334d1a1d28cf5d961fef813a34f6a7b9cc1974\": container with ID starting with e9453a7ccb7a7473cf145618e2334d1a1d28cf5d961fef813a34f6a7b9cc1974 not found: ID does not exist" containerID="e9453a7ccb7a7473cf145618e2334d1a1d28cf5d961fef813a34f6a7b9cc1974" Jul 17 14:07:05.648155 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.648108 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9453a7ccb7a7473cf145618e2334d1a1d28cf5d961fef813a34f6a7b9cc1974"} err="failed to get container status \"e9453a7ccb7a7473cf145618e2334d1a1d28cf5d961fef813a34f6a7b9cc1974\": rpc error: code = NotFound desc = could not find container \"e9453a7ccb7a7473cf145618e2334d1a1d28cf5d961fef813a34f6a7b9cc1974\": container with ID starting with e9453a7ccb7a7473cf145618e2334d1a1d28cf5d961fef813a34f6a7b9cc1974 not found: ID does not exist" Jul 17 14:07:05.648155 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.648123 2565 scope.go:117] "RemoveContainer" containerID="9defe2a47359790e491a5473450cb528835fdeaa3c70583c98a180bb26226cb9" Jul 17 14:07:05.648380 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.648363 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9defe2a47359790e491a5473450cb528835fdeaa3c70583c98a180bb26226cb9"} err="failed to get container status \"9defe2a47359790e491a5473450cb528835fdeaa3c70583c98a180bb26226cb9\": rpc error: code = NotFound desc = could not find container \"9defe2a47359790e491a5473450cb528835fdeaa3c70583c98a180bb26226cb9\": container with ID starting with 9defe2a47359790e491a5473450cb528835fdeaa3c70583c98a180bb26226cb9 not found: ID does not exist" Jul 17 14:07:05.648443 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.648382 2565 scope.go:117] "RemoveContainer" containerID="980e4ecddfc379a94abfe8bc58a0c6dc6f4743662aff8683e6fe958a006e3a10" Jul 17 14:07:05.648598 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.648578 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"980e4ecddfc379a94abfe8bc58a0c6dc6f4743662aff8683e6fe958a006e3a10"} err="failed to get container status \"980e4ecddfc379a94abfe8bc58a0c6dc6f4743662aff8683e6fe958a006e3a10\": rpc error: code = NotFound desc = could not find container \"980e4ecddfc379a94abfe8bc58a0c6dc6f4743662aff8683e6fe958a006e3a10\": container with ID starting with 980e4ecddfc379a94abfe8bc58a0c6dc6f4743662aff8683e6fe958a006e3a10 not found: ID does not exist" Jul 17 14:07:05.648642 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.648600 2565 scope.go:117] "RemoveContainer" containerID="0a3a1919b8c46f7c2346810641245b375cf4d5e0609abe31d3b12552c408652e" Jul 17 14:07:05.648814 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.648797 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a3a1919b8c46f7c2346810641245b375cf4d5e0609abe31d3b12552c408652e"} err="failed to get container status \"0a3a1919b8c46f7c2346810641245b375cf4d5e0609abe31d3b12552c408652e\": rpc error: code = NotFound desc = could not find container \"0a3a1919b8c46f7c2346810641245b375cf4d5e0609abe31d3b12552c408652e\": container with ID starting with 0a3a1919b8c46f7c2346810641245b375cf4d5e0609abe31d3b12552c408652e not found: ID does not exist" Jul 17 14:07:05.648871 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.648816 2565 scope.go:117] "RemoveContainer" containerID="26af6c4ccd0cd9aa3706e6213184342350b3b0d1a0c799876267c5cf656ed05b" Jul 17 14:07:05.649003 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.648988 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26af6c4ccd0cd9aa3706e6213184342350b3b0d1a0c799876267c5cf656ed05b"} err="failed to get container status \"26af6c4ccd0cd9aa3706e6213184342350b3b0d1a0c799876267c5cf656ed05b\": rpc error: code = NotFound desc = could not find container \"26af6c4ccd0cd9aa3706e6213184342350b3b0d1a0c799876267c5cf656ed05b\": container with ID starting with 26af6c4ccd0cd9aa3706e6213184342350b3b0d1a0c799876267c5cf656ed05b not found: ID does not exist" Jul 17 14:07:05.649052 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.649004 2565 scope.go:117] "RemoveContainer" containerID="fe87c9d545b09fa32560c40ee1a4284145ba1c768cc6ae9505549b79c01f4c9d" Jul 17 14:07:05.649227 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.649209 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe87c9d545b09fa32560c40ee1a4284145ba1c768cc6ae9505549b79c01f4c9d"} err="failed to get container status \"fe87c9d545b09fa32560c40ee1a4284145ba1c768cc6ae9505549b79c01f4c9d\": rpc error: code = NotFound desc = could not find container \"fe87c9d545b09fa32560c40ee1a4284145ba1c768cc6ae9505549b79c01f4c9d\": container with ID starting with fe87c9d545b09fa32560c40ee1a4284145ba1c768cc6ae9505549b79c01f4c9d not found: ID does not exist" Jul 17 14:07:05.649297 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.649229 2565 scope.go:117] "RemoveContainer" containerID="e9453a7ccb7a7473cf145618e2334d1a1d28cf5d961fef813a34f6a7b9cc1974" Jul 17 14:07:05.649439 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.649424 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9453a7ccb7a7473cf145618e2334d1a1d28cf5d961fef813a34f6a7b9cc1974"} err="failed to get container status \"e9453a7ccb7a7473cf145618e2334d1a1d28cf5d961fef813a34f6a7b9cc1974\": rpc error: code = NotFound desc = could not find container \"e9453a7ccb7a7473cf145618e2334d1a1d28cf5d961fef813a34f6a7b9cc1974\": container with ID starting with e9453a7ccb7a7473cf145618e2334d1a1d28cf5d961fef813a34f6a7b9cc1974 not found: ID does not exist" Jul 17 14:07:05.696060 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.696028 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" path="/var/lib/kubelet/pods/aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d/volumes" Jul 17 14:07:05.696628 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:05.696609 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" path="/var/lib/kubelet/pods/b295a6f2-9669-4c56-978a-6ea9a292b8d4/volumes" Jul 17 14:07:17.790107 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:17.790071 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:07:18.016638 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.016608 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-9vsb2"] Jul 17 14:07:18.016931 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.016919 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerName="feast-init" Jul 17 14:07:18.016978 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.016934 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerName="feast-init" Jul 17 14:07:18.016978 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.016951 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerName="online" Jul 17 14:07:18.016978 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.016957 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerName="online" Jul 17 14:07:18.016978 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.016966 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerName="registry" Jul 17 14:07:18.016978 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.016971 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerName="registry" Jul 17 14:07:18.016978 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.016977 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" containerName="offline" Jul 17 14:07:18.017150 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.016983 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" containerName="offline" Jul 17 14:07:18.017150 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.016988 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerName="offline" Jul 17 14:07:18.017150 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.016995 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerName="offline" Jul 17 14:07:18.017150 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.017006 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerName="feast-apply" Jul 17 14:07:18.017150 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.017012 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerName="feast-apply" Jul 17 14:07:18.017150 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.017022 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" containerName="feast-init" Jul 17 14:07:18.017150 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.017028 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" containerName="feast-init" Jul 17 14:07:18.017150 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.017037 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" containerName="online" Jul 17 14:07:18.017150 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.017042 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" containerName="online" Jul 17 14:07:18.017150 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.017048 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" containerName="ui" Jul 17 14:07:18.017150 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.017053 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" containerName="ui" Jul 17 14:07:18.017150 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.017060 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerName="ui" Jul 17 14:07:18.017150 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.017065 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerName="ui" Jul 17 14:07:18.017150 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.017070 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" containerName="feast-apply" Jul 17 14:07:18.017150 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.017076 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" containerName="feast-apply" Jul 17 14:07:18.017150 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.017153 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerName="online" Jul 17 14:07:18.017615 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.017162 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" containerName="ui" Jul 17 14:07:18.017615 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.017169 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerName="ui" Jul 17 14:07:18.017615 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.017193 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" containerName="online" Jul 17 14:07:18.017615 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.017200 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerName="offline" Jul 17 14:07:18.017615 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.017206 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa4853f9-df8b-4e5f-8f47-e0e506d7fc1d" containerName="offline" Jul 17 14:07:18.017615 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.017212 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b295a6f2-9669-4c56-978a-6ea9a292b8d4" containerName="registry" Jul 17 14:07:18.019050 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.019033 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-9vsb2" Jul 17 14:07:18.021054 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.021028 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\"" Jul 17 14:07:18.021208 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.021053 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" Jul 17 14:07:18.021373 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.021357 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-pgksg\"" Jul 17 14:07:18.021424 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.021358 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" Jul 17 14:07:18.029105 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.029081 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-9vsb2"] Jul 17 14:07:18.035451 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.035428 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/260ce733-5287-4091-8e7b-16e713e740a2-postgresdata\") pod \"postgres-864846d4f5-9vsb2\" (UID: \"260ce733-5287-4091-8e7b-16e713e740a2\") " pod="test-ns-feast/postgres-864846d4f5-9vsb2" Jul 17 14:07:18.035544 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.035459 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjd2z\" (UniqueName: \"kubernetes.io/projected/260ce733-5287-4091-8e7b-16e713e740a2-kube-api-access-rjd2z\") pod \"postgres-864846d4f5-9vsb2\" (UID: \"260ce733-5287-4091-8e7b-16e713e740a2\") " pod="test-ns-feast/postgres-864846d4f5-9vsb2" Jul 17 14:07:18.053396 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.053328 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-69bbd798b6-ntnbd"] Jul 17 14:07:18.055460 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.055442 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-ntnbd" Jul 17 14:07:18.064455 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.064429 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-ntnbd"] Jul 17 14:07:18.136759 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.136727 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/260ce733-5287-4091-8e7b-16e713e740a2-postgresdata\") pod \"postgres-864846d4f5-9vsb2\" (UID: \"260ce733-5287-4091-8e7b-16e713e740a2\") " pod="test-ns-feast/postgres-864846d4f5-9vsb2" Jul 17 14:07:18.136929 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.136763 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjd2z\" (UniqueName: \"kubernetes.io/projected/260ce733-5287-4091-8e7b-16e713e740a2-kube-api-access-rjd2z\") pod \"postgres-864846d4f5-9vsb2\" (UID: \"260ce733-5287-4091-8e7b-16e713e740a2\") " pod="test-ns-feast/postgres-864846d4f5-9vsb2" Jul 17 14:07:18.136929 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.136784 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhxgl\" (UniqueName: \"kubernetes.io/projected/4c6e2178-6c14-43e6-91d3-18b286aeb453-kube-api-access-zhxgl\") pod \"redis-69bbd798b6-ntnbd\" (UID: \"4c6e2178-6c14-43e6-91d3-18b286aeb453\") " pod="test-ns-feast/redis-69bbd798b6-ntnbd" Jul 17 14:07:18.137089 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.137067 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/260ce733-5287-4091-8e7b-16e713e740a2-postgresdata\") pod \"postgres-864846d4f5-9vsb2\" (UID: \"260ce733-5287-4091-8e7b-16e713e740a2\") " pod="test-ns-feast/postgres-864846d4f5-9vsb2" Jul 17 14:07:18.145132 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.145113 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjd2z\" (UniqueName: \"kubernetes.io/projected/260ce733-5287-4091-8e7b-16e713e740a2-kube-api-access-rjd2z\") pod \"postgres-864846d4f5-9vsb2\" (UID: \"260ce733-5287-4091-8e7b-16e713e740a2\") " pod="test-ns-feast/postgres-864846d4f5-9vsb2" Jul 17 14:07:18.237376 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.237342 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhxgl\" (UniqueName: \"kubernetes.io/projected/4c6e2178-6c14-43e6-91d3-18b286aeb453-kube-api-access-zhxgl\") pod \"redis-69bbd798b6-ntnbd\" (UID: \"4c6e2178-6c14-43e6-91d3-18b286aeb453\") " pod="test-ns-feast/redis-69bbd798b6-ntnbd" Jul 17 14:07:18.245731 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.245705 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhxgl\" (UniqueName: \"kubernetes.io/projected/4c6e2178-6c14-43e6-91d3-18b286aeb453-kube-api-access-zhxgl\") pod \"redis-69bbd798b6-ntnbd\" (UID: \"4c6e2178-6c14-43e6-91d3-18b286aeb453\") " pod="test-ns-feast/redis-69bbd798b6-ntnbd" Jul 17 14:07:18.342886 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.342810 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-9vsb2" Jul 17 14:07:18.365795 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.365770 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-ntnbd" Jul 17 14:07:18.489040 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.489009 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-9vsb2"] Jul 17 14:07:18.492472 ip-10-0-138-92 kubenswrapper[2565]: W0717 14:07:18.492444 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod260ce733_5287_4091_8e7b_16e713e740a2.slice/crio-577d21e049f6756b129b696d287e810071c1edbf25935f3079c6741ab87858d2 WatchSource:0}: Error finding container 577d21e049f6756b129b696d287e810071c1edbf25935f3079c6741ab87858d2: Status 404 returned error can't find the container with id 577d21e049f6756b129b696d287e810071c1edbf25935f3079c6741ab87858d2 Jul 17 14:07:18.494410 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.494392 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 14:07:18.511533 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.511513 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-ntnbd"] Jul 17 14:07:18.513815 ip-10-0-138-92 kubenswrapper[2565]: W0717 14:07:18.513786 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c6e2178_6c14_43e6_91d3_18b286aeb453.slice/crio-1729b70b397ab89b75448c44ac6431fff198ca4fc6767c0409c3a639558deba9 WatchSource:0}: Error finding container 1729b70b397ab89b75448c44ac6431fff198ca4fc6767c0409c3a639558deba9: Status 404 returned error can't find the container with id 1729b70b397ab89b75448c44ac6431fff198ca4fc6767c0409c3a639558deba9 Jul 17 14:07:18.610432 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.610344 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-9vsb2" event={"ID":"260ce733-5287-4091-8e7b-16e713e740a2","Type":"ContainerStarted","Data":"577d21e049f6756b129b696d287e810071c1edbf25935f3079c6741ab87858d2"} Jul 17 14:07:18.611418 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.611394 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-ntnbd" event={"ID":"4c6e2178-6c14-43e6-91d3-18b286aeb453","Type":"ContainerStarted","Data":"1729b70b397ab89b75448c44ac6431fff198ca4fc6767c0409c3a639558deba9"} Jul 17 14:07:18.756609 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:18.756569 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:07:20.623371 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:20.623332 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-ntnbd" event={"ID":"4c6e2178-6c14-43e6-91d3-18b286aeb453","Type":"ContainerStarted","Data":"6f543fa3abebc74e31b1d3c7bab1d147e59d526a0b378aec1851ad4433cb484a"} Jul 17 14:07:20.638347 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:20.638304 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/redis-69bbd798b6-ntnbd" podStartSLOduration=0.952536342 podStartE2EDuration="2.638285964s" totalImagesPullingTime="1.685749622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:07:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:07:20.637866151 +0000 UTC m=+659.466218498" watchObservedRunningTime="2026-07-17 14:07:20.638285964 +0000 UTC m=+659.466638307" Jul 17 14:07:23.581104 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:23.581080 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\"" Jul 17 14:07:24.641280 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:24.641202 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-9vsb2" event={"ID":"260ce733-5287-4091-8e7b-16e713e740a2","Type":"ContainerStarted","Data":"47ea5064815b0693aff58f77811a14429951fbe73730fac11a346ac554ba83d9"} Jul 17 14:07:24.656035 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:24.655989 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-9vsb2" podStartSLOduration=1.5717494730000001 podStartE2EDuration="6.655972402s" totalImagesPullingTime="5.084222929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:07:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:07:24.655312116 +0000 UTC m=+663.483664462" watchObservedRunningTime="2026-07-17 14:07:24.655972402 +0000 UTC m=+663.484324748" Jul 17 14:07:28.599306 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:28.599271 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:07:28.699206 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:28.699145 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:07:28.779341 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:28.779299 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:07:28.783364 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:28.783340 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w"] Jul 17 14:07:28.788807 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:28.788789 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" Jul 17 14:07:28.790976 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:28.790954 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\"" Jul 17 14:07:28.790976 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:28.790973 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" Jul 17 14:07:28.791172 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:28.791033 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\"" Jul 17 14:07:28.791172 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:28.791055 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\"" Jul 17 14:07:28.791172 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:28.791057 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-l6bvf\"" Jul 17 14:07:28.800168 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:28.800150 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w"] Jul 17 14:07:28.821780 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:28.821754 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5bf8f91b-0b40-4cff-bb0c-b9473a8b3954-feast-data\") pod \"feast-credit-scoring-655bd95b8f-lsr4w\" (UID: \"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954\") " pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" Jul 17 14:07:28.821950 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:28.821930 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7h42\" (UniqueName: \"kubernetes.io/projected/5bf8f91b-0b40-4cff-bb0c-b9473a8b3954-kube-api-access-q7h42\") pod \"feast-credit-scoring-655bd95b8f-lsr4w\" (UID: \"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954\") " pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" Jul 17 14:07:28.822087 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:28.822064 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5bf8f91b-0b40-4cff-bb0c-b9473a8b3954-offline-tls\") pod \"feast-credit-scoring-655bd95b8f-lsr4w\" (UID: \"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954\") " pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" Jul 17 14:07:28.822240 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:28.822104 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5bf8f91b-0b40-4cff-bb0c-b9473a8b3954-registry-tls\") pod \"feast-credit-scoring-655bd95b8f-lsr4w\" (UID: \"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954\") " pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" Jul 17 14:07:28.822240 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:28.822231 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5bf8f91b-0b40-4cff-bb0c-b9473a8b3954-online-tls\") pod \"feast-credit-scoring-655bd95b8f-lsr4w\" (UID: \"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954\") " pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" Jul 17 14:07:28.894167 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:28.894097 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:07:28.923277 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:28.923251 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5bf8f91b-0b40-4cff-bb0c-b9473a8b3954-online-tls\") pod \"feast-credit-scoring-655bd95b8f-lsr4w\" (UID: \"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954\") " pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" Jul 17 14:07:28.923393 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:28.923321 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5bf8f91b-0b40-4cff-bb0c-b9473a8b3954-feast-data\") pod \"feast-credit-scoring-655bd95b8f-lsr4w\" (UID: \"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954\") " pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" Jul 17 14:07:28.923393 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:28.923348 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7h42\" (UniqueName: \"kubernetes.io/projected/5bf8f91b-0b40-4cff-bb0c-b9473a8b3954-kube-api-access-q7h42\") pod \"feast-credit-scoring-655bd95b8f-lsr4w\" (UID: \"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954\") " pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" Jul 17 14:07:28.923393 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:28.923380 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5bf8f91b-0b40-4cff-bb0c-b9473a8b3954-offline-tls\") pod \"feast-credit-scoring-655bd95b8f-lsr4w\" (UID: \"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954\") " pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" Jul 17 14:07:28.923548 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:28.923409 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5bf8f91b-0b40-4cff-bb0c-b9473a8b3954-registry-tls\") pod \"feast-credit-scoring-655bd95b8f-lsr4w\" (UID: \"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954\") " pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" Jul 17 14:07:28.923722 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:28.923702 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5bf8f91b-0b40-4cff-bb0c-b9473a8b3954-feast-data\") pod \"feast-credit-scoring-655bd95b8f-lsr4w\" (UID: \"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954\") " pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" Jul 17 14:07:28.925833 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:28.925808 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5bf8f91b-0b40-4cff-bb0c-b9473a8b3954-registry-tls\") pod \"feast-credit-scoring-655bd95b8f-lsr4w\" (UID: \"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954\") " pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" Jul 17 14:07:28.925934 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:28.925866 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5bf8f91b-0b40-4cff-bb0c-b9473a8b3954-online-tls\") pod \"feast-credit-scoring-655bd95b8f-lsr4w\" (UID: \"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954\") " pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" Jul 17 14:07:28.925934 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:28.925912 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5bf8f91b-0b40-4cff-bb0c-b9473a8b3954-offline-tls\") pod \"feast-credit-scoring-655bd95b8f-lsr4w\" (UID: \"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954\") " pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" Jul 17 14:07:28.931344 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:28.931326 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7h42\" (UniqueName: \"kubernetes.io/projected/5bf8f91b-0b40-4cff-bb0c-b9473a8b3954-kube-api-access-q7h42\") pod \"feast-credit-scoring-655bd95b8f-lsr4w\" (UID: \"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954\") " pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" Jul 17 14:07:28.995366 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:28.995337 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:07:29.097674 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:29.097647 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" Jul 17 14:07:29.230542 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:29.230520 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w"] Jul 17 14:07:29.233027 ip-10-0-138-92 kubenswrapper[2565]: W0717 14:07:29.233001 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bf8f91b_0b40_4cff_bb0c_b9473a8b3954.slice/crio-fcb4832593655d6ee52fa792d0c13193bc4cc347b4d7f70e3c45b4888e1a43c6 WatchSource:0}: Error finding container fcb4832593655d6ee52fa792d0c13193bc4cc347b4d7f70e3c45b4888e1a43c6: Status 404 returned error can't find the container with id fcb4832593655d6ee52fa792d0c13193bc4cc347b4d7f70e3c45b4888e1a43c6 Jul 17 14:07:29.667713 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:29.667680 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" event={"ID":"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954","Type":"ContainerStarted","Data":"e8e8cafeecf96e5ebd9e625d5b5a4938e3c2a7264fbfcbc1945d9d94a610c813"} Jul 17 14:07:29.668091 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:29.667733 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" event={"ID":"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954","Type":"ContainerStarted","Data":"fcb4832593655d6ee52fa792d0c13193bc4cc347b4d7f70e3c45b4888e1a43c6"} Jul 17 14:07:30.673097 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:30.673060 2565 generic.go:356] "Generic (PLEG): container finished" podID="5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" containerID="e8e8cafeecf96e5ebd9e625d5b5a4938e3c2a7264fbfcbc1945d9d94a610c813" exitCode=0 Jul 17 14:07:30.673498 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:30.673130 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" event={"ID":"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954","Type":"ContainerDied","Data":"e8e8cafeecf96e5ebd9e625d5b5a4938e3c2a7264fbfcbc1945d9d94a610c813"} Jul 17 14:07:31.680197 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:31.680146 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" event={"ID":"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954","Type":"ContainerStarted","Data":"9156aa3f7b856d655d7c2eb516268a9ec6c5d9acd620a294510b60731a6578cb"} Jul 17 14:07:37.706370 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:37.706337 2565 generic.go:356] "Generic (PLEG): container finished" podID="5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" containerID="9156aa3f7b856d655d7c2eb516268a9ec6c5d9acd620a294510b60731a6578cb" exitCode=0 Jul 17 14:07:37.706745 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:37.706413 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" event={"ID":"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954","Type":"ContainerDied","Data":"9156aa3f7b856d655d7c2eb516268a9ec6c5d9acd620a294510b60731a6578cb"} Jul 17 14:07:38.714404 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:38.714367 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" event={"ID":"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954","Type":"ContainerStarted","Data":"83f40d85048a59ac29a00bf04e73e8c992dfac9d0dbe42843779f294999d805a"} Jul 17 14:07:38.714913 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:38.714444 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" event={"ID":"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954","Type":"ContainerStarted","Data":"6a1427abc1bb63f4190797f19f1283e9768de13052847d944fb1db3a6e34dca5"} Jul 17 14:07:38.714913 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:38.714473 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" event={"ID":"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954","Type":"ContainerStarted","Data":"c87c4bcf3ed5158b4ef2fc017d4832dc7ec15cbab1b900b29f45a9fb76854177"} Jul 17 14:07:38.737519 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:38.737454 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" podStartSLOduration=10.737430891 podStartE2EDuration="10.737430891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:07:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:07:38.735575473 +0000 UTC m=+677.563927819" watchObservedRunningTime="2026-07-17 14:07:38.737430891 +0000 UTC m=+677.565783240" Jul 17 14:07:39.097758 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:39.097720 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" Jul 17 14:07:39.097929 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:39.097811 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" Jul 17 14:07:39.097929 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:39.097844 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" Jul 17 14:07:40.877776 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:40.877724 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:07:40.945365 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:40.945318 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:07:41.098705 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:41.098668 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" Jul 17 14:07:41.098908 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:41.098768 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" Jul 17 14:07:41.098908 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:41.098795 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" Jul 17 14:07:41.100620 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:41.100592 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" podUID="5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.28:6571: connect: connection refused" Jul 17 14:07:41.100745 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:41.100633 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" podUID="5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.28:8816: connect: connection refused" Jul 17 14:07:41.100745 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:41.100632 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" podUID="5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused" Jul 17 14:07:44.098441 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:44.098391 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" podUID="5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.28:6571: connect: connection refused" Jul 17 14:07:44.099483 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:44.099460 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" Jul 17 14:07:44.100345 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:44.100326 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" Jul 17 14:07:44.112527 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:44.112505 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" Jul 17 14:07:44.750559 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:44.750517 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" Jul 17 14:07:47.097936 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:47.097894 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" podUID="5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.28:6571: connect: connection refused" Jul 17 14:07:50.099094 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:50.099065 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" Jul 17 14:07:50.099921 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:50.099903 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" Jul 17 14:07:50.366991 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:07:50.366903 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:08:04.314951 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:04.314914 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:08:28.355193 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:28.355143 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:08:47.144572 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:47.144537 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:08:52.106217 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:52.106169 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w"] Jul 17 14:08:52.106576 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:52.106430 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" podUID="5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" containerName="registry" containerID="cri-o://c87c4bcf3ed5158b4ef2fc017d4832dc7ec15cbab1b900b29f45a9fb76854177" gracePeriod=30 Jul 17 14:08:52.106576 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:52.106489 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" podUID="5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" containerName="offline" containerID="cri-o://83f40d85048a59ac29a00bf04e73e8c992dfac9d0dbe42843779f294999d805a" gracePeriod=30 Jul 17 14:08:52.106699 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:52.106486 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" podUID="5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" containerName="online" containerID="cri-o://6a1427abc1bb63f4190797f19f1283e9768de13052847d944fb1db3a6e34dca5" gracePeriod=30 Jul 17 14:08:52.120757 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:52.120734 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-9vsb2"] Jul 17 14:08:52.120915 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:52.120898 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-9vsb2" podUID="260ce733-5287-4091-8e7b-16e713e740a2" containerName="postgres" containerID="cri-o://47ea5064815b0693aff58f77811a14429951fbe73730fac11a346ac554ba83d9" gracePeriod=30 Jul 17 14:08:52.126240 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:52.126211 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-ntnbd"] Jul 17 14:08:52.126430 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:52.126384 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/redis-69bbd798b6-ntnbd" podUID="4c6e2178-6c14-43e6-91d3-18b286aeb453" containerName="redis" containerID="cri-o://6f543fa3abebc74e31b1d3c7bab1d147e59d526a0b378aec1851ad4433cb484a" gracePeriod=30 Jul 17 14:08:52.171955 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:52.171928 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:08:52.398245 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:52.398224 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-9vsb2" Jul 17 14:08:52.400867 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:52.400846 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-ntnbd" Jul 17 14:08:52.543137 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:52.543107 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjd2z\" (UniqueName: \"kubernetes.io/projected/260ce733-5287-4091-8e7b-16e713e740a2-kube-api-access-rjd2z\") pod \"260ce733-5287-4091-8e7b-16e713e740a2\" (UID: \"260ce733-5287-4091-8e7b-16e713e740a2\") " Jul 17 14:08:52.543331 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:52.543169 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/260ce733-5287-4091-8e7b-16e713e740a2-postgresdata\") pod \"260ce733-5287-4091-8e7b-16e713e740a2\" (UID: \"260ce733-5287-4091-8e7b-16e713e740a2\") " Jul 17 14:08:52.543331 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:52.543211 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhxgl\" (UniqueName: \"kubernetes.io/projected/4c6e2178-6c14-43e6-91d3-18b286aeb453-kube-api-access-zhxgl\") pod \"4c6e2178-6c14-43e6-91d3-18b286aeb453\" (UID: \"4c6e2178-6c14-43e6-91d3-18b286aeb453\") " Jul 17 14:08:52.545445 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:52.545411 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/260ce733-5287-4091-8e7b-16e713e740a2-kube-api-access-rjd2z" (OuterVolumeSpecName: "kube-api-access-rjd2z") pod "260ce733-5287-4091-8e7b-16e713e740a2" (UID: "260ce733-5287-4091-8e7b-16e713e740a2"). InnerVolumeSpecName "kube-api-access-rjd2z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 14:08:52.545557 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:52.545461 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c6e2178-6c14-43e6-91d3-18b286aeb453-kube-api-access-zhxgl" (OuterVolumeSpecName: "kube-api-access-zhxgl") pod "4c6e2178-6c14-43e6-91d3-18b286aeb453" (UID: "4c6e2178-6c14-43e6-91d3-18b286aeb453"). InnerVolumeSpecName "kube-api-access-zhxgl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 14:08:52.573380 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:52.573343 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/260ce733-5287-4091-8e7b-16e713e740a2-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "260ce733-5287-4091-8e7b-16e713e740a2" (UID: "260ce733-5287-4091-8e7b-16e713e740a2"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 14:08:52.644750 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:52.644672 2565 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/260ce733-5287-4091-8e7b-16e713e740a2-postgresdata\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:08:52.644750 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:52.644701 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhxgl\" (UniqueName: \"kubernetes.io/projected/4c6e2178-6c14-43e6-91d3-18b286aeb453-kube-api-access-zhxgl\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:08:52.644750 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:52.644711 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjd2z\" (UniqueName: \"kubernetes.io/projected/260ce733-5287-4091-8e7b-16e713e740a2-kube-api-access-rjd2z\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:08:53.040385 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:53.040356 2565 generic.go:356] "Generic (PLEG): container finished" podID="5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" containerID="6a1427abc1bb63f4190797f19f1283e9768de13052847d944fb1db3a6e34dca5" exitCode=0 Jul 17 14:08:53.040622 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:53.040432 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" event={"ID":"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954","Type":"ContainerDied","Data":"6a1427abc1bb63f4190797f19f1283e9768de13052847d944fb1db3a6e34dca5"} Jul 17 14:08:53.041472 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:53.041451 2565 generic.go:356] "Generic (PLEG): container finished" podID="260ce733-5287-4091-8e7b-16e713e740a2" containerID="47ea5064815b0693aff58f77811a14429951fbe73730fac11a346ac554ba83d9" exitCode=0 Jul 17 14:08:53.041572 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:53.041490 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-9vsb2" Jul 17 14:08:53.041572 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:53.041528 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-9vsb2" event={"ID":"260ce733-5287-4091-8e7b-16e713e740a2","Type":"ContainerDied","Data":"47ea5064815b0693aff58f77811a14429951fbe73730fac11a346ac554ba83d9"} Jul 17 14:08:53.041662 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:53.041574 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-9vsb2" event={"ID":"260ce733-5287-4091-8e7b-16e713e740a2","Type":"ContainerDied","Data":"577d21e049f6756b129b696d287e810071c1edbf25935f3079c6741ab87858d2"} Jul 17 14:08:53.041662 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:53.041598 2565 scope.go:117] "RemoveContainer" containerID="47ea5064815b0693aff58f77811a14429951fbe73730fac11a346ac554ba83d9" Jul 17 14:08:53.042722 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:53.042652 2565 generic.go:356] "Generic (PLEG): container finished" podID="4c6e2178-6c14-43e6-91d3-18b286aeb453" containerID="6f543fa3abebc74e31b1d3c7bab1d147e59d526a0b378aec1851ad4433cb484a" exitCode=0 Jul 17 14:08:53.042722 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:53.042685 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-ntnbd" event={"ID":"4c6e2178-6c14-43e6-91d3-18b286aeb453","Type":"ContainerDied","Data":"6f543fa3abebc74e31b1d3c7bab1d147e59d526a0b378aec1851ad4433cb484a"} Jul 17 14:08:53.042722 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:53.042699 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-ntnbd" Jul 17 14:08:53.042839 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:53.042732 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-ntnbd" event={"ID":"4c6e2178-6c14-43e6-91d3-18b286aeb453","Type":"ContainerDied","Data":"1729b70b397ab89b75448c44ac6431fff198ca4fc6767c0409c3a639558deba9"} Jul 17 14:08:53.050219 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:53.050204 2565 scope.go:117] "RemoveContainer" containerID="47ea5064815b0693aff58f77811a14429951fbe73730fac11a346ac554ba83d9" Jul 17 14:08:53.050484 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:08:53.050467 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47ea5064815b0693aff58f77811a14429951fbe73730fac11a346ac554ba83d9\": container with ID starting with 47ea5064815b0693aff58f77811a14429951fbe73730fac11a346ac554ba83d9 not found: ID does not exist" containerID="47ea5064815b0693aff58f77811a14429951fbe73730fac11a346ac554ba83d9" Jul 17 14:08:53.050547 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:53.050492 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47ea5064815b0693aff58f77811a14429951fbe73730fac11a346ac554ba83d9"} err="failed to get container status \"47ea5064815b0693aff58f77811a14429951fbe73730fac11a346ac554ba83d9\": rpc error: code = NotFound desc = could not find container \"47ea5064815b0693aff58f77811a14429951fbe73730fac11a346ac554ba83d9\": container with ID starting with 47ea5064815b0693aff58f77811a14429951fbe73730fac11a346ac554ba83d9 not found: ID does not exist" Jul 17 14:08:53.050547 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:53.050509 2565 scope.go:117] "RemoveContainer" containerID="6f543fa3abebc74e31b1d3c7bab1d147e59d526a0b378aec1851ad4433cb484a" Jul 17 14:08:53.058046 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:53.058031 2565 scope.go:117] "RemoveContainer" containerID="6f543fa3abebc74e31b1d3c7bab1d147e59d526a0b378aec1851ad4433cb484a" Jul 17 14:08:53.058298 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:08:53.058280 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f543fa3abebc74e31b1d3c7bab1d147e59d526a0b378aec1851ad4433cb484a\": container with ID starting with 6f543fa3abebc74e31b1d3c7bab1d147e59d526a0b378aec1851ad4433cb484a not found: ID does not exist" containerID="6f543fa3abebc74e31b1d3c7bab1d147e59d526a0b378aec1851ad4433cb484a" Jul 17 14:08:53.058349 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:53.058303 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f543fa3abebc74e31b1d3c7bab1d147e59d526a0b378aec1851ad4433cb484a"} err="failed to get container status \"6f543fa3abebc74e31b1d3c7bab1d147e59d526a0b378aec1851ad4433cb484a\": rpc error: code = NotFound desc = could not find container \"6f543fa3abebc74e31b1d3c7bab1d147e59d526a0b378aec1851ad4433cb484a\": container with ID starting with 6f543fa3abebc74e31b1d3c7bab1d147e59d526a0b378aec1851ad4433cb484a not found: ID does not exist" Jul 17 14:08:53.063382 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:53.063363 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-9vsb2"] Jul 17 14:08:53.065491 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:53.065470 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-9vsb2"] Jul 17 14:08:53.074161 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:53.074142 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-ntnbd"] Jul 17 14:08:53.077347 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:53.077331 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-69bbd798b6-ntnbd"] Jul 17 14:08:53.696880 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:53.696848 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="260ce733-5287-4091-8e7b-16e713e740a2" path="/var/lib/kubelet/pods/260ce733-5287-4091-8e7b-16e713e740a2/volumes" Jul 17 14:08:53.697248 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:53.697144 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c6e2178-6c14-43e6-91d3-18b286aeb453" path="/var/lib/kubelet/pods/4c6e2178-6c14-43e6-91d3-18b286aeb453/volumes" Jul 17 14:08:54.747966 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:08:54.747925 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" podUID="5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused" Jul 17 14:09:04.747520 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:04.747477 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" podUID="5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused" Jul 17 14:09:14.747817 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:14.747774 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" podUID="5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" containerName="online" probeResult="failure" output="Get \"https://10.132.0.28:6567/health\": dial tcp 10.132.0.28:6567: connect: connection refused" Jul 17 14:09:14.748238 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:14.747924 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" Jul 17 14:09:22.160574 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:22.160544 2565 generic.go:356] "Generic (PLEG): container finished" podID="5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" containerID="83f40d85048a59ac29a00bf04e73e8c992dfac9d0dbe42843779f294999d805a" exitCode=137 Jul 17 14:09:22.160864 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:22.160617 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" event={"ID":"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954","Type":"ContainerDied","Data":"83f40d85048a59ac29a00bf04e73e8c992dfac9d0dbe42843779f294999d805a"} Jul 17 14:09:22.760091 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:22.760068 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" Jul 17 14:09:22.770429 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:22.770408 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5bf8f91b-0b40-4cff-bb0c-b9473a8b3954-registry-tls\") pod \"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954\" (UID: \"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954\") " Jul 17 14:09:22.770533 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:22.770442 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5bf8f91b-0b40-4cff-bb0c-b9473a8b3954-feast-data\") pod \"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954\" (UID: \"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954\") " Jul 17 14:09:22.770533 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:22.770457 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5bf8f91b-0b40-4cff-bb0c-b9473a8b3954-offline-tls\") pod \"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954\" (UID: \"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954\") " Jul 17 14:09:22.770533 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:22.770514 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7h42\" (UniqueName: \"kubernetes.io/projected/5bf8f91b-0b40-4cff-bb0c-b9473a8b3954-kube-api-access-q7h42\") pod \"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954\" (UID: \"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954\") " Jul 17 14:09:22.770694 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:22.770558 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5bf8f91b-0b40-4cff-bb0c-b9473a8b3954-online-tls\") pod \"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954\" (UID: \"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954\") " Jul 17 14:09:22.772597 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:22.772570 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bf8f91b-0b40-4cff-bb0c-b9473a8b3954-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" (UID: "5bf8f91b-0b40-4cff-bb0c-b9473a8b3954"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:09:22.772752 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:22.772733 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bf8f91b-0b40-4cff-bb0c-b9473a8b3954-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" (UID: "5bf8f91b-0b40-4cff-bb0c-b9473a8b3954"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:09:22.772811 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:22.772771 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bf8f91b-0b40-4cff-bb0c-b9473a8b3954-online-tls" (OuterVolumeSpecName: "online-tls") pod "5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" (UID: "5bf8f91b-0b40-4cff-bb0c-b9473a8b3954"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:09:22.772980 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:22.772962 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bf8f91b-0b40-4cff-bb0c-b9473a8b3954-kube-api-access-q7h42" (OuterVolumeSpecName: "kube-api-access-q7h42") pod "5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" (UID: "5bf8f91b-0b40-4cff-bb0c-b9473a8b3954"). InnerVolumeSpecName "kube-api-access-q7h42". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 14:09:22.779159 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:22.779134 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bf8f91b-0b40-4cff-bb0c-b9473a8b3954-feast-data" (OuterVolumeSpecName: "feast-data") pod "5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" (UID: "5bf8f91b-0b40-4cff-bb0c-b9473a8b3954"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 14:09:22.871348 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:22.871315 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7h42\" (UniqueName: \"kubernetes.io/projected/5bf8f91b-0b40-4cff-bb0c-b9473a8b3954-kube-api-access-q7h42\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:09:22.871348 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:22.871343 2565 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5bf8f91b-0b40-4cff-bb0c-b9473a8b3954-online-tls\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:09:22.871348 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:22.871353 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5bf8f91b-0b40-4cff-bb0c-b9473a8b3954-registry-tls\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:09:22.871578 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:22.871360 2565 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5bf8f91b-0b40-4cff-bb0c-b9473a8b3954-feast-data\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:09:22.871578 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:22.871369 2565 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5bf8f91b-0b40-4cff-bb0c-b9473a8b3954-offline-tls\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:09:23.166492 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:23.166416 2565 generic.go:356] "Generic (PLEG): container finished" podID="5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" containerID="c87c4bcf3ed5158b4ef2fc017d4832dc7ec15cbab1b900b29f45a9fb76854177" exitCode=137 Jul 17 14:09:23.166492 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:23.166461 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" event={"ID":"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954","Type":"ContainerDied","Data":"c87c4bcf3ed5158b4ef2fc017d4832dc7ec15cbab1b900b29f45a9fb76854177"} Jul 17 14:09:23.166492 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:23.166480 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" Jul 17 14:09:23.166940 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:23.166506 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w" event={"ID":"5bf8f91b-0b40-4cff-bb0c-b9473a8b3954","Type":"ContainerDied","Data":"fcb4832593655d6ee52fa792d0c13193bc4cc347b4d7f70e3c45b4888e1a43c6"} Jul 17 14:09:23.166940 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:23.166529 2565 scope.go:117] "RemoveContainer" containerID="83f40d85048a59ac29a00bf04e73e8c992dfac9d0dbe42843779f294999d805a" Jul 17 14:09:23.175063 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:23.175040 2565 scope.go:117] "RemoveContainer" containerID="6a1427abc1bb63f4190797f19f1283e9768de13052847d944fb1db3a6e34dca5" Jul 17 14:09:23.182752 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:23.182739 2565 scope.go:117] "RemoveContainer" containerID="c87c4bcf3ed5158b4ef2fc017d4832dc7ec15cbab1b900b29f45a9fb76854177" Jul 17 14:09:23.187910 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:23.187889 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w"] Jul 17 14:09:23.191221 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:23.191197 2565 scope.go:117] "RemoveContainer" containerID="9156aa3f7b856d655d7c2eb516268a9ec6c5d9acd620a294510b60731a6578cb" Jul 17 14:09:23.192212 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:23.192107 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-655bd95b8f-lsr4w"] Jul 17 14:09:23.200534 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:23.200512 2565 scope.go:117] "RemoveContainer" containerID="e8e8cafeecf96e5ebd9e625d5b5a4938e3c2a7264fbfcbc1945d9d94a610c813" Jul 17 14:09:23.208372 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:23.208352 2565 scope.go:117] "RemoveContainer" containerID="83f40d85048a59ac29a00bf04e73e8c992dfac9d0dbe42843779f294999d805a" Jul 17 14:09:23.208617 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:09:23.208599 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83f40d85048a59ac29a00bf04e73e8c992dfac9d0dbe42843779f294999d805a\": container with ID starting with 83f40d85048a59ac29a00bf04e73e8c992dfac9d0dbe42843779f294999d805a not found: ID does not exist" containerID="83f40d85048a59ac29a00bf04e73e8c992dfac9d0dbe42843779f294999d805a" Jul 17 14:09:23.208670 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:23.208626 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83f40d85048a59ac29a00bf04e73e8c992dfac9d0dbe42843779f294999d805a"} err="failed to get container status \"83f40d85048a59ac29a00bf04e73e8c992dfac9d0dbe42843779f294999d805a\": rpc error: code = NotFound desc = could not find container \"83f40d85048a59ac29a00bf04e73e8c992dfac9d0dbe42843779f294999d805a\": container with ID starting with 83f40d85048a59ac29a00bf04e73e8c992dfac9d0dbe42843779f294999d805a not found: ID does not exist" Jul 17 14:09:23.208670 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:23.208646 2565 scope.go:117] "RemoveContainer" containerID="6a1427abc1bb63f4190797f19f1283e9768de13052847d944fb1db3a6e34dca5" Jul 17 14:09:23.208916 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:09:23.208900 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a1427abc1bb63f4190797f19f1283e9768de13052847d944fb1db3a6e34dca5\": container with ID starting with 6a1427abc1bb63f4190797f19f1283e9768de13052847d944fb1db3a6e34dca5 not found: ID does not exist" containerID="6a1427abc1bb63f4190797f19f1283e9768de13052847d944fb1db3a6e34dca5" Jul 17 14:09:23.208955 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:23.208922 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a1427abc1bb63f4190797f19f1283e9768de13052847d944fb1db3a6e34dca5"} err="failed to get container status \"6a1427abc1bb63f4190797f19f1283e9768de13052847d944fb1db3a6e34dca5\": rpc error: code = NotFound desc = could not find container \"6a1427abc1bb63f4190797f19f1283e9768de13052847d944fb1db3a6e34dca5\": container with ID starting with 6a1427abc1bb63f4190797f19f1283e9768de13052847d944fb1db3a6e34dca5 not found: ID does not exist" Jul 17 14:09:23.208955 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:23.208936 2565 scope.go:117] "RemoveContainer" containerID="c87c4bcf3ed5158b4ef2fc017d4832dc7ec15cbab1b900b29f45a9fb76854177" Jul 17 14:09:23.209135 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:09:23.209119 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c87c4bcf3ed5158b4ef2fc017d4832dc7ec15cbab1b900b29f45a9fb76854177\": container with ID starting with c87c4bcf3ed5158b4ef2fc017d4832dc7ec15cbab1b900b29f45a9fb76854177 not found: ID does not exist" containerID="c87c4bcf3ed5158b4ef2fc017d4832dc7ec15cbab1b900b29f45a9fb76854177" Jul 17 14:09:23.209197 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:23.209139 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c87c4bcf3ed5158b4ef2fc017d4832dc7ec15cbab1b900b29f45a9fb76854177"} err="failed to get container status \"c87c4bcf3ed5158b4ef2fc017d4832dc7ec15cbab1b900b29f45a9fb76854177\": rpc error: code = NotFound desc = could not find container \"c87c4bcf3ed5158b4ef2fc017d4832dc7ec15cbab1b900b29f45a9fb76854177\": container with ID starting with c87c4bcf3ed5158b4ef2fc017d4832dc7ec15cbab1b900b29f45a9fb76854177 not found: ID does not exist" Jul 17 14:09:23.209197 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:23.209152 2565 scope.go:117] "RemoveContainer" containerID="9156aa3f7b856d655d7c2eb516268a9ec6c5d9acd620a294510b60731a6578cb" Jul 17 14:09:23.209362 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:09:23.209348 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9156aa3f7b856d655d7c2eb516268a9ec6c5d9acd620a294510b60731a6578cb\": container with ID starting with 9156aa3f7b856d655d7c2eb516268a9ec6c5d9acd620a294510b60731a6578cb not found: ID does not exist" containerID="9156aa3f7b856d655d7c2eb516268a9ec6c5d9acd620a294510b60731a6578cb" Jul 17 14:09:23.209559 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:23.209365 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9156aa3f7b856d655d7c2eb516268a9ec6c5d9acd620a294510b60731a6578cb"} err="failed to get container status \"9156aa3f7b856d655d7c2eb516268a9ec6c5d9acd620a294510b60731a6578cb\": rpc error: code = NotFound desc = could not find container \"9156aa3f7b856d655d7c2eb516268a9ec6c5d9acd620a294510b60731a6578cb\": container with ID starting with 9156aa3f7b856d655d7c2eb516268a9ec6c5d9acd620a294510b60731a6578cb not found: ID does not exist" Jul 17 14:09:23.209559 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:23.209375 2565 scope.go:117] "RemoveContainer" containerID="e8e8cafeecf96e5ebd9e625d5b5a4938e3c2a7264fbfcbc1945d9d94a610c813" Jul 17 14:09:23.209687 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:09:23.209587 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8e8cafeecf96e5ebd9e625d5b5a4938e3c2a7264fbfcbc1945d9d94a610c813\": container with ID starting with e8e8cafeecf96e5ebd9e625d5b5a4938e3c2a7264fbfcbc1945d9d94a610c813 not found: ID does not exist" containerID="e8e8cafeecf96e5ebd9e625d5b5a4938e3c2a7264fbfcbc1945d9d94a610c813" Jul 17 14:09:23.209687 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:23.209600 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8e8cafeecf96e5ebd9e625d5b5a4938e3c2a7264fbfcbc1945d9d94a610c813"} err="failed to get container status \"e8e8cafeecf96e5ebd9e625d5b5a4938e3c2a7264fbfcbc1945d9d94a610c813\": rpc error: code = NotFound desc = could not find container \"e8e8cafeecf96e5ebd9e625d5b5a4938e3c2a7264fbfcbc1945d9d94a610c813\": container with ID starting with e8e8cafeecf96e5ebd9e625d5b5a4938e3c2a7264fbfcbc1945d9d94a610c813 not found: ID does not exist" Jul 17 14:09:23.696270 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:23.696240 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" path="/var/lib/kubelet/pods/5bf8f91b-0b40-4cff-bb0c-b9473a8b3954/volumes" Jul 17 14:09:29.373120 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:29.373073 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:09:29.579472 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:29.579436 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:09:29.706979 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:29.706874 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:09:29.824497 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:29.824456 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:09:30.070621 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:30.070588 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:09:30.167292 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:30.167256 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:09:30.267854 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:30.267824 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:09:30.336099 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:30.336011 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:09:30.658246 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:09:30.658150 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:11:19.836277 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:19.836195 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:11:19.912979 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:19.912950 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:11:20.029827 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:20.029798 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-gpl9q"] Jul 17 14:11:20.030101 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:20.030089 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" containerName="online" Jul 17 14:11:20.030144 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:20.030103 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" containerName="online" Jul 17 14:11:20.030144 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:20.030117 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" containerName="registry" Jul 17 14:11:20.030144 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:20.030123 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" containerName="registry" Jul 17 14:11:20.030144 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:20.030132 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="260ce733-5287-4091-8e7b-16e713e740a2" containerName="postgres" Jul 17 14:11:20.030144 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:20.030137 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="260ce733-5287-4091-8e7b-16e713e740a2" containerName="postgres" Jul 17 14:11:20.030144 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:20.030144 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" containerName="offline" Jul 17 14:11:20.030343 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:20.030149 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" containerName="offline" Jul 17 14:11:20.030343 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:20.030160 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c6e2178-6c14-43e6-91d3-18b286aeb453" containerName="redis" Jul 17 14:11:20.030343 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:20.030165 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c6e2178-6c14-43e6-91d3-18b286aeb453" containerName="redis" Jul 17 14:11:20.030343 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:20.030171 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" containerName="feast-apply" Jul 17 14:11:20.030343 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:20.030192 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" containerName="feast-apply" Jul 17 14:11:20.030343 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:20.030202 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" containerName="feast-init" Jul 17 14:11:20.030343 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:20.030209 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" containerName="feast-init" Jul 17 14:11:20.030343 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:20.030265 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="260ce733-5287-4091-8e7b-16e713e740a2" containerName="postgres" Jul 17 14:11:20.030343 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:20.030273 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" containerName="offline" Jul 17 14:11:20.030343 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:20.030282 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c6e2178-6c14-43e6-91d3-18b286aeb453" containerName="redis" Jul 17 14:11:20.030343 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:20.030290 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" containerName="online" Jul 17 14:11:20.030343 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:20.030297 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bf8f91b-0b40-4cff-bb0c-b9473a8b3954" containerName="registry" Jul 17 14:11:20.033092 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:20.033076 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-gpl9q" Jul 17 14:11:20.035067 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:20.035041 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\"" Jul 17 14:11:20.035067 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:20.035058 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\"" Jul 17 14:11:20.035277 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:20.035106 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-f2qhj\"" Jul 17 14:11:20.047771 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:20.047751 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-gpl9q"] Jul 17 14:11:20.063558 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:20.063536 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:11:20.194317 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:20.194228 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmxk4\" (UniqueName: \"kubernetes.io/projected/472e8cda-299e-405a-b7ea-b2e5543ccec3-kube-api-access-hmxk4\") pod \"redis-69bbd798b6-gpl9q\" (UID: \"472e8cda-299e-405a-b7ea-b2e5543ccec3\") " pod="test-ns-feast-rest/redis-69bbd798b6-gpl9q" Jul 17 14:11:20.294733 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:20.294707 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmxk4\" (UniqueName: \"kubernetes.io/projected/472e8cda-299e-405a-b7ea-b2e5543ccec3-kube-api-access-hmxk4\") pod \"redis-69bbd798b6-gpl9q\" (UID: \"472e8cda-299e-405a-b7ea-b2e5543ccec3\") " pod="test-ns-feast-rest/redis-69bbd798b6-gpl9q" Jul 17 14:11:20.308194 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:20.308148 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmxk4\" (UniqueName: \"kubernetes.io/projected/472e8cda-299e-405a-b7ea-b2e5543ccec3-kube-api-access-hmxk4\") pod \"redis-69bbd798b6-gpl9q\" (UID: \"472e8cda-299e-405a-b7ea-b2e5543ccec3\") " pod="test-ns-feast-rest/redis-69bbd798b6-gpl9q" Jul 17 14:11:20.351923 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:20.351896 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-gpl9q" Jul 17 14:11:20.475003 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:20.474854 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-gpl9q"] Jul 17 14:11:20.477613 ip-10-0-138-92 kubenswrapper[2565]: W0717 14:11:20.477584 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod472e8cda_299e_405a_b7ea_b2e5543ccec3.slice/crio-2f085192b15914383cbf5b1ba791d7dd8a51c20cc33a5eb370db02b3ac642205 WatchSource:0}: Error finding container 2f085192b15914383cbf5b1ba791d7dd8a51c20cc33a5eb370db02b3ac642205: Status 404 returned error can't find the container with id 2f085192b15914383cbf5b1ba791d7dd8a51c20cc33a5eb370db02b3ac642205 Jul 17 14:11:20.624971 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:20.624932 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-gpl9q" event={"ID":"472e8cda-299e-405a-b7ea-b2e5543ccec3","Type":"ContainerStarted","Data":"473b8858a8b6e95fb03d44de759a3d5ec2a154c23be748d2fbf037a4729eb9de"} Jul 17 14:11:20.625124 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:20.624978 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-gpl9q" event={"ID":"472e8cda-299e-405a-b7ea-b2e5543ccec3","Type":"ContainerStarted","Data":"2f085192b15914383cbf5b1ba791d7dd8a51c20cc33a5eb370db02b3ac642205"} Jul 17 14:11:20.639611 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:20.639567 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/redis-69bbd798b6-gpl9q" podStartSLOduration=0.639552946 podStartE2EDuration="639.552946ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:11:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:11:20.638555992 +0000 UTC m=+899.466908337" watchObservedRunningTime="2026-07-17 14:11:20.639552946 +0000 UTC m=+899.467905292" Jul 17 14:11:21.608391 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:21.608360 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-86jkr_c4b20c0f-f85e-488d-aee9-b772cb8738a0/console-operator/1.log" Jul 17 14:11:21.609357 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:21.609335 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-86jkr_c4b20c0f-f85e-488d-aee9-b772cb8738a0/console-operator/1.log" Jul 17 14:11:25.479673 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:25.479642 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-h5kfm"] Jul 17 14:11:25.482900 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:25.482873 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-h5kfm" Jul 17 14:11:25.484887 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:25.484861 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\"" Jul 17 14:11:25.489502 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:25.489424 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-h5kfm"] Jul 17 14:11:25.510275 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:25.510244 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:11:25.533502 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:25.533475 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/b6686c70-5045-492b-952d-7c8b0c3267d6-postgresdata\") pod \"postgres-864846d4f5-h5kfm\" (UID: \"b6686c70-5045-492b-952d-7c8b0c3267d6\") " pod="test-ns-feast-rest/postgres-864846d4f5-h5kfm" Jul 17 14:11:25.533577 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:25.533537 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7smrn\" (UniqueName: \"kubernetes.io/projected/b6686c70-5045-492b-952d-7c8b0c3267d6-kube-api-access-7smrn\") pod \"postgres-864846d4f5-h5kfm\" (UID: \"b6686c70-5045-492b-952d-7c8b0c3267d6\") " pod="test-ns-feast-rest/postgres-864846d4f5-h5kfm" Jul 17 14:11:25.634131 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:25.634092 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7smrn\" (UniqueName: \"kubernetes.io/projected/b6686c70-5045-492b-952d-7c8b0c3267d6-kube-api-access-7smrn\") pod \"postgres-864846d4f5-h5kfm\" (UID: \"b6686c70-5045-492b-952d-7c8b0c3267d6\") " pod="test-ns-feast-rest/postgres-864846d4f5-h5kfm" Jul 17 14:11:25.634324 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:25.634157 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/b6686c70-5045-492b-952d-7c8b0c3267d6-postgresdata\") pod \"postgres-864846d4f5-h5kfm\" (UID: \"b6686c70-5045-492b-952d-7c8b0c3267d6\") " pod="test-ns-feast-rest/postgres-864846d4f5-h5kfm" Jul 17 14:11:25.634513 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:25.634496 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/b6686c70-5045-492b-952d-7c8b0c3267d6-postgresdata\") pod \"postgres-864846d4f5-h5kfm\" (UID: \"b6686c70-5045-492b-952d-7c8b0c3267d6\") " pod="test-ns-feast-rest/postgres-864846d4f5-h5kfm" Jul 17 14:11:25.642285 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:25.642259 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7smrn\" (UniqueName: \"kubernetes.io/projected/b6686c70-5045-492b-952d-7c8b0c3267d6-kube-api-access-7smrn\") pod \"postgres-864846d4f5-h5kfm\" (UID: \"b6686c70-5045-492b-952d-7c8b0c3267d6\") " pod="test-ns-feast-rest/postgres-864846d4f5-h5kfm" Jul 17 14:11:25.793489 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:25.793462 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-h5kfm" Jul 17 14:11:25.918772 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:25.918749 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-h5kfm"] Jul 17 14:11:25.920833 ip-10-0-138-92 kubenswrapper[2565]: W0717 14:11:25.920811 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6686c70_5045_492b_952d_7c8b0c3267d6.slice/crio-d2cfca8007c24bbdaa173a5b214b9b2d58e69b7b909880dfba9ea378eaa46360 WatchSource:0}: Error finding container d2cfca8007c24bbdaa173a5b214b9b2d58e69b7b909880dfba9ea378eaa46360: Status 404 returned error can't find the container with id d2cfca8007c24bbdaa173a5b214b9b2d58e69b7b909880dfba9ea378eaa46360 Jul 17 14:11:26.648713 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:26.648671 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-h5kfm" event={"ID":"b6686c70-5045-492b-952d-7c8b0c3267d6","Type":"ContainerStarted","Data":"dea8ca2f3869d43f3782093c936f35df2ca4dc24a6c4aa86091d4e56e85bc9c9"} Jul 17 14:11:26.649161 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:26.648722 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-h5kfm" event={"ID":"b6686c70-5045-492b-952d-7c8b0c3267d6","Type":"ContainerStarted","Data":"d2cfca8007c24bbdaa173a5b214b9b2d58e69b7b909880dfba9ea378eaa46360"} Jul 17 14:11:26.664310 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:26.664263 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-h5kfm" podStartSLOduration=1.664247397 podStartE2EDuration="1.664247397s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:11:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:11:26.663231434 +0000 UTC m=+905.491583784" watchObservedRunningTime="2026-07-17 14:11:26.664247397 +0000 UTC m=+905.492599742" Jul 17 14:11:30.984663 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:30.984634 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:11:31.083221 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:31.083165 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:11:31.157751 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:31.157721 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8"] Jul 17 14:11:31.161374 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:31.161357 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" Jul 17 14:11:31.163598 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:31.163575 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\"" Jul 17 14:11:31.163693 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:31.163650 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\"" Jul 17 14:11:31.163878 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:31.163857 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\"" Jul 17 14:11:31.164028 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:31.163918 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-vvjfg\"" Jul 17 14:11:31.172811 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:31.172787 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8ad5d073-612d-4161-b831-e022bbf0b382-feast-data\") pod \"feast-credit-scoring-6c7cf9cbf7-wpbd8\" (UID: \"8ad5d073-612d-4161-b831-e022bbf0b382\") " pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" Jul 17 14:11:31.172917 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:31.172833 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8ad5d073-612d-4161-b831-e022bbf0b382-online-tls\") pod \"feast-credit-scoring-6c7cf9cbf7-wpbd8\" (UID: \"8ad5d073-612d-4161-b831-e022bbf0b382\") " pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" Jul 17 14:11:31.172965 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:31.172946 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8ad5d073-612d-4161-b831-e022bbf0b382-registry-tls\") pod \"feast-credit-scoring-6c7cf9cbf7-wpbd8\" (UID: \"8ad5d073-612d-4161-b831-e022bbf0b382\") " pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" Jul 17 14:11:31.173020 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:31.172992 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp6t8\" (UniqueName: \"kubernetes.io/projected/8ad5d073-612d-4161-b831-e022bbf0b382-kube-api-access-cp6t8\") pod \"feast-credit-scoring-6c7cf9cbf7-wpbd8\" (UID: \"8ad5d073-612d-4161-b831-e022bbf0b382\") " pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" Jul 17 14:11:31.173173 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:31.173160 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8"] Jul 17 14:11:31.191064 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:31.191044 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:11:31.273801 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:31.273736 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8ad5d073-612d-4161-b831-e022bbf0b382-registry-tls\") pod \"feast-credit-scoring-6c7cf9cbf7-wpbd8\" (UID: \"8ad5d073-612d-4161-b831-e022bbf0b382\") " pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" Jul 17 14:11:31.273801 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:31.273768 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp6t8\" (UniqueName: \"kubernetes.io/projected/8ad5d073-612d-4161-b831-e022bbf0b382-kube-api-access-cp6t8\") pod \"feast-credit-scoring-6c7cf9cbf7-wpbd8\" (UID: \"8ad5d073-612d-4161-b831-e022bbf0b382\") " pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" Jul 17 14:11:31.273801 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:31.273796 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8ad5d073-612d-4161-b831-e022bbf0b382-feast-data\") pod \"feast-credit-scoring-6c7cf9cbf7-wpbd8\" (UID: \"8ad5d073-612d-4161-b831-e022bbf0b382\") " pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" Jul 17 14:11:31.274042 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:31.273828 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8ad5d073-612d-4161-b831-e022bbf0b382-online-tls\") pod \"feast-credit-scoring-6c7cf9cbf7-wpbd8\" (UID: \"8ad5d073-612d-4161-b831-e022bbf0b382\") " pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" Jul 17 14:11:31.274259 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:31.274239 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8ad5d073-612d-4161-b831-e022bbf0b382-feast-data\") pod \"feast-credit-scoring-6c7cf9cbf7-wpbd8\" (UID: \"8ad5d073-612d-4161-b831-e022bbf0b382\") " pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" Jul 17 14:11:31.276221 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:31.276205 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8ad5d073-612d-4161-b831-e022bbf0b382-registry-tls\") pod \"feast-credit-scoring-6c7cf9cbf7-wpbd8\" (UID: \"8ad5d073-612d-4161-b831-e022bbf0b382\") " pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" Jul 17 14:11:31.276382 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:31.276363 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8ad5d073-612d-4161-b831-e022bbf0b382-online-tls\") pod \"feast-credit-scoring-6c7cf9cbf7-wpbd8\" (UID: \"8ad5d073-612d-4161-b831-e022bbf0b382\") " pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" Jul 17 14:11:31.282252 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:31.282229 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp6t8\" (UniqueName: \"kubernetes.io/projected/8ad5d073-612d-4161-b831-e022bbf0b382-kube-api-access-cp6t8\") pod \"feast-credit-scoring-6c7cf9cbf7-wpbd8\" (UID: \"8ad5d073-612d-4161-b831-e022bbf0b382\") " pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" Jul 17 14:11:31.290169 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:31.290150 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:11:31.470665 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:31.470628 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" Jul 17 14:11:31.608072 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:31.608050 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8"] Jul 17 14:11:31.610451 ip-10-0-138-92 kubenswrapper[2565]: W0717 14:11:31.610422 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ad5d073_612d_4161_b831_e022bbf0b382.slice/crio-dd2d3162a82b0838decfc17b2f033a83e5bbc6fa22d6cb8f274f231e1fe3f2ad WatchSource:0}: Error finding container dd2d3162a82b0838decfc17b2f033a83e5bbc6fa22d6cb8f274f231e1fe3f2ad: Status 404 returned error can't find the container with id dd2d3162a82b0838decfc17b2f033a83e5bbc6fa22d6cb8f274f231e1fe3f2ad Jul 17 14:11:31.670921 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:31.670895 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" event={"ID":"8ad5d073-612d-4161-b831-e022bbf0b382","Type":"ContainerStarted","Data":"dd2d3162a82b0838decfc17b2f033a83e5bbc6fa22d6cb8f274f231e1fe3f2ad"} Jul 17 14:11:32.675700 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:32.675666 2565 generic.go:356] "Generic (PLEG): container finished" podID="8ad5d073-612d-4161-b831-e022bbf0b382" containerID="93a6fa329814da560063ddd150a29401b59d45d39e1ec6a523fddc12a1d0b533" exitCode=0 Jul 17 14:11:32.676118 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:32.675751 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" event={"ID":"8ad5d073-612d-4161-b831-e022bbf0b382","Type":"ContainerDied","Data":"93a6fa329814da560063ddd150a29401b59d45d39e1ec6a523fddc12a1d0b533"} Jul 17 14:11:33.682140 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:33.682105 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" event={"ID":"8ad5d073-612d-4161-b831-e022bbf0b382","Type":"ContainerStarted","Data":"fadcfd019b2d879170e4b96b6749f62ac406506003ed5f1aae777f0df256c10a"} Jul 17 14:11:39.708498 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:39.708465 2565 generic.go:356] "Generic (PLEG): container finished" podID="8ad5d073-612d-4161-b831-e022bbf0b382" containerID="fadcfd019b2d879170e4b96b6749f62ac406506003ed5f1aae777f0df256c10a" exitCode=0 Jul 17 14:11:39.708896 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:39.708534 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" event={"ID":"8ad5d073-612d-4161-b831-e022bbf0b382","Type":"ContainerDied","Data":"fadcfd019b2d879170e4b96b6749f62ac406506003ed5f1aae777f0df256c10a"} Jul 17 14:11:40.716332 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:40.716297 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" event={"ID":"8ad5d073-612d-4161-b831-e022bbf0b382","Type":"ContainerStarted","Data":"8a29d8ee1d85779f9af13bd04bf8b3862f0472be79115e774da0bfdd6552e561"} Jul 17 14:11:40.716800 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:40.716359 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" event={"ID":"8ad5d073-612d-4161-b831-e022bbf0b382","Type":"ContainerStarted","Data":"2d27639c3cd75dd6d5020b3ca6026e7e015aa6eda95014440688566e464cb58d"} Jul 17 14:11:40.738717 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:40.738657 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" podStartSLOduration=9.738627066 podStartE2EDuration="9.738627066s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:11:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:11:40.736496271 +0000 UTC m=+919.564848618" watchObservedRunningTime="2026-07-17 14:11:40.738627066 +0000 UTC m=+919.566979414" Jul 17 14:11:41.471035 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:41.470999 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" Jul 17 14:11:41.471226 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:41.471063 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" Jul 17 14:11:43.471540 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:43.471502 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" Jul 17 14:11:43.471914 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:43.471607 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" Jul 17 14:11:43.473046 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:43.473005 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" podUID="8ad5d073-612d-4161-b831-e022bbf0b382" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.31:6571: connect: connection refused" Jul 17 14:11:43.473207 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:43.473043 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" podUID="8ad5d073-612d-4161-b831-e022bbf0b382" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused" Jul 17 14:11:46.471380 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:46.471336 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" podUID="8ad5d073-612d-4161-b831-e022bbf0b382" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.31:6571: connect: connection refused" Jul 17 14:11:46.477244 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:46.477216 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" Jul 17 14:11:46.480857 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:46.480830 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" Jul 17 14:11:49.471136 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:49.471093 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" podUID="8ad5d073-612d-4161-b831-e022bbf0b382" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.31:6571: connect: connection refused" Jul 17 14:11:52.472361 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:52.472334 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" Jul 17 14:11:52.473200 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:52.473163 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" Jul 17 14:11:52.728619 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:52.728530 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:11:56.907915 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:56.907878 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:11:57.008678 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:57.008643 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:11:57.068132 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:57.068102 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc"] Jul 17 14:11:57.072134 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:57.072105 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" Jul 17 14:11:57.073488 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:57.073461 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:11:57.073940 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:57.073923 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\"" Jul 17 14:11:57.074075 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:57.074058 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\"" Jul 17 14:11:57.074124 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:57.074058 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\"" Jul 17 14:11:57.074124 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:57.074115 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-b27n9\"" Jul 17 14:11:57.082322 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:57.082303 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc"] Jul 17 14:11:57.192206 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:57.192104 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdlww\" (UniqueName: \"kubernetes.io/projected/09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd-kube-api-access-mdlww\") pod \"feast-driver-ranking-5fbf78c74-4nkfc\" (UID: \"09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd\") " pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" Jul 17 14:11:57.192206 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:57.192146 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd-registry-tls\") pod \"feast-driver-ranking-5fbf78c74-4nkfc\" (UID: \"09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd\") " pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" Jul 17 14:11:57.192387 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:57.192256 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd-feast-data\") pod \"feast-driver-ranking-5fbf78c74-4nkfc\" (UID: \"09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd\") " pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" Jul 17 14:11:57.192387 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:57.192316 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd-online-tls\") pod \"feast-driver-ranking-5fbf78c74-4nkfc\" (UID: \"09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd\") " pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" Jul 17 14:11:57.292708 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:57.292674 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd-feast-data\") pod \"feast-driver-ranking-5fbf78c74-4nkfc\" (UID: \"09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd\") " pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" Jul 17 14:11:57.292708 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:57.292711 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd-online-tls\") pod \"feast-driver-ranking-5fbf78c74-4nkfc\" (UID: \"09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd\") " pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" Jul 17 14:11:57.292908 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:57.292739 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdlww\" (UniqueName: \"kubernetes.io/projected/09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd-kube-api-access-mdlww\") pod \"feast-driver-ranking-5fbf78c74-4nkfc\" (UID: \"09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd\") " pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" Jul 17 14:11:57.292908 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:57.292763 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd-registry-tls\") pod \"feast-driver-ranking-5fbf78c74-4nkfc\" (UID: \"09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd\") " pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" Jul 17 14:11:57.292908 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:11:57.292871 2565 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-driver-ranking-registry-tls: secret "feast-driver-ranking-registry-tls" not found Jul 17 14:11:57.293026 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:11:57.292943 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd-registry-tls podName:09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd nodeName:}" failed. No retries permitted until 2026-07-17 14:11:57.792926273 +0000 UTC m=+936.621278597 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd-registry-tls") pod "feast-driver-ranking-5fbf78c74-4nkfc" (UID: "09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd") : secret "feast-driver-ranking-registry-tls" not found Jul 17 14:11:57.293200 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:57.293158 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd-feast-data\") pod \"feast-driver-ranking-5fbf78c74-4nkfc\" (UID: \"09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd\") " pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" Jul 17 14:11:57.295328 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:57.295307 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd-online-tls\") pod \"feast-driver-ranking-5fbf78c74-4nkfc\" (UID: \"09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd\") " pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" Jul 17 14:11:57.301347 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:57.301323 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdlww\" (UniqueName: \"kubernetes.io/projected/09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd-kube-api-access-mdlww\") pod \"feast-driver-ranking-5fbf78c74-4nkfc\" (UID: \"09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd\") " pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" Jul 17 14:11:57.420259 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:57.420225 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:11:57.796247 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:57.796221 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd-registry-tls\") pod \"feast-driver-ranking-5fbf78c74-4nkfc\" (UID: \"09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd\") " pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" Jul 17 14:11:57.798672 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:57.798640 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd-registry-tls\") pod \"feast-driver-ranking-5fbf78c74-4nkfc\" (UID: \"09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd\") " pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" Jul 17 14:11:57.981593 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:57.981560 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" Jul 17 14:11:58.115423 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:58.115397 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc"] Jul 17 14:11:58.117998 ip-10-0-138-92 kubenswrapper[2565]: W0717 14:11:58.117970 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09c9c48f_ab42_4c1c_84fc_ec7069d7a8fd.slice/crio-83b5085d9a6177940c42cccaf86fb7285e2bd56c04765a557acef74e8a7c0d9b WatchSource:0}: Error finding container 83b5085d9a6177940c42cccaf86fb7285e2bd56c04765a557acef74e8a7c0d9b: Status 404 returned error can't find the container with id 83b5085d9a6177940c42cccaf86fb7285e2bd56c04765a557acef74e8a7c0d9b Jul 17 14:11:58.802245 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:58.802205 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" event={"ID":"09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd","Type":"ContainerStarted","Data":"c99bc6ff8d2de925796318712d69308ae91814920881617abacf60f6bd8ced15"} Jul 17 14:11:58.802445 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:11:58.802276 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" event={"ID":"09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd","Type":"ContainerStarted","Data":"83b5085d9a6177940c42cccaf86fb7285e2bd56c04765a557acef74e8a7c0d9b"} Jul 17 14:12:03.824476 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:12:03.824442 2565 generic.go:356] "Generic (PLEG): container finished" podID="09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd" containerID="c99bc6ff8d2de925796318712d69308ae91814920881617abacf60f6bd8ced15" exitCode=0 Jul 17 14:12:03.824931 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:12:03.824520 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" event={"ID":"09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd","Type":"ContainerDied","Data":"c99bc6ff8d2de925796318712d69308ae91814920881617abacf60f6bd8ced15"} Jul 17 14:12:04.830110 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:12:04.830054 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" event={"ID":"09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd","Type":"ContainerStarted","Data":"f246cdfb436c5394ed0b060beebeef8d058f9a729dd5fa6f7b982ef880b0b547"} Jul 17 14:12:10.858340 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:12:10.858308 2565 generic.go:356] "Generic (PLEG): container finished" podID="09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd" containerID="f246cdfb436c5394ed0b060beebeef8d058f9a729dd5fa6f7b982ef880b0b547" exitCode=0 Jul 17 14:12:10.858768 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:12:10.858375 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" event={"ID":"09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd","Type":"ContainerDied","Data":"f246cdfb436c5394ed0b060beebeef8d058f9a729dd5fa6f7b982ef880b0b547"} Jul 17 14:12:11.865654 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:12:11.865622 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" event={"ID":"09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd","Type":"ContainerStarted","Data":"679d40cb26af9c4c3e50677579666999cf86fcc22683338a7a833936bd39015f"} Jul 17 14:12:11.866150 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:12:11.865676 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" event={"ID":"09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd","Type":"ContainerStarted","Data":"a0392425709416e9be247da7d2049a31beeac2ca6cda1000c42eb44f636fed37"} Jul 17 14:12:12.982675 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:12:12.982626 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" Jul 17 14:12:12.983197 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:12:12.982746 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" Jul 17 14:12:12.983922 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:12:12.983894 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" podUID="09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused" Jul 17 14:12:12.984005 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:12:12.983938 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" podUID="09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused" Jul 17 14:12:15.982909 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:12:15.982867 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" podUID="09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused" Jul 17 14:12:15.983390 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:12:15.982995 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" podUID="09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused" Jul 17 14:12:17.982504 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:12:17.982464 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" Jul 17 14:12:17.982899 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:12:17.982534 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" Jul 17 14:12:18.982051 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:12:18.982003 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" podUID="09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused" Jul 17 14:12:18.987923 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:12:18.987897 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" Jul 17 14:12:18.991145 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:12:18.991120 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" Jul 17 14:12:19.008907 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:12:19.008860 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" podStartSLOduration=22.008845616 podStartE2EDuration="22.008845616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:11:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:12:11.888079907 +0000 UTC m=+950.716432255" watchObservedRunningTime="2026-07-17 14:12:19.008845616 +0000 UTC m=+957.837197962" Jul 17 14:12:21.982435 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:12:21.982392 2565 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" podUID="09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.32:6571: connect: connection refused" Jul 17 14:12:24.982448 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:12:24.982417 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" Jul 17 14:12:24.983200 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:12:24.983153 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" Jul 17 14:13:39.046516 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:39.046485 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:13:40.843923 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:40.843886 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:13:41.311293 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:41.311257 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-f9887f865-z9j72"] Jul 17 14:13:41.311546 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:41.311506 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-f9887f865-z9j72" podUID="6bd66966-3d6c-4338-9c13-b9bd0fa4acc1" containerName="manager" containerID="cri-o://ebf36699ab211f118a969a35e99dcf17b5f94fea23babfe9677e5dc41d0b1ef7" gracePeriod=10 Jul 17 14:13:41.327316 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:41.327288 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:13:41.572038 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:41.571984 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-f9887f865-z9j72" Jul 17 14:13:41.678556 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:41.678524 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lhhh\" (UniqueName: \"kubernetes.io/projected/6bd66966-3d6c-4338-9c13-b9bd0fa4acc1-kube-api-access-8lhhh\") pod \"6bd66966-3d6c-4338-9c13-b9bd0fa4acc1\" (UID: \"6bd66966-3d6c-4338-9c13-b9bd0fa4acc1\") " Jul 17 14:13:41.680778 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:41.680756 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6bd66966-3d6c-4338-9c13-b9bd0fa4acc1-kube-api-access-8lhhh" (OuterVolumeSpecName: "kube-api-access-8lhhh") pod "6bd66966-3d6c-4338-9c13-b9bd0fa4acc1" (UID: "6bd66966-3d6c-4338-9c13-b9bd0fa4acc1"). InnerVolumeSpecName "kube-api-access-8lhhh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 14:13:41.711499 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:41.711472 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:13:41.770273 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:41.770241 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8"] Jul 17 14:13:41.770529 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:41.770498 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" podUID="8ad5d073-612d-4161-b831-e022bbf0b382" containerName="registry" containerID="cri-o://2d27639c3cd75dd6d5020b3ca6026e7e015aa6eda95014440688566e464cb58d" gracePeriod=30 Jul 17 14:13:41.770689 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:41.770572 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" podUID="8ad5d073-612d-4161-b831-e022bbf0b382" containerName="online" containerID="cri-o://8a29d8ee1d85779f9af13bd04bf8b3862f0472be79115e774da0bfdd6552e561" gracePeriod=30 Jul 17 14:13:41.772208 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:41.772161 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc"] Jul 17 14:13:41.772526 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:41.772501 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" podUID="09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd" containerName="registry" containerID="cri-o://a0392425709416e9be247da7d2049a31beeac2ca6cda1000c42eb44f636fed37" gracePeriod=30 Jul 17 14:13:41.772659 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:41.772531 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" podUID="09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd" containerName="online" containerID="cri-o://679d40cb26af9c4c3e50677579666999cf86fcc22683338a7a833936bd39015f" gracePeriod=30 Jul 17 14:13:41.779470 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:41.779449 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lhhh\" (UniqueName: \"kubernetes.io/projected/6bd66966-3d6c-4338-9c13-b9bd0fa4acc1-kube-api-access-8lhhh\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:13:41.807741 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:41.807720 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:13:42.279352 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:42.279319 2565 generic.go:356] "Generic (PLEG): container finished" podID="6bd66966-3d6c-4338-9c13-b9bd0fa4acc1" containerID="ebf36699ab211f118a969a35e99dcf17b5f94fea23babfe9677e5dc41d0b1ef7" exitCode=0 Jul 17 14:13:42.279865 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:42.279371 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-f9887f865-z9j72" Jul 17 14:13:42.279865 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:42.279403 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-f9887f865-z9j72" event={"ID":"6bd66966-3d6c-4338-9c13-b9bd0fa4acc1","Type":"ContainerDied","Data":"ebf36699ab211f118a969a35e99dcf17b5f94fea23babfe9677e5dc41d0b1ef7"} Jul 17 14:13:42.279865 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:42.279468 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-f9887f865-z9j72" event={"ID":"6bd66966-3d6c-4338-9c13-b9bd0fa4acc1","Type":"ContainerDied","Data":"d55c286b8591abbcc9228e58818e0333c2cdd36702f43201c8baf94f72191e44"} Jul 17 14:13:42.279865 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:42.279503 2565 scope.go:117] "RemoveContainer" containerID="ebf36699ab211f118a969a35e99dcf17b5f94fea23babfe9677e5dc41d0b1ef7" Jul 17 14:13:42.289342 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:42.289322 2565 scope.go:117] "RemoveContainer" containerID="ebf36699ab211f118a969a35e99dcf17b5f94fea23babfe9677e5dc41d0b1ef7" Jul 17 14:13:42.289652 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:13:42.289620 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebf36699ab211f118a969a35e99dcf17b5f94fea23babfe9677e5dc41d0b1ef7\": container with ID starting with ebf36699ab211f118a969a35e99dcf17b5f94fea23babfe9677e5dc41d0b1ef7 not found: ID does not exist" containerID="ebf36699ab211f118a969a35e99dcf17b5f94fea23babfe9677e5dc41d0b1ef7" Jul 17 14:13:42.289738 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:42.289656 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebf36699ab211f118a969a35e99dcf17b5f94fea23babfe9677e5dc41d0b1ef7"} err="failed to get container status \"ebf36699ab211f118a969a35e99dcf17b5f94fea23babfe9677e5dc41d0b1ef7\": rpc error: code = NotFound desc = could not find container \"ebf36699ab211f118a969a35e99dcf17b5f94fea23babfe9677e5dc41d0b1ef7\": container with ID starting with ebf36699ab211f118a969a35e99dcf17b5f94fea23babfe9677e5dc41d0b1ef7 not found: ID does not exist" Jul 17 14:13:42.295963 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:42.295940 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-f9887f865-z9j72"] Jul 17 14:13:42.301010 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:42.300987 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-f9887f865-z9j72"] Jul 17 14:13:43.285677 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:43.285647 2565 generic.go:356] "Generic (PLEG): container finished" podID="8ad5d073-612d-4161-b831-e022bbf0b382" containerID="8a29d8ee1d85779f9af13bd04bf8b3862f0472be79115e774da0bfdd6552e561" exitCode=0 Jul 17 14:13:43.286064 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:43.285722 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" event={"ID":"8ad5d073-612d-4161-b831-e022bbf0b382","Type":"ContainerDied","Data":"8a29d8ee1d85779f9af13bd04bf8b3862f0472be79115e774da0bfdd6552e561"} Jul 17 14:13:43.288693 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:43.288672 2565 generic.go:356] "Generic (PLEG): container finished" podID="09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd" containerID="679d40cb26af9c4c3e50677579666999cf86fcc22683338a7a833936bd39015f" exitCode=0 Jul 17 14:13:43.288815 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:43.288708 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" event={"ID":"09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd","Type":"ContainerDied","Data":"679d40cb26af9c4c3e50677579666999cf86fcc22683338a7a833936bd39015f"} Jul 17 14:13:43.697101 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:43.697002 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6bd66966-3d6c-4338-9c13-b9bd0fa4acc1" path="/var/lib/kubelet/pods/6bd66966-3d6c-4338-9c13-b9bd0fa4acc1/volumes" Jul 17 14:13:43.992517 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:43.992435 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-h5kfm"] Jul 17 14:13:43.992664 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:43.992600 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-h5kfm" podUID="b6686c70-5045-492b-952d-7c8b0c3267d6" containerName="postgres" containerID="cri-o://dea8ca2f3869d43f3782093c936f35df2ca4dc24a6c4aa86091d4e56e85bc9c9" gracePeriod=30 Jul 17 14:13:44.008715 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:44.008689 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-gpl9q"] Jul 17 14:13:44.008993 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:44.008968 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/redis-69bbd798b6-gpl9q" podUID="472e8cda-299e-405a-b7ea-b2e5543ccec3" containerName="redis" containerID="cri-o://473b8858a8b6e95fb03d44de759a3d5ec2a154c23be748d2fbf037a4729eb9de" gracePeriod=30 Jul 17 14:13:44.072355 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:44.072325 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:13:44.276449 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:44.276426 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-h5kfm" Jul 17 14:13:44.279283 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:44.279266 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-gpl9q" Jul 17 14:13:44.298200 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:44.296859 2565 generic.go:356] "Generic (PLEG): container finished" podID="472e8cda-299e-405a-b7ea-b2e5543ccec3" containerID="473b8858a8b6e95fb03d44de759a3d5ec2a154c23be748d2fbf037a4729eb9de" exitCode=0 Jul 17 14:13:44.298200 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:44.296986 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-gpl9q" event={"ID":"472e8cda-299e-405a-b7ea-b2e5543ccec3","Type":"ContainerDied","Data":"473b8858a8b6e95fb03d44de759a3d5ec2a154c23be748d2fbf037a4729eb9de"} Jul 17 14:13:44.298200 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:44.297025 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-gpl9q" event={"ID":"472e8cda-299e-405a-b7ea-b2e5543ccec3","Type":"ContainerDied","Data":"2f085192b15914383cbf5b1ba791d7dd8a51c20cc33a5eb370db02b3ac642205"} Jul 17 14:13:44.298200 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:44.297047 2565 scope.go:117] "RemoveContainer" containerID="473b8858a8b6e95fb03d44de759a3d5ec2a154c23be748d2fbf037a4729eb9de" Jul 17 14:13:44.298200 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:44.297241 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-gpl9q" Jul 17 14:13:44.301735 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:44.301706 2565 generic.go:356] "Generic (PLEG): container finished" podID="b6686c70-5045-492b-952d-7c8b0c3267d6" containerID="dea8ca2f3869d43f3782093c936f35df2ca4dc24a6c4aa86091d4e56e85bc9c9" exitCode=0 Jul 17 14:13:44.301875 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:44.301784 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-h5kfm" Jul 17 14:13:44.301875 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:44.301789 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-h5kfm" event={"ID":"b6686c70-5045-492b-952d-7c8b0c3267d6","Type":"ContainerDied","Data":"dea8ca2f3869d43f3782093c936f35df2ca4dc24a6c4aa86091d4e56e85bc9c9"} Jul 17 14:13:44.301983 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:44.301894 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-h5kfm" event={"ID":"b6686c70-5045-492b-952d-7c8b0c3267d6","Type":"ContainerDied","Data":"d2cfca8007c24bbdaa173a5b214b9b2d58e69b7b909880dfba9ea378eaa46360"} Jul 17 14:13:44.310309 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:44.310268 2565 scope.go:117] "RemoveContainer" containerID="473b8858a8b6e95fb03d44de759a3d5ec2a154c23be748d2fbf037a4729eb9de" Jul 17 14:13:44.310705 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:13:44.310615 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"473b8858a8b6e95fb03d44de759a3d5ec2a154c23be748d2fbf037a4729eb9de\": container with ID starting with 473b8858a8b6e95fb03d44de759a3d5ec2a154c23be748d2fbf037a4729eb9de not found: ID does not exist" containerID="473b8858a8b6e95fb03d44de759a3d5ec2a154c23be748d2fbf037a4729eb9de" Jul 17 14:13:44.310705 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:44.310654 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"473b8858a8b6e95fb03d44de759a3d5ec2a154c23be748d2fbf037a4729eb9de"} err="failed to get container status \"473b8858a8b6e95fb03d44de759a3d5ec2a154c23be748d2fbf037a4729eb9de\": rpc error: code = NotFound desc = could not find container \"473b8858a8b6e95fb03d44de759a3d5ec2a154c23be748d2fbf037a4729eb9de\": container with ID starting with 473b8858a8b6e95fb03d44de759a3d5ec2a154c23be748d2fbf037a4729eb9de not found: ID does not exist" Jul 17 14:13:44.310705 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:44.310689 2565 scope.go:117] "RemoveContainer" containerID="dea8ca2f3869d43f3782093c936f35df2ca4dc24a6c4aa86091d4e56e85bc9c9" Jul 17 14:13:44.320343 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:44.320319 2565 scope.go:117] "RemoveContainer" containerID="dea8ca2f3869d43f3782093c936f35df2ca4dc24a6c4aa86091d4e56e85bc9c9" Jul 17 14:13:44.320644 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:13:44.320620 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dea8ca2f3869d43f3782093c936f35df2ca4dc24a6c4aa86091d4e56e85bc9c9\": container with ID starting with dea8ca2f3869d43f3782093c936f35df2ca4dc24a6c4aa86091d4e56e85bc9c9 not found: ID does not exist" containerID="dea8ca2f3869d43f3782093c936f35df2ca4dc24a6c4aa86091d4e56e85bc9c9" Jul 17 14:13:44.320712 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:44.320654 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dea8ca2f3869d43f3782093c936f35df2ca4dc24a6c4aa86091d4e56e85bc9c9"} err="failed to get container status \"dea8ca2f3869d43f3782093c936f35df2ca4dc24a6c4aa86091d4e56e85bc9c9\": rpc error: code = NotFound desc = could not find container \"dea8ca2f3869d43f3782093c936f35df2ca4dc24a6c4aa86091d4e56e85bc9c9\": container with ID starting with dea8ca2f3869d43f3782093c936f35df2ca4dc24a6c4aa86091d4e56e85bc9c9 not found: ID does not exist" Jul 17 14:13:44.404543 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:44.404518 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmxk4\" (UniqueName: \"kubernetes.io/projected/472e8cda-299e-405a-b7ea-b2e5543ccec3-kube-api-access-hmxk4\") pod \"472e8cda-299e-405a-b7ea-b2e5543ccec3\" (UID: \"472e8cda-299e-405a-b7ea-b2e5543ccec3\") " Jul 17 14:13:44.404681 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:44.404587 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7smrn\" (UniqueName: \"kubernetes.io/projected/b6686c70-5045-492b-952d-7c8b0c3267d6-kube-api-access-7smrn\") pod \"b6686c70-5045-492b-952d-7c8b0c3267d6\" (UID: \"b6686c70-5045-492b-952d-7c8b0c3267d6\") " Jul 17 14:13:44.404681 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:44.404633 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/b6686c70-5045-492b-952d-7c8b0c3267d6-postgresdata\") pod \"b6686c70-5045-492b-952d-7c8b0c3267d6\" (UID: \"b6686c70-5045-492b-952d-7c8b0c3267d6\") " Jul 17 14:13:44.406810 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:44.406781 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/472e8cda-299e-405a-b7ea-b2e5543ccec3-kube-api-access-hmxk4" (OuterVolumeSpecName: "kube-api-access-hmxk4") pod "472e8cda-299e-405a-b7ea-b2e5543ccec3" (UID: "472e8cda-299e-405a-b7ea-b2e5543ccec3"). InnerVolumeSpecName "kube-api-access-hmxk4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 14:13:44.406929 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:44.406838 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6686c70-5045-492b-952d-7c8b0c3267d6-kube-api-access-7smrn" (OuterVolumeSpecName: "kube-api-access-7smrn") pod "b6686c70-5045-492b-952d-7c8b0c3267d6" (UID: "b6686c70-5045-492b-952d-7c8b0c3267d6"). InnerVolumeSpecName "kube-api-access-7smrn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 14:13:44.434467 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:44.434439 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6686c70-5045-492b-952d-7c8b0c3267d6-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "b6686c70-5045-492b-952d-7c8b0c3267d6" (UID: "b6686c70-5045-492b-952d-7c8b0c3267d6"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 14:13:44.505776 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:44.505706 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmxk4\" (UniqueName: \"kubernetes.io/projected/472e8cda-299e-405a-b7ea-b2e5543ccec3-kube-api-access-hmxk4\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:13:44.505776 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:44.505733 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7smrn\" (UniqueName: \"kubernetes.io/projected/b6686c70-5045-492b-952d-7c8b0c3267d6-kube-api-access-7smrn\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:13:44.505776 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:44.505742 2565 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/b6686c70-5045-492b-952d-7c8b0c3267d6-postgresdata\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:13:44.617648 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:44.617623 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-gpl9q"] Jul 17 14:13:44.621688 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:44.621669 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-gpl9q"] Jul 17 14:13:44.636919 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:44.636899 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-h5kfm"] Jul 17 14:13:44.639207 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:44.639187 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-h5kfm"] Jul 17 14:13:45.696141 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:45.696107 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="472e8cda-299e-405a-b7ea-b2e5543ccec3" path="/var/lib/kubelet/pods/472e8cda-299e-405a-b7ea-b2e5543ccec3/volumes" Jul 17 14:13:45.696521 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:45.696492 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6686c70-5045-492b-952d-7c8b0c3267d6" path="/var/lib/kubelet/pods/b6686c70-5045-492b-952d-7c8b0c3267d6/volumes" Jul 17 14:13:46.478379 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:46.478337 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" podUID="8ad5d073-612d-4161-b831-e022bbf0b382" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused" Jul 17 14:13:46.670004 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:46.669966 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:13:46.740535 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:46.740448 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:13:48.989192 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:48.989140 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" podUID="09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused" Jul 17 14:13:52.463086 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:52.463041 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:13:52.623036 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:52.623003 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:13:53.160696 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:53.160651 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:13:56.478286 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:56.478246 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" podUID="8ad5d073-612d-4161-b831-e022bbf0b382" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused" Jul 17 14:13:58.988528 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:13:58.988486 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" podUID="09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused" Jul 17 14:14:06.478154 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:06.478114 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" podUID="8ad5d073-612d-4161-b831-e022bbf0b382" containerName="online" probeResult="failure" output="Get \"https://10.132.0.31:6567/health\": dial tcp 10.132.0.31:6567: connect: connection refused" Jul 17 14:14:06.478549 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:06.478250 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" Jul 17 14:14:08.989046 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:08.989007 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" podUID="09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd" containerName="online" probeResult="failure" output="Get \"https://10.132.0.32:6567/health\": dial tcp 10.132.0.32:6567: connect: connection refused" Jul 17 14:14:08.989447 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:08.989121 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" Jul 17 14:14:09.399792 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:09.399764 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:14:09.511027 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:09.510992 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:14:09.748631 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:09.748542 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:14:09.835782 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:09.835749 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:14:09.902552 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:09.902519 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:14:10.003155 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:10.003074 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:14:10.103537 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:10.103511 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:14:12.424708 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:12.424657 2565 generic.go:356] "Generic (PLEG): container finished" podID="8ad5d073-612d-4161-b831-e022bbf0b382" containerID="2d27639c3cd75dd6d5020b3ca6026e7e015aa6eda95014440688566e464cb58d" exitCode=137 Jul 17 14:14:12.425286 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:12.424809 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" event={"ID":"8ad5d073-612d-4161-b831-e022bbf0b382","Type":"ContainerDied","Data":"2d27639c3cd75dd6d5020b3ca6026e7e015aa6eda95014440688566e464cb58d"} Jul 17 14:14:12.428137 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:12.428111 2565 generic.go:356] "Generic (PLEG): container finished" podID="09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd" containerID="a0392425709416e9be247da7d2049a31beeac2ca6cda1000c42eb44f636fed37" exitCode=137 Jul 17 14:14:12.428287 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:12.428214 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" event={"ID":"09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd","Type":"ContainerDied","Data":"a0392425709416e9be247da7d2049a31beeac2ca6cda1000c42eb44f636fed37"} Jul 17 14:14:12.450264 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:12.450238 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" Jul 17 14:14:12.453543 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:12.453520 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" Jul 17 14:14:12.528261 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:12.528230 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd-feast-data\") pod \"09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd\" (UID: \"09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd\") " Jul 17 14:14:12.528435 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:12.528284 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd-online-tls\") pod \"09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd\" (UID: \"09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd\") " Jul 17 14:14:12.528435 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:12.528329 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8ad5d073-612d-4161-b831-e022bbf0b382-online-tls\") pod \"8ad5d073-612d-4161-b831-e022bbf0b382\" (UID: \"8ad5d073-612d-4161-b831-e022bbf0b382\") " Jul 17 14:14:12.528435 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:12.528353 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd-registry-tls\") pod \"09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd\" (UID: \"09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd\") " Jul 17 14:14:12.528435 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:12.528380 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8ad5d073-612d-4161-b831-e022bbf0b382-feast-data\") pod \"8ad5d073-612d-4161-b831-e022bbf0b382\" (UID: \"8ad5d073-612d-4161-b831-e022bbf0b382\") " Jul 17 14:14:12.528661 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:12.528479 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdlww\" (UniqueName: \"kubernetes.io/projected/09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd-kube-api-access-mdlww\") pod \"09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd\" (UID: \"09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd\") " Jul 17 14:14:12.528661 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:12.528534 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8ad5d073-612d-4161-b831-e022bbf0b382-registry-tls\") pod \"8ad5d073-612d-4161-b831-e022bbf0b382\" (UID: \"8ad5d073-612d-4161-b831-e022bbf0b382\") " Jul 17 14:14:12.528661 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:12.528586 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cp6t8\" (UniqueName: \"kubernetes.io/projected/8ad5d073-612d-4161-b831-e022bbf0b382-kube-api-access-cp6t8\") pod \"8ad5d073-612d-4161-b831-e022bbf0b382\" (UID: \"8ad5d073-612d-4161-b831-e022bbf0b382\") " Jul 17 14:14:12.529722 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:12.529693 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd-feast-data" (OuterVolumeSpecName: "feast-data") pod "09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd" (UID: "09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 14:14:12.531057 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:12.530993 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd" (UID: "09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:14:12.531294 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:12.531269 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ad5d073-612d-4161-b831-e022bbf0b382-online-tls" (OuterVolumeSpecName: "online-tls") pod "8ad5d073-612d-4161-b831-e022bbf0b382" (UID: "8ad5d073-612d-4161-b831-e022bbf0b382"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:14:12.531294 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:12.531272 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd-online-tls" (OuterVolumeSpecName: "online-tls") pod "09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd" (UID: "09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:14:12.531441 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:12.531290 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd-kube-api-access-mdlww" (OuterVolumeSpecName: "kube-api-access-mdlww") pod "09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd" (UID: "09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd"). InnerVolumeSpecName "kube-api-access-mdlww". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 14:14:12.531441 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:12.531320 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ad5d073-612d-4161-b831-e022bbf0b382-kube-api-access-cp6t8" (OuterVolumeSpecName: "kube-api-access-cp6t8") pod "8ad5d073-612d-4161-b831-e022bbf0b382" (UID: "8ad5d073-612d-4161-b831-e022bbf0b382"). InnerVolumeSpecName "kube-api-access-cp6t8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 14:14:12.531710 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:12.531688 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ad5d073-612d-4161-b831-e022bbf0b382-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8ad5d073-612d-4161-b831-e022bbf0b382" (UID: "8ad5d073-612d-4161-b831-e022bbf0b382"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 17 14:14:12.539305 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:12.539256 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ad5d073-612d-4161-b831-e022bbf0b382-feast-data" (OuterVolumeSpecName: "feast-data") pod "8ad5d073-612d-4161-b831-e022bbf0b382" (UID: "8ad5d073-612d-4161-b831-e022bbf0b382"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 14:14:12.629942 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:12.629914 2565 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/8ad5d073-612d-4161-b831-e022bbf0b382-online-tls\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:14:12.629942 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:12.629937 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd-registry-tls\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:14:12.629942 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:12.629946 2565 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/8ad5d073-612d-4161-b831-e022bbf0b382-feast-data\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:14:12.630144 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:12.629954 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdlww\" (UniqueName: \"kubernetes.io/projected/09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd-kube-api-access-mdlww\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:14:12.630144 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:12.629964 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/8ad5d073-612d-4161-b831-e022bbf0b382-registry-tls\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:14:12.630144 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:12.629972 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cp6t8\" (UniqueName: \"kubernetes.io/projected/8ad5d073-612d-4161-b831-e022bbf0b382-kube-api-access-cp6t8\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:14:12.630144 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:12.629980 2565 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd-feast-data\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:14:12.630144 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:12.629987 2565 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd-online-tls\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:14:13.435443 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:13.435416 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" Jul 17 14:14:13.435914 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:13.435441 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc" event={"ID":"09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd","Type":"ContainerDied","Data":"83b5085d9a6177940c42cccaf86fb7285e2bd56c04765a557acef74e8a7c0d9b"} Jul 17 14:14:13.435914 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:13.435510 2565 scope.go:117] "RemoveContainer" containerID="679d40cb26af9c4c3e50677579666999cf86fcc22683338a7a833936bd39015f" Jul 17 14:14:13.438145 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:13.438122 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" event={"ID":"8ad5d073-612d-4161-b831-e022bbf0b382","Type":"ContainerDied","Data":"dd2d3162a82b0838decfc17b2f033a83e5bbc6fa22d6cb8f274f231e1fe3f2ad"} Jul 17 14:14:13.438289 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:13.438144 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8" Jul 17 14:14:13.444931 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:13.444913 2565 scope.go:117] "RemoveContainer" containerID="a0392425709416e9be247da7d2049a31beeac2ca6cda1000c42eb44f636fed37" Jul 17 14:14:13.452909 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:13.452896 2565 scope.go:117] "RemoveContainer" containerID="f246cdfb436c5394ed0b060beebeef8d058f9a729dd5fa6f7b982ef880b0b547" Jul 17 14:14:13.459777 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:13.459756 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc"] Jul 17 14:14:13.460832 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:13.460817 2565 scope.go:117] "RemoveContainer" containerID="c99bc6ff8d2de925796318712d69308ae91814920881617abacf60f6bd8ced15" Jul 17 14:14:13.463479 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:13.463459 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5fbf78c74-4nkfc"] Jul 17 14:14:13.468440 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:13.468420 2565 scope.go:117] "RemoveContainer" containerID="8a29d8ee1d85779f9af13bd04bf8b3862f0472be79115e774da0bfdd6552e561" Jul 17 14:14:13.473442 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:13.473421 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8"] Jul 17 14:14:13.476530 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:13.476511 2565 scope.go:117] "RemoveContainer" containerID="2d27639c3cd75dd6d5020b3ca6026e7e015aa6eda95014440688566e464cb58d" Jul 17 14:14:13.476851 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:13.476833 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-6c7cf9cbf7-wpbd8"] Jul 17 14:14:13.484134 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:13.484118 2565 scope.go:117] "RemoveContainer" containerID="fadcfd019b2d879170e4b96b6749f62ac406506003ed5f1aae777f0df256c10a" Jul 17 14:14:13.491049 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:13.491033 2565 scope.go:117] "RemoveContainer" containerID="93a6fa329814da560063ddd150a29401b59d45d39e1ec6a523fddc12a1d0b533" Jul 17 14:14:13.696485 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:13.696406 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd" path="/var/lib/kubelet/pods/09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd/volumes" Jul 17 14:14:13.696890 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:13.696877 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ad5d073-612d-4161-b831-e022bbf0b382" path="/var/lib/kubelet/pods/8ad5d073-612d-4161-b831-e022bbf0b382/volumes" Jul 17 14:14:21.717144 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:21.717103 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:14:21.781460 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:21.781427 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:14:22.136219 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:22.136155 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:14:30.247500 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:14:30.247468 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:15:13.362449 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:15:13.362412 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:15:24.389104 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:15:24.389064 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:15:24.447694 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:15:24.447663 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:15:45.269548 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:15:45.269442 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:15:45.337877 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:15:45.337842 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:15:45.468904 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:15:45.468859 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:15:45.571984 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:15:45.571949 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:15:45.631543 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:15:45.631512 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:15:45.690595 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:15:45.690558 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:15:45.862971 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:15:45.862888 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:15:45.965128 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:15:45.965098 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:16:21.631491 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:16:21.631462 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-86jkr_c4b20c0f-f85e-488d-aee9-b772cb8738a0/console-operator/1.log" Jul 17 14:16:21.633762 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:16:21.633726 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-86jkr_c4b20c0f-f85e-488d-aee9-b772cb8738a0/console-operator/1.log" Jul 17 14:16:44.598823 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:16:44.598785 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:17:11.352741 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:17:11.352701 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:17:11.453925 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:17:11.453888 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:17:11.619073 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:17:11.618995 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:17:11.707442 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:17:11.707405 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:17:11.772941 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:17:11.772915 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:17:12.081886 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:17:12.081853 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:17:12.221819 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:17:12.221785 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:17:16.489807 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:17:16.489768 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:17:57.533681 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:17:57.533642 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:17:57.590558 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:17:57.590511 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:18:33.273160 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:18:33.273123 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:18:33.375269 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:18:33.375239 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:18:33.451584 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:18:33.451543 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:18:33.513089 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:18:33.513059 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:18:38.572580 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:18:38.572542 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:19:16.195998 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:19:16.195965 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:19:17.364727 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:19:17.364693 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:19:21.875261 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:19:21.875208 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:19:21.938472 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:19:21.938444 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:19:41.370641 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:19:41.370598 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:19:41.460468 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:19:41.460439 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:19:43.796064 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:19:43.796027 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:19:43.897333 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:19:43.897297 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:19:44.034304 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:19:44.034255 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:19:44.095455 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:19:44.095343 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:19:44.249257 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:19:44.249197 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:19:44.350809 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:19:44.350726 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:20:27.944690 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:20:27.944598 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:20:28.013421 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:20:28.013384 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:21:05.205388 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:21:05.205277 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:21:05.284353 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:21:05.284323 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:21:05.405212 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:21:05.405155 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:21:05.505459 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:21:05.505376 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:21:05.616533 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:21:05.616503 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:21:05.737499 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:21:05.737464 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:21:05.837848 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:21:05.837817 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:21:06.306602 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:21:06.306570 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:21:21.655254 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:21:21.655225 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-86jkr_c4b20c0f-f85e-488d-aee9-b772cb8738a0/console-operator/1.log" Jul 17 14:21:21.658021 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:21:21.658001 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-86jkr_c4b20c0f-f85e-488d-aee9-b772cb8738a0/console-operator/1.log" Jul 17 14:22:31.358243 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:22:31.358211 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:22:31.413965 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:22:31.413938 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:23:36.425992 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:23:36.425907 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:23:52.074762 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:23:52.074723 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:23:52.141288 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:23:52.141256 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:23:52.221527 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:23:52.221484 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:23:52.284914 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:23:52.284886 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:23:52.359786 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:23:52.359696 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:23:57.455109 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:23:57.455063 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:23:58.214968 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:23:58.214929 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:24:35.208367 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:35.208336 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:24:36.514565 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:36.514535 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:24:41.172368 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:41.172315 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:24:41.258513 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:41.258456 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:24:42.029595 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.029515 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p7xkh/must-gather-xzqpf"] Jul 17 14:24:42.029895 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.029879 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ad5d073-612d-4161-b831-e022bbf0b382" containerName="online" Jul 17 14:24:42.029989 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.029900 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ad5d073-612d-4161-b831-e022bbf0b382" containerName="online" Jul 17 14:24:42.029989 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.029914 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ad5d073-612d-4161-b831-e022bbf0b382" containerName="feast-apply" Jul 17 14:24:42.029989 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.029924 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ad5d073-612d-4161-b831-e022bbf0b382" containerName="feast-apply" Jul 17 14:24:42.029989 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.029942 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd" containerName="feast-init" Jul 17 14:24:42.029989 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.029950 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd" containerName="feast-init" Jul 17 14:24:42.029989 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.029961 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="472e8cda-299e-405a-b7ea-b2e5543ccec3" containerName="redis" Jul 17 14:24:42.029989 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.029967 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="472e8cda-299e-405a-b7ea-b2e5543ccec3" containerName="redis" Jul 17 14:24:42.029989 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.029973 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd" containerName="feast-apply" Jul 17 14:24:42.029989 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.029978 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd" containerName="feast-apply" Jul 17 14:24:42.029989 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.029994 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ad5d073-612d-4161-b831-e022bbf0b382" containerName="registry" Jul 17 14:24:42.030409 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.030000 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ad5d073-612d-4161-b831-e022bbf0b382" containerName="registry" Jul 17 14:24:42.030409 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.030006 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd" containerName="online" Jul 17 14:24:42.030409 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.030011 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd" containerName="online" Jul 17 14:24:42.030409 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.030020 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ad5d073-612d-4161-b831-e022bbf0b382" containerName="feast-init" Jul 17 14:24:42.030409 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.030028 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ad5d073-612d-4161-b831-e022bbf0b382" containerName="feast-init" Jul 17 14:24:42.030409 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.030036 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd" containerName="registry" Jul 17 14:24:42.030409 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.030044 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd" containerName="registry" Jul 17 14:24:42.030409 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.030058 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6686c70-5045-492b-952d-7c8b0c3267d6" containerName="postgres" Jul 17 14:24:42.030409 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.030067 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6686c70-5045-492b-952d-7c8b0c3267d6" containerName="postgres" Jul 17 14:24:42.030409 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.030078 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6bd66966-3d6c-4338-9c13-b9bd0fa4acc1" containerName="manager" Jul 17 14:24:42.030409 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.030083 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6bd66966-3d6c-4338-9c13-b9bd0fa4acc1" containerName="manager" Jul 17 14:24:42.030409 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.030144 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6686c70-5045-492b-952d-7c8b0c3267d6" containerName="postgres" Jul 17 14:24:42.030409 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.030152 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ad5d073-612d-4161-b831-e022bbf0b382" containerName="registry" Jul 17 14:24:42.030409 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.030159 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="472e8cda-299e-405a-b7ea-b2e5543ccec3" containerName="redis" Jul 17 14:24:42.030409 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.030166 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6bd66966-3d6c-4338-9c13-b9bd0fa4acc1" containerName="manager" Jul 17 14:24:42.030409 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.030190 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ad5d073-612d-4161-b831-e022bbf0b382" containerName="online" Jul 17 14:24:42.030409 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.030198 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd" containerName="registry" Jul 17 14:24:42.030409 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.030206 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="09c9c48f-ab42-4c1c-84fc-ec7069d7a8fd" containerName="online" Jul 17 14:24:42.033430 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.033407 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p7xkh/must-gather-xzqpf" Jul 17 14:24:42.038905 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.038886 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p7xkh\"/\"kube-root-ca.crt\"" Jul 17 14:24:42.039022 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.038939 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-p7xkh\"/\"default-dockercfg-nc2jh\"" Jul 17 14:24:42.039022 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.038963 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p7xkh\"/\"openshift-service-ca.crt\"" Jul 17 14:24:42.049610 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.049590 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p7xkh/must-gather-xzqpf"] Jul 17 14:24:42.058727 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.058700 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:24:42.120147 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.120123 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v9wf\" (UniqueName: \"kubernetes.io/projected/d9b22273-8bf1-48c4-b16e-755291f02bcc-kube-api-access-6v9wf\") pod \"must-gather-xzqpf\" (UID: \"d9b22273-8bf1-48c4-b16e-755291f02bcc\") " pod="openshift-must-gather-p7xkh/must-gather-xzqpf" Jul 17 14:24:42.120293 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.120230 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d9b22273-8bf1-48c4-b16e-755291f02bcc-must-gather-output\") pod \"must-gather-xzqpf\" (UID: \"d9b22273-8bf1-48c4-b16e-755291f02bcc\") " pod="openshift-must-gather-p7xkh/must-gather-xzqpf" Jul 17 14:24:42.130411 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.130384 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:24:42.220547 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.220522 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d9b22273-8bf1-48c4-b16e-755291f02bcc-must-gather-output\") pod \"must-gather-xzqpf\" (UID: \"d9b22273-8bf1-48c4-b16e-755291f02bcc\") " pod="openshift-must-gather-p7xkh/must-gather-xzqpf" Jul 17 14:24:42.220861 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.220560 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v9wf\" (UniqueName: \"kubernetes.io/projected/d9b22273-8bf1-48c4-b16e-755291f02bcc-kube-api-access-6v9wf\") pod \"must-gather-xzqpf\" (UID: \"d9b22273-8bf1-48c4-b16e-755291f02bcc\") " pod="openshift-must-gather-p7xkh/must-gather-xzqpf" Jul 17 14:24:42.220916 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.220899 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d9b22273-8bf1-48c4-b16e-755291f02bcc-must-gather-output\") pod \"must-gather-xzqpf\" (UID: \"d9b22273-8bf1-48c4-b16e-755291f02bcc\") " pod="openshift-must-gather-p7xkh/must-gather-xzqpf" Jul 17 14:24:42.228756 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.228738 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v9wf\" (UniqueName: \"kubernetes.io/projected/d9b22273-8bf1-48c4-b16e-755291f02bcc-kube-api-access-6v9wf\") pod \"must-gather-xzqpf\" (UID: \"d9b22273-8bf1-48c4-b16e-755291f02bcc\") " pod="openshift-must-gather-p7xkh/must-gather-xzqpf" Jul 17 14:24:42.356934 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.356846 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p7xkh/must-gather-xzqpf" Jul 17 14:24:42.498731 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.498563 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p7xkh/must-gather-xzqpf"] Jul 17 14:24:42.500835 ip-10-0-138-92 kubenswrapper[2565]: W0717 14:24:42.500809 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd9b22273_8bf1_48c4_b16e_755291f02bcc.slice/crio-7314369d1bb737e2b536b444fdaed659419aa1102f3bb7b57ae9deb3ada0a73a WatchSource:0}: Error finding container 7314369d1bb737e2b536b444fdaed659419aa1102f3bb7b57ae9deb3ada0a73a: Status 404 returned error can't find the container with id 7314369d1bb737e2b536b444fdaed659419aa1102f3bb7b57ae9deb3ada0a73a Jul 17 14:24:42.502670 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.502652 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 17 14:24:42.811406 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:42.811377 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p7xkh/must-gather-xzqpf" event={"ID":"d9b22273-8bf1-48c4-b16e-755291f02bcc","Type":"ContainerStarted","Data":"7314369d1bb737e2b536b444fdaed659419aa1102f3bb7b57ae9deb3ada0a73a"} Jul 17 14:24:49.843392 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:49.843349 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p7xkh/must-gather-xzqpf" event={"ID":"d9b22273-8bf1-48c4-b16e-755291f02bcc","Type":"ContainerStarted","Data":"43bb593253e0ee16ea8028f4927e0a795d12e8b79ac3c3c265ba09cb17432389"} Jul 17 14:24:49.843392 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:49.843395 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p7xkh/must-gather-xzqpf" event={"ID":"d9b22273-8bf1-48c4-b16e-755291f02bcc","Type":"ContainerStarted","Data":"c546f680f854bc9fdb00634273bf425f6dbbf59600c1ae84fe2bcb27c563ad38"} Jul 17 14:24:49.858804 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:49.858747 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-p7xkh/must-gather-xzqpf" podStartSLOduration=1.500658633 podStartE2EDuration="7.85873239s" totalImagesPullingTime="6.358073757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 14:24:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:24:49.85732884 +0000 UTC m=+1708.685681186" watchObservedRunningTime="2026-07-17 14:24:49.85873239 +0000 UTC m=+1708.687084736" Jul 17 14:24:58.881290 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:58.881253 2565 generic.go:356] "Generic (PLEG): container finished" podID="d9b22273-8bf1-48c4-b16e-755291f02bcc" containerID="c546f680f854bc9fdb00634273bf425f6dbbf59600c1ae84fe2bcb27c563ad38" exitCode=0 Jul 17 14:24:58.881715 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:58.881324 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p7xkh/must-gather-xzqpf" event={"ID":"d9b22273-8bf1-48c4-b16e-755291f02bcc","Type":"ContainerDied","Data":"c546f680f854bc9fdb00634273bf425f6dbbf59600c1ae84fe2bcb27c563ad38"} Jul 17 14:24:58.881715 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:58.881616 2565 scope.go:117] "RemoveContainer" containerID="c546f680f854bc9fdb00634273bf425f6dbbf59600c1ae84fe2bcb27c563ad38" Jul 17 14:24:59.526218 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:59.526171 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-p7xkh_must-gather-xzqpf_d9b22273-8bf1-48c4-b16e-755291f02bcc/gather/0.log" Jul 17 14:24:59.885409 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:24:59.885379 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:25:00.054521 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:00.054483 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:25:00.128958 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:00.128920 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:25:03.060404 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:03.060374 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zjn62_6a493036-14a3-45e6-b0ac-db183e813fc8/global-pull-secret-syncer/0.log" Jul 17 14:25:03.113155 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:03.113121 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" Jul 17 14:25:03.237268 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:03.237231 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-92.ec2.internal_84dd6aaeace753174afb8903ed9d6bac/haproxy/0.log" Jul 17 14:25:04.864414 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:04.864360 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-p7xkh/must-gather-xzqpf"] Jul 17 14:25:04.864993 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:04.864575 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-p7xkh/must-gather-xzqpf" podUID="d9b22273-8bf1-48c4-b16e-755291f02bcc" containerName="copy" containerID="cri-o://43bb593253e0ee16ea8028f4927e0a795d12e8b79ac3c3c265ba09cb17432389" gracePeriod=2 Jul 17 14:25:04.866380 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:04.866351 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-p7xkh/must-gather-xzqpf"] Jul 17 14:25:04.866639 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:25:04.866609 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-xzqpf\" is forbidden: User \"system:node:ip-10-0-138-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-p7xkh\": no relationship found between node 'ip-10-0-138-92.ec2.internal' and this object" podUID="d9b22273-8bf1-48c4-b16e-755291f02bcc" pod="openshift-must-gather-p7xkh/must-gather-xzqpf" Jul 17 14:25:05.087153 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:05.087132 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-p7xkh_must-gather-xzqpf_d9b22273-8bf1-48c4-b16e-755291f02bcc/copy/0.log" Jul 17 14:25:05.088785 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:05.088770 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p7xkh/must-gather-xzqpf" Jul 17 14:25:05.090156 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:25:05.090129 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-xzqpf\" is forbidden: User \"system:node:ip-10-0-138-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-p7xkh\": no relationship found between node 'ip-10-0-138-92.ec2.internal' and this object" podUID="d9b22273-8bf1-48c4-b16e-755291f02bcc" pod="openshift-must-gather-p7xkh/must-gather-xzqpf" Jul 17 14:25:05.222786 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:05.222722 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d9b22273-8bf1-48c4-b16e-755291f02bcc-must-gather-output\") pod \"d9b22273-8bf1-48c4-b16e-755291f02bcc\" (UID: \"d9b22273-8bf1-48c4-b16e-755291f02bcc\") " Jul 17 14:25:05.222903 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:05.222789 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6v9wf\" (UniqueName: \"kubernetes.io/projected/d9b22273-8bf1-48c4-b16e-755291f02bcc-kube-api-access-6v9wf\") pod \"d9b22273-8bf1-48c4-b16e-755291f02bcc\" (UID: \"d9b22273-8bf1-48c4-b16e-755291f02bcc\") " Jul 17 14:25:05.223154 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:05.223124 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9b22273-8bf1-48c4-b16e-755291f02bcc-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "d9b22273-8bf1-48c4-b16e-755291f02bcc" (UID: "d9b22273-8bf1-48c4-b16e-755291f02bcc"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 17 14:25:05.225053 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:05.225035 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9b22273-8bf1-48c4-b16e-755291f02bcc-kube-api-access-6v9wf" (OuterVolumeSpecName: "kube-api-access-6v9wf") pod "d9b22273-8bf1-48c4-b16e-755291f02bcc" (UID: "d9b22273-8bf1-48c4-b16e-755291f02bcc"). InnerVolumeSpecName "kube-api-access-6v9wf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 17 14:25:05.323306 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:05.323262 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6v9wf\" (UniqueName: \"kubernetes.io/projected/d9b22273-8bf1-48c4-b16e-755291f02bcc-kube-api-access-6v9wf\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:25:05.323306 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:05.323301 2565 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d9b22273-8bf1-48c4-b16e-755291f02bcc-must-gather-output\") on node \"ip-10-0-138-92.ec2.internal\" DevicePath \"\"" Jul 17 14:25:05.545059 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:05.545026 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:25:05.606166 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:05.606119 2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lmcm_daa5b207-dac5-4e52-90a4-e144871e2db1/konnectivity-agent/0.log" limit=1024 Jul 17 14:25:05.695880 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:05.695854 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9b22273-8bf1-48c4-b16e-755291f02bcc" path="/var/lib/kubelet/pods/d9b22273-8bf1-48c4-b16e-755291f02bcc/volumes" Jul 17 14:25:05.908892 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:05.908819 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-p7xkh_must-gather-xzqpf_d9b22273-8bf1-48c4-b16e-755291f02bcc/copy/0.log" Jul 17 14:25:05.909352 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:05.909166 2565 generic.go:356] "Generic (PLEG): container finished" podID="d9b22273-8bf1-48c4-b16e-755291f02bcc" containerID="43bb593253e0ee16ea8028f4927e0a795d12e8b79ac3c3c265ba09cb17432389" exitCode=143 Jul 17 14:25:05.909352 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:05.909246 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p7xkh/must-gather-xzqpf" Jul 17 14:25:05.909352 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:05.909289 2565 scope.go:117] "RemoveContainer" containerID="43bb593253e0ee16ea8028f4927e0a795d12e8b79ac3c3c265ba09cb17432389" Jul 17 14:25:05.917241 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:05.917225 2565 scope.go:117] "RemoveContainer" containerID="c546f680f854bc9fdb00634273bf425f6dbbf59600c1ae84fe2bcb27c563ad38" Jul 17 14:25:05.929123 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:05.929106 2565 scope.go:117] "RemoveContainer" containerID="43bb593253e0ee16ea8028f4927e0a795d12e8b79ac3c3c265ba09cb17432389" Jul 17 14:25:05.929398 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:25:05.929380 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43bb593253e0ee16ea8028f4927e0a795d12e8b79ac3c3c265ba09cb17432389\": container with ID starting with 43bb593253e0ee16ea8028f4927e0a795d12e8b79ac3c3c265ba09cb17432389 not found: ID does not exist" containerID="43bb593253e0ee16ea8028f4927e0a795d12e8b79ac3c3c265ba09cb17432389" Jul 17 14:25:05.929485 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:05.929409 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43bb593253e0ee16ea8028f4927e0a795d12e8b79ac3c3c265ba09cb17432389"} err="failed to get container status \"43bb593253e0ee16ea8028f4927e0a795d12e8b79ac3c3c265ba09cb17432389\": rpc error: code = NotFound desc = could not find container \"43bb593253e0ee16ea8028f4927e0a795d12e8b79ac3c3c265ba09cb17432389\": container with ID starting with 43bb593253e0ee16ea8028f4927e0a795d12e8b79ac3c3c265ba09cb17432389 not found: ID does not exist" Jul 17 14:25:05.929485 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:05.929432 2565 scope.go:117] "RemoveContainer" containerID="c546f680f854bc9fdb00634273bf425f6dbbf59600c1ae84fe2bcb27c563ad38" Jul 17 14:25:05.929704 ip-10-0-138-92 kubenswrapper[2565]: E0717 14:25:05.929683 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c546f680f854bc9fdb00634273bf425f6dbbf59600c1ae84fe2bcb27c563ad38\": container with ID starting with c546f680f854bc9fdb00634273bf425f6dbbf59600c1ae84fe2bcb27c563ad38 not found: ID does not exist" containerID="c546f680f854bc9fdb00634273bf425f6dbbf59600c1ae84fe2bcb27c563ad38" Jul 17 14:25:05.929744 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:05.929710 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c546f680f854bc9fdb00634273bf425f6dbbf59600c1ae84fe2bcb27c563ad38"} err="failed to get container status \"c546f680f854bc9fdb00634273bf425f6dbbf59600c1ae84fe2bcb27c563ad38\": rpc error: code = NotFound desc = could not find container \"c546f680f854bc9fdb00634273bf425f6dbbf59600c1ae84fe2bcb27c563ad38\": container with ID starting with c546f680f854bc9fdb00634273bf425f6dbbf59600c1ae84fe2bcb27c563ad38 not found: ID does not exist" Jul 17 14:25:06.500320 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:06.500290 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-kjqdb_418f4e52-7ba5-475c-83a7-f23adbfd0f21/cluster-monitoring-operator/0.log" Jul 17 14:25:06.758536 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:06.758461 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nn6ks_6c2a3578-fd94-493b-9e16-2f4c957213e0/node-exporter/0.log" Jul 17 14:25:06.784933 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:06.784908 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nn6ks_6c2a3578-fd94-493b-9e16-2f4c957213e0/kube-rbac-proxy/0.log" Jul 17 14:25:06.812691 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:06.812668 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nn6ks_6c2a3578-fd94-493b-9e16-2f4c957213e0/init-textfile/0.log" Jul 17 14:25:07.054240 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:07.054218 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-djf6w_80a082ab-8450-4eb7-b646-1692ce6e24d1/kube-rbac-proxy-main/0.log" Jul 17 14:25:07.088902 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:07.088877 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-djf6w_80a082ab-8450-4eb7-b646-1692ce6e24d1/kube-rbac-proxy-self/0.log" Jul 17 14:25:07.117804 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:07.117785 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-79f6958cdf-djf6w_80a082ab-8450-4eb7-b646-1692ce6e24d1/openshift-state-metrics/0.log" Jul 17 14:25:07.647760 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:07.647724 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-ccbf95c6c-bnmzs_9fc89814-a55f-4311-86ae-c79d44efe0bb/telemeter-client/0.log" Jul 17 14:25:07.686404 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:07.686381 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-ccbf95c6c-bnmzs_9fc89814-a55f-4311-86ae-c79d44efe0bb/reload/0.log" Jul 17 14:25:07.710873 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:07.710853 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-ccbf95c6c-bnmzs_9fc89814-a55f-4311-86ae-c79d44efe0bb/kube-rbac-proxy/0.log" Jul 17 14:25:07.743478 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:07.743446 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f6b675695-l9d94_3810dd92-7808-4834-9140-7bff1ea942a1/thanos-query/0.log" Jul 17 14:25:07.772155 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:07.772131 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f6b675695-l9d94_3810dd92-7808-4834-9140-7bff1ea942a1/kube-rbac-proxy-web/0.log" Jul 17 14:25:07.798977 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:07.798956 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f6b675695-l9d94_3810dd92-7808-4834-9140-7bff1ea942a1/kube-rbac-proxy/0.log" Jul 17 14:25:07.825493 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:07.825449 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f6b675695-l9d94_3810dd92-7808-4834-9140-7bff1ea942a1/prom-label-proxy/0.log" Jul 17 14:25:07.863566 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:07.863545 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f6b675695-l9d94_3810dd92-7808-4834-9140-7bff1ea942a1/kube-rbac-proxy-rules/0.log" Jul 17 14:25:07.909734 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:07.909625 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6f6b675695-l9d94_3810dd92-7808-4834-9140-7bff1ea942a1/kube-rbac-proxy-metrics/0.log" Jul 17 14:25:09.833616 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:09.833582 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-86jkr_c4b20c0f-f85e-488d-aee9-b772cb8738a0/console-operator/1.log" Jul 17 14:25:09.841708 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:09.841684 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-86jkr_c4b20c0f-f85e-488d-aee9-b772cb8738a0/console-operator/2.log" Jul 17 14:25:10.551959 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:10.551927 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lzz5v/perf-node-gather-daemonset-l8rm6"] Jul 17 14:25:10.552276 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:10.552264 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9b22273-8bf1-48c4-b16e-755291f02bcc" containerName="gather" Jul 17 14:25:10.552326 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:10.552278 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9b22273-8bf1-48c4-b16e-755291f02bcc" containerName="gather" Jul 17 14:25:10.552326 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:10.552291 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9b22273-8bf1-48c4-b16e-755291f02bcc" containerName="copy" Jul 17 14:25:10.552326 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:10.552296 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9b22273-8bf1-48c4-b16e-755291f02bcc" containerName="copy" Jul 17 14:25:10.552428 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:10.552364 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9b22273-8bf1-48c4-b16e-755291f02bcc" containerName="gather" Jul 17 14:25:10.552428 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:10.552371 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9b22273-8bf1-48c4-b16e-755291f02bcc" containerName="copy" Jul 17 14:25:10.555781 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:10.555763 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-l8rm6" Jul 17 14:25:10.559118 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:10.559095 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lzz5v\"/\"kube-root-ca.crt\"" Jul 17 14:25:10.559270 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:10.559142 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lzz5v\"/\"default-dockercfg-st7cx\"" Jul 17 14:25:10.562256 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:10.562220 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lzz5v\"/\"openshift-service-ca.crt\"" Jul 17 14:25:10.567260 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:10.567239 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8826f\" (UniqueName: \"kubernetes.io/projected/73edc51e-16c7-427e-8865-a8647beb64b2-kube-api-access-8826f\") pod \"perf-node-gather-daemonset-l8rm6\" (UID: \"73edc51e-16c7-427e-8865-a8647beb64b2\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-l8rm6" Jul 17 14:25:10.567360 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:10.567297 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/73edc51e-16c7-427e-8865-a8647beb64b2-proc\") pod \"perf-node-gather-daemonset-l8rm6\" (UID: \"73edc51e-16c7-427e-8865-a8647beb64b2\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-l8rm6" Jul 17 14:25:10.567360 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:10.567350 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/73edc51e-16c7-427e-8865-a8647beb64b2-lib-modules\") pod \"perf-node-gather-daemonset-l8rm6\" (UID: \"73edc51e-16c7-427e-8865-a8647beb64b2\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-l8rm6" Jul 17 14:25:10.567453 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:10.567386 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/73edc51e-16c7-427e-8865-a8647beb64b2-podres\") pod \"perf-node-gather-daemonset-l8rm6\" (UID: \"73edc51e-16c7-427e-8865-a8647beb64b2\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-l8rm6" Jul 17 14:25:10.567453 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:10.567413 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73edc51e-16c7-427e-8865-a8647beb64b2-sys\") pod \"perf-node-gather-daemonset-l8rm6\" (UID: \"73edc51e-16c7-427e-8865-a8647beb64b2\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-l8rm6" Jul 17 14:25:10.573337 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:10.573318 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lzz5v/perf-node-gather-daemonset-l8rm6"] Jul 17 14:25:10.668335 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:10.668299 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8826f\" (UniqueName: \"kubernetes.io/projected/73edc51e-16c7-427e-8865-a8647beb64b2-kube-api-access-8826f\") pod \"perf-node-gather-daemonset-l8rm6\" (UID: \"73edc51e-16c7-427e-8865-a8647beb64b2\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-l8rm6" Jul 17 14:25:10.668524 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:10.668353 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/73edc51e-16c7-427e-8865-a8647beb64b2-proc\") pod \"perf-node-gather-daemonset-l8rm6\" (UID: \"73edc51e-16c7-427e-8865-a8647beb64b2\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-l8rm6" Jul 17 14:25:10.668524 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:10.668371 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/73edc51e-16c7-427e-8865-a8647beb64b2-lib-modules\") pod \"perf-node-gather-daemonset-l8rm6\" (UID: \"73edc51e-16c7-427e-8865-a8647beb64b2\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-l8rm6" Jul 17 14:25:10.668524 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:10.668391 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/73edc51e-16c7-427e-8865-a8647beb64b2-podres\") pod \"perf-node-gather-daemonset-l8rm6\" (UID: \"73edc51e-16c7-427e-8865-a8647beb64b2\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-l8rm6" Jul 17 14:25:10.668524 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:10.668422 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73edc51e-16c7-427e-8865-a8647beb64b2-sys\") pod \"perf-node-gather-daemonset-l8rm6\" (UID: \"73edc51e-16c7-427e-8865-a8647beb64b2\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-l8rm6" Jul 17 14:25:10.668524 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:10.668451 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/73edc51e-16c7-427e-8865-a8647beb64b2-proc\") pod \"perf-node-gather-daemonset-l8rm6\" (UID: \"73edc51e-16c7-427e-8865-a8647beb64b2\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-l8rm6" Jul 17 14:25:10.668524 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:10.668494 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73edc51e-16c7-427e-8865-a8647beb64b2-sys\") pod \"perf-node-gather-daemonset-l8rm6\" (UID: \"73edc51e-16c7-427e-8865-a8647beb64b2\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-l8rm6" Jul 17 14:25:10.668524 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:10.668521 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/73edc51e-16c7-427e-8865-a8647beb64b2-lib-modules\") pod \"perf-node-gather-daemonset-l8rm6\" (UID: \"73edc51e-16c7-427e-8865-a8647beb64b2\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-l8rm6" Jul 17 14:25:10.668773 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:10.668579 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/73edc51e-16c7-427e-8865-a8647beb64b2-podres\") pod \"perf-node-gather-daemonset-l8rm6\" (UID: \"73edc51e-16c7-427e-8865-a8647beb64b2\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-l8rm6" Jul 17 14:25:10.676774 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:10.676752 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8826f\" (UniqueName: \"kubernetes.io/projected/73edc51e-16c7-427e-8865-a8647beb64b2-kube-api-access-8826f\") pod \"perf-node-gather-daemonset-l8rm6\" (UID: \"73edc51e-16c7-427e-8865-a8647beb64b2\") " pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-l8rm6" Jul 17 14:25:10.855205 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:10.855111 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-9l9rw_10b00003-e1e9-41fb-8218-479d03a2c5a9/volume-data-source-validator/0.log" Jul 17 14:25:10.865028 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:10.865006 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-l8rm6" Jul 17 14:25:11.004806 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:11.004781 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lzz5v/perf-node-gather-daemonset-l8rm6"] Jul 17 14:25:11.007157 ip-10-0-138-92 kubenswrapper[2565]: W0717 14:25:11.007131 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod73edc51e_16c7_427e_8865_a8647beb64b2.slice/crio-1882a827d544c124f5a76386abdc233fc0974b89623d0a2cfbcd0906ac3d3620 WatchSource:0}: Error finding container 1882a827d544c124f5a76386abdc233fc0974b89623d0a2cfbcd0906ac3d3620: Status 404 returned error can't find the container with id 1882a827d544c124f5a76386abdc233fc0974b89623d0a2cfbcd0906ac3d3620 Jul 17 14:25:11.722594 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:11.722567 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qhjd8_9c528470-2f64-4de3-918a-9e510c262890/dns/0.log" Jul 17 14:25:11.752213 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:11.752165 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qhjd8_9c528470-2f64-4de3-918a-9e510c262890/kube-rbac-proxy/0.log" Jul 17 14:25:11.830069 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:11.830040 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7vl2s_a89f466c-3e1d-436f-a747-eb674d94e1ad/dns-node-resolver/0.log" Jul 17 14:25:11.939729 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:11.939698 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-l8rm6" event={"ID":"73edc51e-16c7-427e-8865-a8647beb64b2","Type":"ContainerStarted","Data":"3d4a98ab3375cc4a77d6f0195484d947bf7886decefc7d7a3bbcfadb9480c46e"} Jul 17 14:25:11.940108 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:11.939743 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-l8rm6" event={"ID":"73edc51e-16c7-427e-8865-a8647beb64b2","Type":"ContainerStarted","Data":"1882a827d544c124f5a76386abdc233fc0974b89623d0a2cfbcd0906ac3d3620"} Jul 17 14:25:11.940108 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:11.939795 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-l8rm6" Jul 17 14:25:11.953483 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:11.953441 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-l8rm6" podStartSLOduration=1.953426351 podStartE2EDuration="1.953426351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 14:25:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 14:25:11.952539816 +0000 UTC m=+1730.780892163" watchObservedRunningTime="2026-07-17 14:25:11.953426351 +0000 UTC m=+1730.781778696" Jul 17 14:25:12.331391 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:12.331361 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h5vnp_0f760d5c-f6ca-406b-bc61-b18d9d6182fb/node-ca/0.log" Jul 17 14:25:13.053564 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:13.053531 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-76cc77cc44-b58sp_82857eb2-5266-41f0-a333-56f15ab82e28/router/0.log" Jul 17 14:25:13.365994 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:13.365897 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-47dp7_a6a77fbc-7a50-43ba-9c98-3655564837f6/serve-healthcheck-canary/0.log" Jul 17 14:25:13.763408 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:13.763319 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-r6gsw_313552d6-2c32-4553-98fc-2a5f01d7722c/insights-operator/0.log" Jul 17 14:25:13.764483 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:13.764454 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-r6gsw_313552d6-2c32-4553-98fc-2a5f01d7722c/insights-operator/1.log" Jul 17 14:25:13.880767 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:13.880739 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5cd8l_3d263a70-7272-470e-b960-382c647f0dd1/kube-rbac-proxy/0.log" Jul 17 14:25:13.906302 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:13.906281 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5cd8l_3d263a70-7272-470e-b960-382c647f0dd1/exporter/0.log" Jul 17 14:25:13.933893 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:13.933868 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5cd8l_3d263a70-7272-470e-b960-382c647f0dd1/extractor/0.log" Jul 17 14:25:17.953585 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:17.953557 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lzz5v/perf-node-gather-daemonset-l8rm6" Jul 17 14:25:18.602349 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:18.602317 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-phbnw_45230f7f-2bb9-4737-adf5-e47da33d503c/kube-storage-version-migrator-operator/1.log" Jul 17 14:25:18.603791 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:18.603768 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7658d9b749-phbnw_45230f7f-2bb9-4737-adf5-e47da33d503c/kube-storage-version-migrator-operator/0.log" Jul 17 14:25:20.215014 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:20.214935 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v68k8_67792ecb-4c2c-4d9d-ae18-fcc9fe824b46/kube-multus-additional-cni-plugins/0.log" Jul 17 14:25:20.255301 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:20.255272 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v68k8_67792ecb-4c2c-4d9d-ae18-fcc9fe824b46/egress-router-binary-copy/0.log" Jul 17 14:25:20.286227 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:20.286198 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v68k8_67792ecb-4c2c-4d9d-ae18-fcc9fe824b46/cni-plugins/0.log" Jul 17 14:25:20.312775 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:20.312751 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v68k8_67792ecb-4c2c-4d9d-ae18-fcc9fe824b46/bond-cni-plugin/0.log" Jul 17 14:25:20.338218 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:20.338173 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v68k8_67792ecb-4c2c-4d9d-ae18-fcc9fe824b46/routeoverride-cni/0.log" Jul 17 14:25:20.363348 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:20.363324 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v68k8_67792ecb-4c2c-4d9d-ae18-fcc9fe824b46/whereabouts-cni-bincopy/0.log" Jul 17 14:25:20.401265 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:20.401242 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v68k8_67792ecb-4c2c-4d9d-ae18-fcc9fe824b46/whereabouts-cni/0.log" Jul 17 14:25:20.510559 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:20.510471 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-jxlrl_5d00f939-d019-4401-9be8-43ac747c82c9/kube-multus/0.log" Jul 17 14:25:20.600800 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:20.600773 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kbq75_cbf9af62-a8f3-4f20-829d-6b23e69b412e/network-metrics-daemon/0.log" Jul 17 14:25:20.628204 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:20.628156 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-kbq75_cbf9af62-a8f3-4f20-829d-6b23e69b412e/kube-rbac-proxy/0.log" Jul 17 14:25:21.510890 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:21.510856 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5rgk4_47d4c929-8979-422d-a56e-c339542aa947/ovn-controller/0.log" Jul 17 14:25:21.540462 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:21.540433 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5rgk4_47d4c929-8979-422d-a56e-c339542aa947/ovn-acl-logging/0.log" Jul 17 14:25:21.575437 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:21.575410 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5rgk4_47d4c929-8979-422d-a56e-c339542aa947/kube-rbac-proxy-node/0.log" Jul 17 14:25:21.608812 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:21.608734 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5rgk4_47d4c929-8979-422d-a56e-c339542aa947/kube-rbac-proxy-ovn-metrics/0.log" Jul 17 14:25:21.649570 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:21.649542 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5rgk4_47d4c929-8979-422d-a56e-c339542aa947/northd/0.log" Jul 17 14:25:21.680426 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:21.680402 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5rgk4_47d4c929-8979-422d-a56e-c339542aa947/nbdb/0.log" Jul 17 14:25:21.713548 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:21.713527 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5rgk4_47d4c929-8979-422d-a56e-c339542aa947/sbdb/0.log" Jul 17 14:25:21.792474 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:21.792450 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5rgk4_47d4c929-8979-422d-a56e-c339542aa947/ovnkube-controller/0.log" Jul 17 14:25:23.452500 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:23.452468 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7bc5b6bf85-mclw4_b5f8c02b-c7ab-4e40-9502-0186ac149d3c/check-endpoints/0.log" Jul 17 14:25:23.553309 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:23.553279 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-g6tlt_cd745e32-d2eb-4680-b42d-65a7410a8669/network-check-target-container/0.log" Jul 17 14:25:24.491842 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:24.491816 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-7x4qw_02fc3761-d97b-4f88-8b93-e3f3831728d8/iptables-alerter/0.log" Jul 17 14:25:25.304345 ip-10-0-138-92 kubenswrapper[2565]: I0717 14:25:25.304317 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-2ptt4_b64b331c-1e50-44df-96e8-3d2419bb0653/tuned/0.log"